Stack Overflow
Stack Overflow

Questions tagged [aws-dms]

AWS Database Migration Service (AWS DMS) can migrate your data to and from most widely used commercial and open-source databases such as Oracle, PostgreSQL, Microsoft SQL Server, Amazon Redshift, Amazon Aurora, MariaDB, and MySQL. The service supports homogeneous migrations such as Oracle to Oracle, and also heterogeneous migrations between different database platforms, such as Oracle to MySQL. The source or target database must be on an AWS service.

http://docs.aws.amazon.com/dms/latest/userguide/Welcome.html

291 questions
11
votes
3 answers

Wanted to know more about the internals of AWS DMS (Data Migration Service)?

When the replication task is created, then when there is any change in source database it is replicated in the target database. So just wanted to know more about how this service internally works? My Understanding DMS has listener service which is…
Girish
  • 1,667
  • 1
  • 16
  • 28
9
votes
2 answers

AWS DMS | ERROR: could not access file "pglogical": No such file or directory

Error - 2019-06-17T05:00:11 [SOURCE_CAPTURE ]E: RetCode: SQL_ERROR SqlState: 58P01 NativeError: 1 Message: ERROR: could not access file "pglogical": No such file or directory;, Error while executing the query [1022502]…
vivekyad4v
  • 9,723
  • 4
  • 33
  • 49
8
votes
1 answer

AWS DMS replication instance out of memory

I recently started to work with AWS Data Migration Service (DMS) and running into some issues. Currently attempting to migrate a 10GB Oracle DB to AWS RDS Postgres. Works but has crazy(?) memory requirements. Feels like it loads the entire DB into…
gapvision
  • 870
  • 8
  • 24
6
votes
1 answer

Enclosing a password which contains special characters with curly braces does not work

I am trying to create a data migration task on AWS in order to migrate data from one RDS instance to another. The instance password for the source endpoint contains special characters (+&;) and by enclosing it with curly braces (as it is suggested…
refaktor
  • 81
  • 7
6
votes
1 answer

Starting AWS DMS Replication Task in Terraform

Is there any way to start an AWS Database Migration Service full-load-and-cdc replication task through Terraform? Preferably, this would start automatically upon creation of the task. The AWS DMS console provides an option to "Start task on create",…
shelley
  • 6,576
  • 2
  • 31
  • 54
5
votes
1 answer

AWS DMS (Database Migration Services) full LOB not working for SQL Server

I'm trying to migrate a SQL Server table using AWS DMS to a DynamoDb target. The table structure is as follows: |SourceTableID|Title |Status|Display|LongDescription| |-------------|-----------|------|-------|---------------| |VARCHAR(100)…
Luis Becerril
  • 701
  • 1
  • 8
  • 29
5
votes
1 answer

Amazon DMS task with custom rules fails when sinking to Kinesis

I'm trying to listen to Aurora DB changes using Amazon DMS and push the changes to a Kinesis stream, where a Lambda function listening to the stream will do the processing. I was referring to the below documentation to write my…
Praneeth Peiris
  • 1,704
  • 13
  • 32
4
votes
1 answer

AWS mirgate data from MongoDB to DynamoDB/S3/Redshift

The issue is that mirgating data from MongoDB to DynamoDB/S3/Redshift currently, as I unterstand for us is not available via AWS DMS Service, as it does not support all data types. Or maybe I'm wrong. The probelm is that our Mongo object contain not…
Mark
  • 340
  • 1
  • 11
4
votes
2 answers

AWS DMS - Database Migration Service SYSTEM ERROR MESSAGE:The IAM Role arn:aws:iam:::role/dms-vpc-role is not configured properly

I am trying to create a a DMS (Database Migration Service) Instance but I am getting the following error: SYSTEM ERROR MESSAGE:The IAM Role arn:aws:iam:::role/dms-vpc-role is not configured properly What role should I create and to…
Eran Chetzroni
  • 788
  • 9
  • 22
4
votes
2 answers

Not able to import certificate as documented

I followed all steps mentioned on this page. https://docs.aws.amazon.com/dms/latest/userguide/target.docdb.html The problem is that the "import certificate" button is disabled and I can not upload the certificate. You can download the public key…
shantanuo
  • 27,732
  • 66
  • 204
  • 340
4
votes
0 answers

AWS DMS - Migrate array from MongoDB to DynamoDB

I'm trying to migrate data from MongoDB to DynamoDB. Based on my test, it seems DMS can only convert array into string. For example: { data: ['one', 'two', 'three']} It will be { data: { 'S': [\"one\", \"two\", \"three\"] } } Is it possible to…
zeck
  • 729
  • 1
  • 6
  • 12
4
votes
1 answer

How to disable foreign key constraints in postgresql

I'm using AWS Aurora Postgres and using DMS to migrate from RDS postgres to Aurora PG. In order to perform the FULL LOAD I want to disable foreign key constraints and triggers on all the objects. I'm able to disable triggers but couldn't find a way…
RMu
  • 647
  • 2
  • 9
  • 31
4
votes
0 answers

Merge data from multiple tables in RDS to export to Redshift using AWS DMS

I am setting up a continuous replication from RDS to Redshift using AWS DMS, as suggested here. My usecase requires me to combine data from multiple RDS tables to export to Redshift. For eg. RDS has Tables School, Student, District. I want to export…
Adi
  • 235
  • 2
  • 6
  • 13
3
votes
1 answer

Connection fails when adding ElasticSearch as a Target for AWS Data Migration Service

I'm trying to set up ElasticSearch endpoint in DMS but no matter what I try when I test the connection I get this generic error: Test Endpoint failed: Application-Status: 1020912, Application-Message: Endpoint initialization failed. I've created a…
Adam Cooper
  • 6,436
  • 1
  • 25
  • 47
3
votes
1 answer

Can we use AWS Data Migration Service for replication from Aurora Serverless as source?

My DMS replication instance (which is in same VPC as of Aurora serverless DB instance) is not able to find DB while creating endpoint in DMS. However, I am able to create a cloud9 instance in same VPC as aurora serverless instance and connect to it…
conetfun
  • 1,413
  • 1
  • 14
  • 24
1
2 3
…
19 20