Spark, Emr, Dynamodb, Lambda, Pyspark, Deduplication, Terraform, Scala, PostgreSQL, S3, AWS, Python, Advanced Sql, resilient pipeline patterns, AWS Sagemaker, Glue, Type 2 Dimensions, Medallion Architecture, Lakehouse, Idempotency, Incremental historical processing, late-arriving data handling, AWS data services, Step Functions, CDC Merge processing, Aurora

Dynamodb, Emr, Aws Rds, Kinesis, Cloudwatch, Elasticsearch, Aws Ec2, Waf, Devops Tools, Python, AWS Cloud infrastructure, VPN connectivity, SPARK programming, data migration facilities, Glue, AWS migration tools, Athena, cloud security architectures, CloudTrail