Data Governance, ETL frameworks, quality assurance practices, data integration techniques, Microsoft Azure Databricks, building scalable data pipelines, managing large datasets, cloud-based data storage and processing solutions

Spark, Emr, Dynamodb, Lambda, Pyspark, Deduplication, Terraform, Scala, PostgreSQL, S3, AWS, Python, Advanced Sql, resilient pipeline patterns, AWS Sagemaker, Glue, Type 2 Dimensions, Medallion Architecture, Lakehouse, Idempotency, Incremental historical processing, late-arriving data handling, AWS data services, Step Functions, CDC Merge processing, Aurora

Pyspark, Apache Spark, Kafka, Emr, Redshift, Sql, ELT, Lambda, Kinesis, Data Warehouse Architecture, Data Lake, Python, Aws S3, Etl, Airflow, CI CD, Lake Formation, pipeline development, Glue, AWS Security, Athena, Real-Time Data Processing, Cloud Optimization

Data Modeling, Python, Sql, Azure Synapse Data Factory, Medallion Architecture, Microsoft Fabric, Fivetran

snowflake , Apache Airflow, Data Warehousing Concepts, Azure Data Factory ADF, AWS Azure Cloud, SQL Data Modeling, Git CI CD, DBT Data Build Tool, ETL ELT Pipeline Development