Pyspark, AWS Glue, data pipeline development, ETL processes, data integration techniques, data quality frameworks

Azure Databricks, Numpy, Devops, Pandas, Azure Functions, Flask, Integration Testing, Microsoft Azure, FastAPI, Rest Apis, Python, Scikit-learn, ETL processes, Data Processing

data engineering , Snowflake Data Warehouse, ETL processes, Data integration techniques, Cloud-based data storage and processing

Google Cloud Platform (GCP), BigQuery, Hadoop Ecosystem, Scala, Apache Spark, Kafka, Data Modeling, Dataproc, Big Data Technologies, Cloud Storage, DataFlow, Etl, Airflow, ELT frameworks, Pub/Sub, Pipeline orchestration