Python, Databricks, Gitlab, Bash Shell Scripting, AWS, CI CD, Infrastructure-as-Code, monitoring and observability tools

data engineering , snowflake , Unix, Sql, Python Scripting, Gitlab, Data Architecture, Data design patterns

Git, Sql, Nodejs, AWS, Python, Kubernetes, Docker, Jenkins, Scala, Kafka, NoSQL stores, Relational Databases

data engineering , data deduplication , Spark, Apache Airflow, Kafka, Data Quality, Web Crawling, Etl, Python, Data Pipelines, Petabyte Scale, Ray, data acquisition, Data Licensing, Vendor Management, Distributed Data Processing