Bash Shell Scripting, Gitlab, Databricks, Python, AWS, monitoring and observability tools, Infrastructure-as-Code, CI CD

data engineering , snowflake , Unix, Sql, Python Scripting, Gitlab, Data Architecture, Data design patterns

Git, Sql, Nodejs, AWS, Python, Kubernetes, Docker, Jenkins, Scala, Kafka, NoSQL stores, Relational Databases

data engineering , data deduplication , Spark, Apache Airflow, Kafka, Data Quality, Web Crawling, Etl, Python, Data Pipelines, Petabyte Scale, Ray, data acquisition, Data Licensing, Vendor Management, Distributed Data Processing