

Search by job, company or skills
Key Skills:
▪ Lead a team of data engineers in managing day-to-day BAU operations, production support, incident management, and platform stability.
▪ Strong AWS knowledge in terms of designing new architecture and providing optimized solutions for existing ones. (S3, Glue, DMS, MWAA, AMS, IAM).
▪ In-depth knowledge with respect to Snowflake and its architecture.
▪ Prefer prior Experience in BAU environment.
▪ Good knowledge on Airflow and MWAA.
▪ Hands-on experience in SQL/Python/Pyspark.
▪ Expertise in optimizing techniques in cloud environments.
▪ Should have the vision on data strategy and able to deliver the same.
▪ Should be able to lead the design and implementation of data management processes, including data sourcing, integration, and transformation.
▪ Able to manage and lead a team of data professionals, providing guidance, mentoring and foster a collaborative and innovative team culture focused on continuous improvement.
▪ To evaluate and recommend data-related technologies, tools, and platforms.
▪ Collaborate with IT teams to ensure seamless integration of data solutions.
▪ Should have experience in Implementing and enforcing data security protocols and ensure compliance with relevant regulations.
Required Qualifications:
▪ At least 8+ years of Data Engineer Experience
▪ Bachelor qualification in a computer science or STEM (science, technology, engineering, or mathematics) related field.
▪ At least 5+ years of recent hands-on professional experience (actively coding) working as a Lead handling support & production issue.
▪ 2+ experience with large scale datasets, data lake and data warehouse technologies such as AWS Redshift, Google BigQuery, Snowflake. Snowflake is highly preferred.
Job ID: 151766449
Skills:
Ems, Sql, Numpy, Pandas, Python, pricing data, Airflow, Luigi, prime brokerage data, security identifiers, market microstructure, OMS, data pipeline orchestration
Skills:
Pyspark, Tableau, Impala, Sql, Hive, Linux, Sap Bo, Cloudera, Python, AI Machine Learning, Plotly, Cloudera Data Platform, DevOps deployment
Skills:
geospatial data , schemas , S3, PostgreSQL, Kafka, Indexes, Neo4j, Elasticsearch, Database Design, Python, AWS, Java, RDS, Sql, Gcp, ROS, Azure, time-series databases, Go, OLAP engines, EKS, OpenRMF, data models, CDC pipelines, Quickwit
Skills:
Sql, Python, AI LLM-based systems, analytics infrastructure, data pipelines, Agent Development Kit, Cider Agents, data architecture design, enterprise-scale data platforms, Gemini Command-line Interface, LLM Extensions, machine learning operations
Skills:
data engineering , Cloud Platforms (Azure), Dashboarding (Power BI), ETL/ELT Pipeline Development, Machine Learning Deployment