Senior Data Engineer

Job Purpose

This role is appropriate for a senior data engineer capable of taking ownership and a delivering a subsection of the wider data platform or data applications. As a Senior Data Engineer, you will directly contribute to our key organizational objectives of Accelerated Innovation, Cost Optimization, Risk Mitigation, and Business Enablement.

Role & Responsibilities

• Design, develop and maintain scalable data pipelines and architectures to support data ingestion, integration and analytics.
• Be accountable for technical delivery and take ownership of solutions.
• Lead a team of senior and junior developers providing mentorship and guidance.
• Collaborate with enterprise architects, business analysts and stakeholders to understand data requirements, validate designs and communicate progress.
• Drive technical innovation within the department to increase code reusability, code quality and developer productivity.
• Challenge the status quo by bringing the very latest data engineering practices and techniques.

Requirements

• 8 to 15 Years of experience in Data Engineering.
• Expert in leveraging cloud-based data platforms (Snowflake, data lakehouse architecture) to create enterprise lake houses.
• Advanced expertise with AWS services including Lambda, EMR, MSK, Glue, and S3.
• Experience designing event-based or streaming data architectures using Kafka.
• Advanced expertise in Python and SQL (Java/Scala experience welcomed)
• Expert in CI/CD pipelines to deploy infrastructure (Terraform) with test automation.
• Experience implementing data access controls to meet regulatory requirements.
• Experience with both RDBMS (Oracle, Postgres, MSSQL) and NoSQL (Dynamo, OpenSearch, Redis).
• Experience implementing CDC ingestion techniques.
• Experience using workflow tools (Airflow, Control-M, etc.)
• Significant experience with GitHub, code verification, validation, and AI-assisted development.
• Knowledge of investment management industry concepts, particularly security reference data, fund reference data, transactions, orders, holdings, and fund accounting.

Bonus Technical Skills

• Strong experience in containerization and deploying applications to Kubernetes.
• Strong experience in API development using Python-based frameworks like FastAPI.
• Familiarity with Asset Management data domains (Security Reference, Trades, Orders Holdings, Funds, Accounting, Index etc).