Search by job, company or skills

eucloid data solutions

Lead Data Engineer

eucloid data solutions
Chennai, India
5-7 Years
Save
  • Posted a month ago
  • Be among the first 10 applicants
Early Applicant

Job Description

Eucloid is looking for a Lead Data Engineer to join our Data Platform team supporting various business applications. The ideal candidate will support the development of data infrastructure for our clients by participating in activities that may include starting from upstream and downstream technology selection to designing and building different components. Candidate will also be involved in projects like integrating data from various sources, managing big data pipelines that are easily accessible with optimised performance of the overall ecosystem. The ideal candidate is an experienced data wrangler who will support our software developers, database architects and data analysts on business initiatives. You must be self-directed and comfortable supporting the data needs of cross-functional teams, systems, and technical solutions.

Responsibilities

  • Responsible for the design, deployment, configuration, and operations of a multi-node big data cluster.
  • This includes working with open source and/or commercial stacks to support the full SDLC.
  • Resource will work to deploy, manage, and maintain development, test and production environments for the big data platform.
  • Develop scripts to automate and streamline operations and configurations in the infrastructure.
  • Specify, design, build, and support BI solutions by working closely with datalake team.
  • Create dashboards and KPIs to show the business performance to management.
  • Design and maintain data models used for reporting and analytics
  • Work to identify infrastructure needs and provide support to developers and business users.
  • Research performance issues.
  • Optimize platform for performance.
  • Troubleshoot and resolve issues in all operational environments.
  • Work with a cross-functional team delivering software deployments.
  • Forward thinking by continuously adopting new ideas and technologies to solve business problems.
  • Own the design and development of automated solutions for recurring reporting and in-depth analysis.
  • A problem solver and critical thinker.

Requirements

  • Strong Experience in Data lake - Spark, distributed file system, Yarn, Cloud services (preferably GCP / AWS).
  • Strong Experience in SQL tools - Vertica, Dremio product or any big data SQL.
  • Scripting Knowledge - Shell, Python.
  • Experience with ETL and OLAP concepts in building highly scalable data pipelines.
  • Exposure to any Visualization systems is a plus (like Apache Superset, Tableau).
  • Experience with Agile, data structures, data analysis and wrangling tools and technologies.
  • Familiar with version control and relational databases.
  • Strong Experience in monitoring, debugging and troubleshooting of services.
  • Experience in providing on-call support.

Basic Qualifications

  • Eucloid Data Solutions Awarded for the most promising Data Solutions Provider by Entrepreneur Magazine.
  • Bachelor's / Master's Degree in Computer or related field from a reputed institution.
  • 5+ years of professional experience in software, with most of them from a product company.

Preferred Qualifications

  • Proficient in one or more technologies, such as AWS, EMR, Hadoop, Spark, SQL, Python, and Data Structures.
  • Experience working in Linux based environment.
  • Good communication and design skills.

This job was posted by Eucloid Careers from Eucloid Data Solutions.

More Info

Job Type:
Permanent Job
Industry:
Other
Function:
Data Engineering
Employment Type:
Full time

Job ID: 147474851

Jobs by Skill - IT
Jobs by Skill - Non IT
International Jobs
Last Updated: 21-05-2026 08:54:31 PM
Homejobs in ChennaiLead Data Engineer

Similar Jobs

Lead Data Engineer IRC288563

Globallogic India
Chennai, India

Skills:

snowflake , Java, BigQuery, Hadoop, Scala, AWS Glue, Kafka, Redshift, Sql, Apache Airflow, Hive, Gcp, Presto, Spark, Databricks, DataFlow, Azure, Python, AWS, Luigi, Prefect, OpenSearch

Lead Data Engineer - R01558812

Brillio
B
Chennai

Skills:

Pyspark, Sql, Python, Data Modeling, Data Warehousing, Azure Data Engineering, Microsoft Fabric, Lakehouse Architecture, ETL/ELT, Stored Procedures

Lead Data Engineer - AI Engineer

staples india
Chennai, India

Skills:

snowflake , Pyspark, Sql, Databricks, Python, LangChain, Azure AI Agent Service, Semantic Kernel, Unity Catalog, OpenAI SDK, GCP Vertex AI, OpenTelemetry, Azure AI, Gemini, Azure Guardrails

Lead Data Engineer

JMAN Group
Chennai, India

Skills:

snowflake , Sql, Databricks, Data Warehousing, Cloud, Devops, Jira, Tableau, Power Bi, Etl, Gcp, Git, ELT, Azure Data Factory, Data Visualization, Datadog, AWS, Kubernetes, Python, Servicenow, Azure, Docker, Redshift, Monitoring, Azure Monitor, dbt, Looker, Synapse, CI CD pipelines, Big Query, Ticketing Workflow Tools, Log Analytics, Freshdesk, Azure SQL Server

Lead Data Engineer

Crayon Data
Chennai, India

Skills:

Java, Hadoop, Oracle Sql, Scala, HBase, Hive, Gcp, DB2, Spark, Azure, Python, AWS, Airflow, Teradata