Search by job, company or skills

Lead Data Engineer

10-20 Years
Quick Apply
  • Posted 7 hours ago
  • Over 50 applicants have applied

Job Description

  • 8+ years of experience in data engineering, machine learning, AI, data warehousing, and data management Projects Med to Small.
  • 3+ years in a leadership role, responsible for the direct oversight of a team of data engineers (offshore) where you oversaw day-to-day activities, attained delivery metrics, and provided technical coaching to staff (Must Have)
  • Data processing programming using SQL, Python, and similar tools (Must Have).
  • Solid experience with cloud-based data tools and platforms - AWS (Must Have), Azure or, Google (Nice To Have)
  • Deep hands-on experience using databases and related technologies in a fast-paced business environment with large-scale and complex datasets including design and optimize queries, create data structures, and develop data models (Must Have)
  • Be comfortable with building effective cross-team collaborative working relationships with people at all levels of the organization. (Must Have)
  • Experience in enterprise level data platforms involving implementation of end-to-end data pipelines. (Must Have)
  • Experience with column-oriented database technologies, Redshift (Must Have) Big Query or Vertica (Nice to Have), and traditional database systems SQL Server and Oracle (Must Have), MySQL (Nice to Have).
  • Experience in architecting data pipelines and solutions for both streaming and batch integrations using tools/frameworks like Matillion (Must Have but can be learned), Lambda (Preferred), Spark (Preferred), AWS Glue ETL (Nice to Have), Spark Streaming (Nice to Have), AWS Glue DataBrew (Nice to Have), Kinesis Data Firehose (Nice to Have)
  • Logical programming in Python (Must Have), Spark (Preferred), PySpark (Nice to Have), Java(Nice to Have), Javascript(Nice to Have), and/or Scala (Nice to Have).
  • Cloud-native data platform design with a focus on streaming and event-driven architectures (Preferred)

More Info

Job Type:
Industry:
Function:
Employment Type:

About Company

SMC Squared provides US companies with IT talent to accelerate innovation, develop digital products and services, or simply get basic operational work done. Our GIC approach helps CIOs minimize risk and cost and also improve quality and retention. Whether clients need a small team of 5 developers or 500 engineers in a dedicated facility, our employee-based approach builds dedicated teams of top technology talent with the same mission, vision, and values as their US counterparts. We recruit-for-fit rather than assign-for-need, thus creating a common culture, establishing stronger control, and radically improving resource retention. Our leadership team has walked in your shoes and worked alongside talent in the US and India for more than 70 collective years. We bring a people-first approach and respect that attracts and retains high quality Bangalore-based talent.

Job ID: 114438435

Similar Jobs

Bengaluru, India

Skills:

snowflake PowerShellKafkaAzure DatabricksSSISSqlELTGitAzure Data FactoryAzure Synapse AnalyticsPythonAzure DevOpsEtlEvent HubAzure Service Bus

Bengaluru, India

Skills:

amazon dynamodb snowflake CassandraAmazon S3PostgreSQLAWS GlueDockerNeo4jPythonAws LambdaOracle Sql ServerApache SparkSqlGitAmazon RedshiftSqsApache KafkaDatabricksMongoDBAmazon AthenaAWS Step FunctionsGraphDBAmazon SNSAmazon NeptuneAmazon ECS FargateAWS Cloud TechnologiesCI CD pipelinesMicrosoft Fabric

Bengaluru, India

Skills:

snowflake Aws LambdaBigQueryAgile MethodologiesEmrRedshiftSqlSparkPythonGCP DataflowPub SubGlue

Bengaluru, India

Skills:

data warehouses Spark SQLMetadata ManagementData SecurityPysparkApache SparkSqlELTEncryptionIamAgilePythonEtlGenAIlineageDelta Live TablesUnity CatalogDatabricks Lakehouse Platformdata lakesmedallion architectureDelta LakeGovernanceDatabricks Workflows

Bengaluru, India

Skills:

SparkSqlEtl DevelopmentBig Data TechnologiesData ModelingJavaHadoopPysparkGoogle CloudAWSHiveData WarehousingKubernetesPythonAzureDockerScalaAirflowPrefect

Beware of Scammers

We don’t charge money for job offers