Search by job, company or skills

Fractal Analytics

Gcp Data Engineer

Save
  • Posted 16 days ago
  • Over 300 applicants
Quick Apply

Job Description

Key Responsibilities:

  • Design & Implement Data Pipelines: Develop and optimize ETL/ELT pipelines using Dataflow, BigQuery, and Cloud Composer (Airflow).
  • Data Integration: Work with structured and unstructured data sources, integrating data from on-premise and cloud-based systems.
  • Data Warehousing & Modeling: Design high-performance data models in BigQuery, ensuring scalability and cost efficiency.
  • Automation & Infrastructure as Code (IaC): Implement Terraform for provisioning GCP resources and automate deployments.
  • Streaming & Batch Processing: Work with Pub/Sub, Dataflow (Apache Beam), and Kafka for real-time and batch data processing.

Required Skills & Qualifications:

  • Education: Bachelors or Masters degree in Computer Science, Data Engineering, or a related field.
  • 7+ years of experience in data engineering, cloud data solutions, and pipeline development.
  • GCP Expertise: Hands-on experience with BigQuery, Scala, Dataflow, Pub/Sub, Cloud Storage, Cloud Composer (Airflow), Vertex AI, and IAM Policies.
  • Programming: Proficiency in Python, SQL

More Info

Job Type:
Industry:
Function:
Employment Type:

About Company

Job ID: 111421553

Similar Jobs

Pune, India

Skills:

Apache AirflowBigQueryPysparkDataprocInformaticaTalendSqlPythonNoSQL databasesdata warehousing solutionsGoogle Data Engineering services

Mumbai, India

Skills:

BigQueryGitDataprocDataFlowPythonSqlCloud ComposerCloud Dataflow

Chennai, India

Skills:

PysparkTerraformPythonMlJavaBigQueryDataprocSqlGcpCompute EngineApache KafkaApache BeamDataFlowAirflowTektonDataformCloud BuildPub SubCloud ComposerCloud RunVertex AICloud SQLCloud FunctionsDataplexArtifact Registry

Pune, India

Skills:

BigQueryGcpDataprocDataFlowSqlAirflowdbtData Vault 2.0Looker

Pune, India

Skills:

composer SqlELTCloud StorageDataFlowTableauBigQueryEtlPythonGcpGitdigital marketing datacustomer behavior analyticsLookerAgile development practicesreal-time batch data processingPub Subdata quality governanceclickstream dataCI CD pipelines