Search Jobs

Search by job, company or skills

Senior Data Engineer

Senior Data Engineer

Freelancer Ashar Zafeer
5-10 Years
1 - 2 LPA
Early Applicant
Quick Apply
  • Posted 12 hours ago
  • Be among the first 30 applicants

Job Description

Job Title: Senior Data Engineer

Location: Bellandur, Bangalore

Duration: 6 Months Contract (Possibility of extension)

Work Mode – Fully onsite job

Interview mode: 1st round MS teams & 2nd round in-person interview

 

Key Responsibilities

  • Design and build the BigQuery data warehouse across raw, curated and reporting datasets.
  • Build and maintain ETL/ELT pipelines using GCP-native tools (e.g. Dataflow, Cloud Composer, Cloud Functions) to move data into BigQuery.
  • Implement row-level security and access controls within BigQuery.
  • Develop the Python (FastAPI) backend API on Cloud Run that serves the reporting layer.
  • Integrate GCP Gemini for natural-language-to-SQL (text-to-query), optimizing for token efficiency and cost.
  • Implement file archival / retrieval for historical sales order search.
  • Build toward an agentic AI framework covering churn analysis, anomaly detection and escalation management.
  • Design, develop and deploy the React web application.
  • Deploy and manage application services on GCP — Cloud Run, Artifact Registry, and related deployment pipelines.
  • Build ReactJS, ChartJS dashboards connected to BigQuery, where used alongside or instead of the React app.
  • Design an intuitive interface for the natural-language query assistant.
  • Ensure the UI correctly reflects row-level security / access permissions per user.
  • Integrate with the Python FastAPI backend endpoints.

 

Required Skills

·       3–5 years of experience working with GCP, ReactJS and Python.

·       Strong SQL and data modelling experience on BigQuery or an equivalent cloud data warehouse.

·       Experience building ETL/ELT pipelines using GCP-native tools (Dataflow, Cloud Composer, Cloud Functions, or similar).

·       Python backend development (FastAPI or similar) and REST API design.

·       Experience with core GCP services: BigQuery, Cloud Run, IAM, Secret Manager.

·       Hands-on experience deploying and managing applications on GCP — Cloud Run, Artifact Registry, IAM, and related deployment services.

·       Understanding of row-level security and data governance patterns.

·       Strong React development experience — hooks, state management, component design.

·       Experience connecting BI tools (Power BI and/or Tableau) to cloud data warehouses, with BigQuery preferred.

·       REST API integration experience.

·       UI/UX sensitivity for executive-facing dashboards and reporting tools.

·       Git-based version control and comfort working in a CI/CD pipeline (Azure DevOps or equivalent).

·       Familiarity with least-privilege IAM practicesno static credentials, scoped service accounts.

Comfortable working in an agile, sprint-based delivery model across Discovery, Development and Testing phases.

More Info

Job Type:
Function:
Employment Type:

Key Skills

· 3–5 years of experience working with GCP

ReactJS and Python. · Strong SQL and data modelling experience on BigQuery or an equivalent cloud data warehouse. · Experience building ETL/ELT pipelines using GCP-native tools (Dataflow

Cloud Composer

Cloud Functions

or similar). · Python backend development (FastAPI or similar) and REST API design. · Experience with core GCP services: BigQuery

Cloud Run

Secret Manager.

Similar Jobs

5-7 yrs
Bengaluru, India
Skills:
data vault kimball BigQuerySqlCloud StorageGcpTerraformDataFlowPythonCloud Build3NFPub SubCloud ComposerDataplex
3-5 yrs
Bengaluru, India
Skills:
CloudwatchSqlS3EmrLambdaPysparkAWSSnsPythonSqsIamGitPostgreSQLSparkGlue CatalogAthenaCI CDApache IcebergAuroraEventBridge
5-10 yrs
Bengaluru, India
Skills:
IamSqlS3AWS GluePythonPysparkStep FunctionsAthenaApache IcebergAmazon QuickSight
7-12 yrs
Bengaluru, India
Skills:
GolangS3PostgreSQLPrometheusKafkaDatadogEc2DockerSnsPythonApi GatewayAws LambdaRDSDynamodbRabbitmqJenkinsMS SQLCloudwatchECSIamSqsRestful ApisAWS cloud servicesGitLab CICI CD toolsGlue
5-7 yrs
Bengaluru, India
Skills:
Cloud Composer (Airflow)BigQueryScalaApache SparkDataprocSqlCloud StorageTerraformApache BeamDataFlowPythonPub SubGCP AI PlatformCloud SQLVertex AISpanner