Search by job, company or skills

Senior Data Engineer

  • Posted 10 hours ago
  • Be among the first 10 applicants

Job Description

Senior Data Engineer

Requirement

  • 5+ years of experience with AWS. Azure or GCP will be an advantage.
  • Strong experience as Data / Platform Engineering
  • Very good knowledge of AWS data stack:
  • S3
  • Spark on EMR
  • Experience with Databricks
  • Experience building production-scale backend services, CLI tools, or infrastructural components such as Kubernetes operators (preferably in Go or Python)
  • Good understanding of data processing pipelines
  • Experience or knowledge of GDPR is a big plus, especially:
  • Right to be forgotten
  • Data deletion / anonymization flows
  • Ability to work very independently and drive complex topics
  • Strong ownership and communication skills

Interacting with teams around the world is very much part of our day-to-day, so communication skills are vital. We are looking for strong problem-solvers who can apply their engineering skills to a wide range of platforms and environments, while also acting as an ambassador to coach team members and stakeholders

Responsibilities

  • Architect and build infrastructure automation at scale for 1000+ engineers through tools like Terraform and Helm
  • Build and enhance fault-tolerant and highly available Kubernetes clusters
  • Drive positive change in deployment frequency, lead time to change, change failure rate and mean time to restore metrics
  • Consult and cooperate with engineers in developing and implementing best practices in the field of cloud infrastructure and software engineering

More Info

Job Type:
Industry:
Employment Type:

About Company

Job ID: 152270913

Similar Jobs

Egypt, Cairo

Skills:

Apache AirflowDockerPysparkApache SparkKafkaFastAPIMongoDBKubernetesPythonPrefect

Egypt, Cairo

Skills:

snowflake Etl ToolsTableauTalendSqlPythonAirflowdbtAPI integrations

Egypt, Cairo

Skills:

amazon emr amazon dynamodb Aws LambdaAmazon Ec2Amazon S3AWS GlueAmazon CloudWatchSqlApache AirflowAmazon RedshiftSparkPythonAWS DataZone

Egypt, Cairo

Skills:

Metadata ManagementSqlELTEtlIbm DatastageData GovernancePythonRest ApisData VirtualizationWatson Knowledge CatalogIBM CP4D

Remote

Skills:

data engineering snowflake EtlAWS

Beware of Scammers

We don’t charge money for job offers