AWS Data Engineer
- Posted a month ago
- Be among the first 30 applicants
Job Description
- Help design, build and continuously improve the clients online platform.
- Research, suggest and implement new technology solutions following best practices/standards.
- Take responsibility for the resiliency and availability of different products.
- Be a productive member of the team.
- 5+ years of experience in data engineering, analytics, or backend development
- Design, build, and optimize scalable data pipelines and cloud-based data solutions using AWS and Databricks to support advanced analytics and business needs.
- Develop and refactor reusable data pipelines leveraging AWS and Databricks
- Design and implement data lakes, data warehouses, ETL processes, and backend services for structured and unstructured data
- Collaborate with business analysts, data scientists, architects, developers, and stakeholders to deliver fit-for-purpose solutions
- Optimize data pipelines for performance, scalability, cost efficiency, reliability, and security
- Implement robust testing and monitoring frameworks
- Identify and resolve performance bottlenecks, ensuring efficient workload execution
- Participate in code reviews and maintain high-quality documentation
- Stay updated with emerging data engineering trends and apply best practices
- Bachelor's or Master's degree in Computer Science, Data Engineering, or a related field
- Hands-on experience with AWS Cloud and Databricks
- Strong proficiency in:, Serverless and orchestration workflows (AWS Lambda, Step Functions), Programming and scripting (Python, Bash, Make), Query languages (SQL, SPARQL)
- Experience with diverse data models: Relational databases (Amazon Redshift), NoSQL databases (DynamoDB), Object storage (Amazon S3), Graph databases (Amazon Neptune)
- Experience with version control and CI/CD tools (Git, GitLab preferred)
- Infrastructure as Code experience, preferably using AWS CDK
- Strong passion for data engineering and solving real-world problems
- Customer-focused and value-driven mindset
- Excellent analytical and problem-solving skills
- Strong collaboration and communication abilities
- Familiarity with Agile/Scrum methodologies
- Proactive approach to continuous improvement and innovation
- A challenging, innovating environment.
- Opportunities for learning where needed.
More Info
Key Skills
About Company
Skills:
Kms, Pyspark, Iam, Sql, Python, AWS Lake Formation
Skills:
snowflake , AWS Glue, Json, SSIS, Sql, Terraform, Spark, Data Warehousing, Restful Apis, Python, Aws S3, API calls, Data Lake architectures
Skills:
Aws Services, Pyspark, Postgresql, Databricks, MongoDB, Python, Step Functions, Lambda Functions
Skills:
Aws Lambda, Amazon S3, Pyspark, AWS Glue, Apache Spark, AWS Athena, Sql, Amazon Redshift, Data Warehousing, Python, Etl Development, AWS EMR, Data Lake Architecture
Skills:
Sql, S3, Pyspark, Emr, Redshift, Lambda, Git, Docker, Iam, Databricks, Kubernetes, AWS, Airflow, CI/CD pipelines, Glue