I
Aws Developer
I
- Posted 5 days ago
- Be among the first 20 applicants
Job Description
- Primary skills:Technology->Data On Cloud - NoSQL->Amazon Dynamo DB,Technology->Data On Cloud - Platform->AWS
- Design, develop, and maintain ETL/ELT pipelines using AWS Glue.
- Develop AWS Glue jobs using PySpark, and SQL for large-scale data processing.
- Build data ingestion and transformation pipelines across structured and semi-structured data sources.
- Configure and manage AWS Glue Data Catalog, Jobs, Workflows, and Triggers.
- Work with AWS services such as Amazon S3, Redshift, and IAM.
- Implement data transformations, validations, data-quality checks, and reconciliation processes.
- Optimize Glue/Spark jobs for performance, scalability, reliability, and cost efficiency.
- Implement incremental loads, partitioning strategies, error handling, restart/recovery, and audit frameworks.
- Troubleshoot ETL pipeline failures and production performance issues.
- Implement appropriate security controls including IAM roles, encryption, and access management.
- Support migration of legacy/mainframe or on-premises ETL workloads to the AWS cloud data platform.
- Develop automated deployment processes using CI/CD and Infrastructure-as-Code practices where applicable.
- Collaborate with data architects, analysts, business teams, and cloud/platform teams to translate requirements into scalable data solutions.
- Prepare technical design documents, mapping specifications, operational documentation, and deployment/runbook documentation.
- 2 years of overall Data Engineering / ETL development experience.
- Strong hands-on experience developing production-grade AWS Glue,Python and PySpark solutions.
- Experience handling high-volume datasets and complex transformations in AWS environments. Preferred Certification
- AWS Certified Data Engineer – Associate or other relevant AWS certification
More Info
About Company
Skills:
Amazon Redshift, Pyspark, AWS Glue, Python, Sql, ELT, Etl, Distribution Keys, RA3 nodes, Redshift Spectrum, Sort Keys
Skills:
snowflake , Java, Integration Testing, Agile Methodologies, PostgreSQL, Dynamodb, Spring Boot, Unit Testing, Microservices, Automated Testing, Restful Web Services, Docker, MySQL, Swagger, Software Development Life Cycle, Postman, Troubleshooting, Modern AI-assisted development tools, Application performance monitoring, CI/CD pipelines, GitHub branching strategies
Skills:
.Net Core, Sql, Java, Node.js, Microservices, Nosql, Git, React, Docker, Mvc, Restful Apis, Kubernetes, Python, AWS, Go, AWS SDKs
Skills:
Nodejs, Kafka, HTML, Angular, Microservices, Javascript, Python, Java, Aws Services, Springboot, CSS, Sql, Django, Express Js, Reactjs, Zookeeper, Event-driven applications, No-SQL, API-driven architectures, AWS MSKafka, DevSecOps tools, Observability, PaaS routing services, Quarkus
Skills:
Distributed Systems, Kafka, Windows, Nosql, React, Docker, Terraform, Sonarqube, Macos, Python, AWS, Aws Services, Cloudformation, Sql, Rabbitmq, Jenkins, Gcp, Linux, Ansible, Arm, Rest Apis, Azure, Kubernetes, Go, Intel, GitHub Actions, Microservices Architectures, make, Bazel