Data Engineer
Years of Experience: 5-8 Years
Job Summary: We are seeking a skilled Data Engineer with extensive experience in AWS and Google Cloud to join our dynamic team. The ideal candidate will have a strong background in big data technologies and a proven track record of designing and implementing data pipelines that support analytics and business intelligence initiatives. This role requires a detail-oriented individual who can work collaboratively with cross-functional teams to deliver high-quality data solutions.
Responsibilities
- Design, develop, and maintain scalable data pipelines using AWS services.
- Implement data storage solutions using Snowflake and BigQuery.
- Collaborate with data scientists and analysts to understand data requirements and deliver solutions that meet business needs.
- Optimize data processing workflows for performance and cost efficiency.
- Monitor and troubleshoot data pipeline performance and reliability.
- Document data architecture and processes for future reference and compliance.
Mandatory Skills
- Proven experience with AWS services, including but not limited to S3, EC2, Lambda, and Amazon Redshift.
- Strong knowledge of big data technologies such as Spark and Kafka Stream.
- Experience with data warehousing solutions, specifically Snowflake and BigQuery.
- Proficiency in SQL, particularly Postgreql.
- Ability to work with large datasets and perform data transformations.
Preferred Skills
- Familiarity with data modeling and ETL processes.
- Experience with data governance and data quality frameworks.
- Knowledge of machine learning concepts and tools.
- Strong analytical and problem-solving skills.
- Excellent communication and teamwork abilities.
Qualifications
- Bachelor's degree in Computer Science, Information Technology, or a related field.
- 5-8 years of experience in data engineering or a related role.
- Certifications in AWS or Google Cloud are a plus.
Join our team and contribute to building innovative data solutions that drive business success!
AWS