Jobs for Humanity is partnering with testmar_27_v2 to build an inclusive and just employment ecosystem. Therefore, we prioritize individuals coming from all walks of life.
Company Name: testmar_27_v2
We are seeking a skilled Data Engineer to join our dynamic team. In this role, you will be responsible for designing, building, and maintaining robust data infrastructure that supports our organization's data-driven decision-making processes. You will work with cutting-edge technologies to ensure efficient data flow and accessibility for analytical and machine learning applications.
Job Purpose
The primary purpose of this role is to develop and maintain scalable, reliable data infrastructure that enables efficient data collection, storage, processing, and accessibility for analysis and machine learning applications, supporting the organization's data-driven initiatives and business intelligence needs.
Job Duties And Responsibilities
- Data Infrastructure Design
- Data Collection & Storage
- Python Programming
- SQL Development
- Scala Programming
- Apache Spark Implementation
- Kafka Integration
- Airflow Workflow Management
- AWS Cloud Services
- GCP Cloud Services
- Data Pipeline Development
- ETL/ELT Processes
- Data Warehousing
- Database Systems Management
- Data Processing Optimization
Required Qualifications
- Python
- SQL
- Scala
- Apache Spark
- Kafka
- Airflow
- AWS
- GCP
- Data Infrastructure Design
- Data Collection & Storage
- Cloud Platform Experience
- Data Pipeline Tools
- Database Systems
- Data Warehousing
- ETL/ELT Processes
