H
Data Engineer
H
Data Engineer
HalianThis job is no longer accepting applications
Job Description
Our Client
We are looking for a Big Data Engineer to create solutions suitable for the job in a real-time, highly data-driven organization and make technical innovations happen.
Your Requirements:
- Minimum 2+ years of development and design experience in Java with Flink, Beam (or similar streaming toolset) and Kafka.
- Experience of working with Real Time/Streaming data
- Ability to Execute BEAM pipelines on Apache FLINK Runner
- Experience of working on Beam SDK
- Knowledge of Microservices using JAVA
- Experience of working on Github
- Experience of using Spark Streaming
- Experience of working with SQL and NOSQL Databases
- Experience of executing or working with Real Time Data pipelines
- Experience of topic setting using Kafka(Confluent).
- Knowledge of real time data pipelines by developing Kafka producers and streaming applications for consuming
- Experience in Kubernetes
- Well versed with CI/CD principles (GitHub, Jenkins etc.), and actively involved in solving, troubleshooting issues in distributed services ecosystem
- High level knowledge of compliance and regulatory requirements of data including but not limited to encryption, anonymization, data integrity, policy control features in large scale infrastructures
Halian Group
With over 20 years of experience, we have come to understand that innovation is the only way to provide agile, practical solutions that transform businesses and careers.
Our resourcing and smart services help you to realize tomorrow's potential. Discover the amazing things possible when you bring the right people and the right technologies together.
More Info
Key Skills
About Company
Award-Winning Tech Talent Company. We help businesses make progress, build efficiency and discover new possibilities. Our goal is to support talented individuals to explore, innovate and unleash their potential.Our success has spanned over 20 years. In that time, we’ve come to understand that innovation is the only way to provide agile, practical solutions that transform businesses and careers that fulfil potential, faster.Halian's smart services, tech talent and search capability, help you to realise tomorrow’s potential. To discover the amazing things that are possible when you bring the right people and the right technology together.