Big Data Engineer - 1352361

Our Client
A Leading Telco/ Digital Solution Provider in the MENA region.

Job Overview:
We are looking for a big data engineer with a successful track record for building scalable data solutions in a fast-paced environment.

Responsibilities:

• Work closely with data architects, data analysts and data science teams to come up with technical solutions to solve specific business problems.
• Ability to deal with different data sources and data types.
• Integrate and Ingest data from multiple source systems using into big data environment.
• Create end to end data transformations and workflows for the data engineering transformations that serve the business needs along with the proper logging and recovery procedures for these workflows

Requirements:

• At least 4 years of of experience in developing big data solutions in ICT/Digital Solutions industry
• Bachelor's or master's degree in Computer Science or related fields (equivalent work experience considered).
• Experience with NoSQL, Hive, Impala.
• Experience in Tuning bigdata transformations using Apache Spark and Hive QL.
• Experience solving for complex data integrations across multiple systems.
• Experience working with Data Science teams to improve actionable data.
• Solid experience in Python, Java, Scala and SQL (including Spark SQL)
• Solid Experience in Data integration Talend is a must, other data integration tools as Informatica Power Center, Informatica BDM, ODI, Denodo, Altryx ..etc is preferred.
• Solid Experience in ingesting the data from multiple data sources through APIs into HDFS
• Solid Experience in creating data pipelines using NiFi.

Halian Group
With over 20 years of experience, we have come to understand that innovation is the only way to provide agile, practical solutions that transform businesses and careers.
Our resourcing and smart services help you to realize tomorrow's potential. Discover the amazing things possible when you bring the right people and the right technologies together.