Search by job, company or skills

ITC Infotech

Data Engineer

This job is no longer accepting applications

new job description bg glownew job description bg glownew job description bg svg
  • Posted 2 months ago

Job Description

JD:

Cloudera developer along with Informatica experience:

Cloudera with Informatica role would focus on data integration and management, requiring expertise in both Informatica's suite of tools and Cloudera's Hadoop platform. Key responsibilities include designing, developing, and maintaining ETL processes using Informatica (PowerCenter or Cloud), and ensuring data flows efficiently within the Cloudera environment (Hive, Spark, etc.). This role also involves troubleshooting, performance optimization, and collaborating with cross-functional teams.

Job Title: Informatica Developer / Data Engineer (with Cloudera Focus)

Responsibilities:

  • Data Integration & ETL:
  • Design, develop, and maintain ETL (Extract, Transform, Load) workflows and mappings using Informatica PowerCenter or Informatica Cloud Services (IICS) to move data between various sources and the Cloudera data lake.
  • Cloudera Platform Expertise:
  • Work with Cloudera Hadoop ecosystem components like Hive, Spark, and HBase to process and analyze data within the data lake.
  • Performance Optimization:
  • Monitor and optimize ETL processes and data pipelines for performance and scalability within the Cloudera environment.
  • Data Quality & Governance:
  • Implement and maintain data quality rules and governance policies to ensure data accuracy and integrity.
  • Troubleshooting & Support:
  • Diagnose and resolve complex data integration issues related to Informatica and Cloudera.
  • Collaboration:
  • Collaborate with data architects, analysts, and other engineers to understand data requirements and deliver effective solutions.
  • Documentation:
  • Create and maintain documentation for ETL processes, data pipelines, and system configurations.
  • Security & Compliance:
  • Ensure data integration solutions adhere to security policies and compliance standards.
  • Qualifications:

    • Informatica Experience: Proven experience with Informatica PowerCenter or Informatica Cloud Services (IICS).
    • Cloudera Hadoop Experience: Hands-on experience with Cloudera Hadoop components like Hive, Spark, and HBase.
    • ETL Development: Strong understanding of ETL concepts and experience in designing and developing ETL solutions.
    • Database Knowledge: Familiarity with relational databases (e.g., Oracle, SQL Server) and SQL.
    • Problem-Solving: Excellent analytical and problem-solving skills.
    • Communication: Strong communication and collaboration skills.
    • Bachelor's Degree: A bachelor's degree in computer science, information technology, or a related field.

    Experience:

    5 to 15 years

    Notice period: Immediate /Within 30 days

    Location: Initial posting will be Bangalore and need to relocate to Jeddah within a month after joining

    More Info

    Job Type:
    Industry:
    Employment Type:

    About Company

    Job ID: 126282909

    Similar Jobs