You will be the backbone of the AI Center's data supply chain ensuring that telecom network events, subscriber data, and financial transactions are reliably available, clean, and structured for AI, BI, and automation workloads.
ROLE MISSION
Build scalable and reliable data pipelines using Microsoft Fabric and Azure-native services.
Key Responsibilities
- Design and build ETL/ELT pipelines in Microsoft Fabric to ingest and process high-volume telecom data (CDR, network logs, billing events) and fintech data (transactions, payment flows, KYC records)
- Support Databricks workloads where required for large-scale data transformation and ML feature pipelines
- Implement data quality and validation checks to ensure accuracy of customer, network, and financial data feeding AI models and BI reports
- Integrate data from source systems including CRM platforms, billing systems, payment gateways, and core banking systems
- Apply Azure storage and security concepts to protect sensitive subscriber and financial data
Must-have Skills
- Microsoft Fabric (Data Factory, Lakehouse, Synapse pipelines)
- SQL and PySpark
- Azure storage and security concepts
NICE-TO-HAVE
- Experience with real-time streaming for telecom or payment data (Event Hubs, Kafka)
- Knowledge of PCI-DSS data handling requirements
- Familiarity with telecom BSS/OSS data structures
- Azure Data Engineer Associate certification
