Job Accountabilities
JOB DESCRIPTION
- Identify PII across datasets.
- Support the creation and maintenance of DPIA documentation to comply with data privacy standards.
- Assist in validating that datasets meet required privacy, confidentiality, and security controls.
- Support encryption and masking of identified PII data within Databricks.
- Assist in applying data retention rules using Databricks scripts and workflows.
- Perform testing and validation to ensure data removal, archival, or anonymization is executed correctly based on the organization's Data Retention Policy.
- Perform data quality checks and validation to ensure data reliability and accuracy.
- Analyze datasets to uncover data quality issues, anomalies, or inconsistencies.
- Collaborate with cross-functional teams to understand the PII use cases, Data Retention Policies and Metadata confirmation.
Key Deliverables
- Maintain CDP Data Sensitivity Classification ensuring accurate tagging and ongoing updates of sensitive and PII data fields.
- Prepare DPIA/TIA documentation to support Compliance and Data Protection requirements.
- Implement encryption for PII data fields within Data Lake to meet security and governance standards.
- Apply the Data Retention Policy across all designated data sources within the Data Lake, including documentation and validation of outcomes.
- Update and maintain Metadata descriptions in the Data Catalog to improve data discoverability and data governance maturity.
- Start and Stop ADF Data Pipelines / Fivetran processes as required to support data ingestion, testing, and operational workflows.
Qualification
QUALIFICATIONS, EXPERIENCE AND SKILLS:
College/University Degree - preferable in Computer Science, Software Engineering or Math/Physics (Computer Sc. stream) or equivalent experience
Experience: 0-1 Years
Hard Skills
- Proficient knowledge in Database concepts, SQL scripts.
- Knowledge of Databricks, Azure stack toolbox (i.e ADF) would be a plus.
- Strong analytical and problem-solving skills with the ability to simplify complex technical concepts for non-technical audiences.
Soft Skills
- Ability to work independently, manage multiple governance projects simultaneously, and meet deadlines in a fast-paced environment.
- Effectively prioritize and deliver a clear roadmap of deliverables. Agile methodology would be an advantage
- Communicate effectively with all stakeholders, including technical and non-technical
