Data Architecture: Work closely with business leads and data architects to design, implement and manage end-to-end CDP architecture based on business requirements.
Data Mapping & Integration: Collaborate closely with multi-functional teams to design XDM schemas for data from various source systems including Azure data lake, CRM, marketing platforms, and other transactional databases, ensuring accuracy and reliability.
Data Pipeline Development: Design, develop, and manage end-to-end data pipelines that facilitate the flawless extraction, transformation, and loading of data from diverse sources into the CDP.
ETL Optimization: Continuously improve and optimize ETL processes to enhance data flow efficiency, minimize latency, and support real-time and batch processing requirements.
Data Transformation: Implement data cleansing, enrichment, and transformation processes to ensure high-quality data is available for analysis and reporting.
Data Quality Assurance: Design testing plans, develop and implement data quality checks, validation rules, and supervising mechanisms to maintain data accuracy and integrity within the CDP.
Platform Enhancement: Collaborate with the technical lead/architect to identify and implement enhancements to the CDP infrastructure, integrations, and functionalities.
User Documentation: Create and maintain comprehensive documentation for data pipelines, processes, and configurations to facilitate knowledge sharing and onboarding.
Collaboration: Partner with data analysts, business collaborators, and data scientists to understand data requirements and translate them into effective data engineering solutions.
Performance Monitoring: Monitor data pipeline performance and solve issues to ensure optimal data flow, and proactively find opportunities for enhancement.
Data Governance and Compliance: Ensure consistency to data privacy and compliance standards provided by internal compliance teams throughout the data lifecycle within the CDP.
Skills Required
Machine Learning
Python
Find more jobs at Manulife
Manulife is a leading financial services group. We provide financial advice, insurance, as well as wealth and asset management solutions for individuals, groups and institutions.
