Data Quality Management (DQM) Talend based Tool
- Task: create automated tool for managing general data quality and advance data preparation & cleansing for achieving minimum requirements for migration SAP R3 to SAP S4HANA;
Talend environment chosen for DQM tool implementation based on customers requirements - DQM Tool includes:
- Automated Data Load from SAP via BW Interface
- Fast and reliable running of relevant DQ Rules in Talend
- Keeping affected and resolved records periodized in SQL Server
- Sending affected records into Talend Data Stewardship (TDS) for checking by Data Stewards (also storing affected records into excel files)
- Loading resolved cases from TDS
- Sending PI Relevant Rules cases to PI Interface for automatic updated in SAP
- Handling error cases from automatic SAP update
- Levels of support:
- Consulting – architectural level design
- Operations – work on ensuring and improving data quality by performing monthly DQ Rules RUNs; implementing additional DQ Rules, which acquired deep understanding of data content; assist in process improvement
- Technical – completely create Talend tool that automate processes, connecting Talend tool and storing periodizes data in SQL Server and Qlik Sense Reporting for DQ Monitoring