Dynamics GP Scraper, Modelling and Data Quality

Daniel Thompson

Built a web-scraper to pull a specific version of Dynamics GP from a web-server. Then built a model using the data to construct the schema within a database for testing, built a set of soft constraint data quality rules against the schema, and ported these to run against a clients live version of Dynamics GP. Also produced a visualisation using python's NetworkX and Plotly packages, in order to show how the system joins function. Added a governance model over the top as well, in order to group tables and data quality errors by their logical entities.
Like this project
0

Posted Nov 28, 2023

Developed Python web scraper to pull schema for Dynamics Great Plains. Wrote Data Quality rules against the data. Added governance framework over the top.

Customer Profile Deduplication
Customer Profile Deduplication
Data Migration - NetSuite
Data Migration - NetSuite