# Tutorial: How to monitor Business Partner updates?

## Overview

**Use Case**

This use case describes the recommended use of CDQ Cloud Services for establishing continuous data quality monitoring for
Business Partner data.

![](/assets/mbpdq_overview.6b0b80dfd3a402ee83cc4df36ffb07d714af9a4efcd61211920dc86cb3a58771.a417aafd.png)

A complete use case description is available on the [Wiki](https://meta.cdq.com/Use_case/Data_Quality_Monitoring).

**Learning Goals**

![](/assets/mbpdq-process.ccbbdfa8eee672682d9c5c6839dd6a6733ca21c8a9aae3f2b67b14bbe245d48f.a417aafd.png)

In this tutorial, the user will be focused on:

- Creating configuration based on validation profiles using [Data Validation Configurator](https://meta.cdq.com/App/Data_Validation_Configurator) cloud app.
- Creating data monitor based on prepared configuration using [Data Monitoring Configurator](https://meta.cdq.com/App/Data_Monitoring_Configurator) cloud app.
- Analysing validated data with [Data Quality Dashboard](https://meta.cdq.com/App/Data_Quality_Dashboard) cloud app.
- Downloading reports using [Batch Data Validation](https://meta.cdq.com/App/Batch_Data_Validation) cloud app.


Remember
This tutorial is based on local data and specific naming. The presented results will be different from yours.

## Prerequisites

**Login**

Log into the CDQ [Cloud Apps](https://apps.cdq.com)

Authorization
If you have no access to the CDQ Cloud App, ask your internal point of contact to create a CDQ dedicated account. Account
detail will be sent by email.

**Data Mirror**

To proceed with this tutorial the Data Mirror is needed. Go to this [page](https://meta.cdq.com/Use_case/Data_Mirror_Setup_and_Synchronization) to get more information.

## Step 1: Data Quality Monitor Configuration

### Create a configuration for the Data Quality Rules Engine that is used for monitoring

Application to be used
**[Data Validation Configurator](https://meta.cdq.com/App/Data_Validation_Configurator)** - allows customizing the validation process by certain rules and parameters.

1) Pick Data Validation Configurator from accessible apps
2) Click create for a new configuration
3) Name the new configuration `Standard`
4) Click create


|  |
|  --- |
| ![](/assets/createconf.b062a69a75a650a8783923a435ebc9d05f019b714d0e50168b733a8584317431.a417aafd.png) |


1) Check the `Data Validation Configuration` table below. Every configuration has a unique number assigned.


|  |  |
|  --- | --- |
| ![](/assets/conflist.b1c005a131a71f645a74b025b5a32407f913f64084051cc1459f3617bd84d838.a417aafd.png) | ![](/assets/confid.f0db1081d02768fe212c16062e5181e69bc5899da2f2ee77b1ecde8d50c5dac7.a417aafd.png) |


1) Select newly created configuration for an edition
2) Edit the parameters in the "Details of `Standard` configuration" section:
  - select `Standard` Validation Profile from the list
  - set the Rule Status to `Release`


| Validation profile | Rule status |
|  --- | --- |
| ![](/assets/profilesetup.fe6e36f12cff0c08b8427b3eec93b6d8aaeb28d7df793ed9fc78d97530ba5702.a417aafd.png) | ![](/assets/rulefilter.6d6cbb84faf211135a1a0f54dc66efe4abe59ae39a026a65825320257d936313.a417aafd.png) |


To read more about profiles visit this [wiki page](https://meta.cdq.com/App/Data_Validation_Configurator)

1) Limit validation results with the county filter in the "Data Quality Rules" section
  - Use filter by country and set `DE-Germany`
  - Set `Release` state of the rule


| Setting filter | Rule state |
|  --- | --- |
| ![](/assets/countryfilter.a736b5f4fb49a8feff048a97c15f1ea4539d90f60873d93b33638d24a84e073a.a417aafd.png) | ![](/assets/rulefilter.6d6cbb84faf211135a1a0f54dc66efe4abe59ae39a026a65825320257d936313.a417aafd.png) |


Congratulation
You have created a configuration for the Data Quality Rules Engine!

### Create a data quality monitor and activate it using the previously created configuration

Application to be used
**[Data Monitoring Configurator](https://meta.cdq.com/App/Data_Monitoring_Configurator)** - allows schedule regular running jobs on the data mirror.

1) Pick Data Monitor Configurator from accessible apps
2) Click Add New Data Monitor


|  |
|  --- |
| ![](/assets/newmonitor.02c116659a19876bd588a549cda77ef40e132d1d201ab8cd87145f560330aa21.a417aafd.png) |


1) In the creation windows pick:
  - Data Mirror created before ([Prerequisites](#prerequisites))
  - Configuration created in the [Step 1](#create-a-configuration-for-the-data-quality-rules-engine-that-is-used-for-monitoring)
  - Component from the list
  - Schedule plan
  - Click Create New Data Monitor


|  |
|  --- |
| ![](/assets/createmonitor.45bcfa3d405a855a9ac9a12d837039ef05bed2206e4d630b3f52e7cf078eb391.a417aafd.png) |


Thanks to the schedule set during creation, the validation process of the pointed data mirror will run automatically.
The report will be sent directly to the mailbox to be assigned to the user.

Congratulation
You have created a data quality monitor!

## Step 2: Data Quality Measurement Results Analysis

### Analyze Data Quality in the Data Quality Dashboard

Application to be used
**[Data Quality Dashboard](https://meta.cdq.com/App/Data_Quality_Dashboard)** - allows for UI guided analysis of the data quality performance, customizing dynamically result reports and enables to track the progress over time.

To analise the quality of the data, it is important to prepare quality dashboard:

1. Select your workspace where the desired data source is located


|  |
|  --- |
| ![](/assets/dqd_workspace.ef03d9147f989b86a11bfe01fe5cae8ab640442f81b4161748de60f7342f288e.a417aafd.png) |


1. Open the filter by clicking on the icon in the upper-left corner of the page


|  |
|  --- |
| ![](/assets/dqd_filter.9522f303ff9880f25d7772c421923a7cafe25bfdc6788e4bb8c10ff5bebb7489.a417aafd.png) |


1. Set data source and select the countries you want to validate the data for
2. Select **Apply** button


|  |
|  --- |
| ![](/assets/dqd_filtersettings.5450b3bd8e807607eb808a13da23ff56048bfaf0ebb426b246cb0aaf78390dbd.a417aafd.png) |


1. Check the data in the updated dashboard


|  |
|  --- |
| ![](/assets/dqd_dash1.1839adb55410d420f213bda24ac95b91ce1db68a368a642b619a1592d8e467cc.a417aafd.png) |


1. Check the **Number of Distinct Records** and **Records with ERROR Violation** increase/decrease indicator compared to previous data quality monitor run


| Number of Distinct Records | Records with ERROR Violation |
|  --- | --- |
| ![](/assets/dqd_changeindi.120b97908ef536f4300c57d98f85869b677269824581c196addaba2d44d026a9.a417aafd.png) | ![](/assets/dqd_violation.2cea0df3cee41fcd179cdd0718443567ee737c2e0df4038c9f58ba845e152fe8.a417aafd.png) |


1. Verify the rest of the charts


Congratulation
You have set dashboard for displaying desired data for visual analysis!

### Download Data Quality Reports

Application to be used
**[Batch Data Validation](https://meta.cdq.com/App/Batch_Data_Validation)** - run a data quality profiling on data storage and receive data quality reports.

**Batch Data Validation** app will be used as a report reader-generated from created data monitor. When the job based on
the Data Monitor schedule starts the status of completion will be visible in the **Data Validation Jobs**.

1) Validate the job status:


| Job ID | Job in progress | Job is done |
|  --- | --- | --- |
| ![](/assets/jobid.564fa0248a6f65bd94aa1f6294371dbdb633c3d6aac361bf83fc41955a4596c7.a417aafd.png) | ![](/assets/jobinprogress.3ed2a170d1527bd58f1b61a56c123905e0aed408033614e53135aa057a49670d.a417aafd.png) | ![](/assets/jobfinished.418d890e033e0fa5e316030cfbdfda262ee3352a983793a363f9b9a425bba3cd.a417aafd.png) |


1) If it's finished, scroll down to the **Data Validation Reports**


|  |
|  --- |
| ![](/assets/valreps.af9fddb5b9e851ff911ff7e4fd5f5cd5d0ea48c25e8c1bd3deae9cfb021ca3fa.a417aafd.png) |


1) Check the completion status of the report
2) Select **Show Results**


|  |
|  --- |
| ![](/assets/showres.9bf50f384b4d94797c87d5e9ed0fa7947e5c707d652c2256bf40ccd916679504.a417aafd.png) |


1) Select one of the results provided by the job and download it


|  |
|  --- |
| ![](/assets/download.2572bb86e8713226f20f942bf35b617f4082ebc1143c02791577df67356f4531.a417aafd.png) |


Pop-up Window
Remember to allow the browser to display Pop-ups.

The **Job result** page provides a list of all generated reports and the **Dashboard** with charts.

|  |
|  --- |
| ![](/assets/list.b877a134692d0daa4e28952a815fa5aeec291f9fbdd30efe883608980d5fd3e2.a417aafd.png) |


Congratulation
Now you have the report of your data quality!

## Your opinion matters!

We are constantly working on providing an outstanding user experience with our products. Please share your opinion about this tutorial!