2022 releases

The 79 release notes published during 2022, newest first.

2022-12-13

We are pleased to introduce a new Reference Data API endpoint: Generate Golden Record, that allows to create a golden record out of any cdqId.

By default the Golden Record is generated based on a best match from primary or preferred data source (more about that can be found in the golden record rules). Since now a Golden Record can be also generated on a basis of any record (represented by cdqId in the API request) even from other data sources than primary or preferred.

Let's take a look at the following example - normally, when doing a lookup for "name: SAP AG, country: Germany", the golden record is generated by default on the basis of DE.RC record, however in the results there is also a record from BE.CCD data source. If there is a need or wish a Golden Record to be generated on a basis of this particular record, you can use the new endpoint, providing just a cdqId in the request body (see attached image).

Notice that for now this feature can be used via API, but soon it is going to be available in the Business Partner Lookup app as well.

2022-12-09

We have added an "Account dropdown" in the Cloud Apps’ header. The account dropdown contains information like the name and email address of the user, as well as links to "management" apps (e.g. user management, storage manager, global settings, API key management, etc.). At the bottom of the modal you will find logout reset password options.

2022-12-09

We have revised all “Requests settings” modal in our single apps (Validation, BP Curation and Address Curation) and it turned out that there were a lot of inconsistencies in regards with the “Request settings” (configuration) modal. Therefore we have introduced all of the missing fields in those modals.

2022-12-08

We extended and improved the data quality rulebook for the following countries:

Latvia

• Post code format invalid (Latvia). The LV-prefix is now optional.

Puerto Rico

• Post code format invalid (Puerto Rico). We allow newly the 5 and 5+4 format.

Cambodia

• Since 2018 the post code became a 6-digit code which ranges to our knowledge from 010000 to 250702 and replaces the 5-digit code. We identify now the old format as deprecated: Deprecated post code format identified (Cambodia).
• Additionally, the general post code format rule does allow for both versions of the post code (see Post code format invalid (Cambodia))

Mauritius

• The old 7 alphanumeric digit code is identified by this data quality rule Deprecated post code format identified (Mauritius)).
• Additionally, the general post code format rule does now allow for both versions of the post code, the 7 digit and the latest used 5 digit post code (see Post code format invalid (Mauritius))

2022-12-07

In Egypt the so called Advance Cargo Information (ACI) System was introduced. It is a new customs system that requires cargo data and documents (e.g. the invoice and packing list) to be provided upfront by the shipper. This is strictly mandatory for all Egypt import shipments since July 2021. Any deviation from the ACI standard is usually not accepted and results in shipments rejection and potential customs penalties.

• Particularly, the shipper has to provide a Consignee Enterprise code, which is the tax identification number in Egypt. The tax identification number is a 9 digits number issued by the Egyptian Tax Authority uniquely identifying all companies registered in Egypt.
• The CDQ Cloud Services now support the tax identification number. This enables data sharing of business partners in Egypt. In particular data sharing supports you now in enriching and confirming the correct consignee code, and validating its format.
• see CDQ/Business Partner/Identifier/TIN EG.
• The data sharing quality gate was extended by a data quality rule that checks the format of the tax number, see Identifier format invalid (Tax identification number (Egypt)).

2022-12-06

We recently added the National Provider Identifier and the DEA number to our data model. They are required when doing business with HealthCare Providers in the United States in order to satisfy multiple compliance requirements.

• The CDQ/Business Partner/Identifier/US NPI (NPI) is a unique 10-digit identification number issued to health care providers in the United States by the Centers for Medicare and Medicaid Services (CMS)..
• The CDQ/Business Partner/Identifier/US DEA is the identifier that allows medical professionals to write prescriptions for controlled substances. DEA numbers consist of two letters, six numbers, and one check digit. DEA numbers are smart numbers meaning some of the digits have meaning.

For both identifiers there are data quality rules in place, please see for more information the following two links:

• Identifier format invalid (DEA Registration Number (United States))
• Identifier format invalid (National Provider Identifier (United States))

2022-12-05

The CDQ Data Quality Checks allow for checking the format of the CDQ/Business Partner/Identifier/BR ID AT (local name: Firmenbuchnummer). The underlying data quality rule was improved:

• The rule allows now the rather commonly used prefix FN as part of the actual identifier
• The rule supports now the format of the Firmenbuchnummer for registered branch offices. In this case the actual identifier can comprise up to three additional digits for identifying the particular branch.

2022-12-02

Honduras once introduced a postal code of 6 alphanumeric characters in the format AA9999 that replaced a 5 digit postal code. To our knowledge as of today the 5 digit postal code is again commonly used and replaced the previously introduced 6 digit one.

• A new rule identifies the "old" post code format of Honduras (6 alphanumeric characters): Deprecated post code format identified (Honduras)
• The existing rule that checks the post code now allows both types instead of enforcing the 6 digit one: Post code format invalid (Honduras)

2022-12-02

We have introduced a small improvement in the settings modal of the Data Source Manager app. If you try to save credentials/quota modal with empty credential input fields, we would indicate that at least one of the fields is empty. Hopefully, it will make it easier to activate a particular Data Source.

2022-12-01

Each record in the lookup request results contains information about the underlying data source in form of the prefix of the data source.

Since now the information about data sources will be more extensive, as we added "dataSourceName" field in the result, which represent a full name of a corresponding data source.

2022-11-30

Recently we have introduced a few features related to address curation results, that might be useful for some of our customers.

Here is a short description of these features:

• JOIN_THOROUGHFARE_NUMBER_POSTFIX - thoroughfare number in address curation result is added to thoroughfare value as a postfix
• JOIN_THOROUGHFARE_NUMBER_PREFIX - thoroughfare number in address curation result is added to thoroughfare value as a prefix
• PREFER_THOROUGHFARE_NAME - thoroughfare value in address curation result is replaced by thoroughfare name
• PREFER_THOROUGHFARE_SHORTNAME - thoroughfare value in address curation result is replaced by thoroughfare short name

2022-11-30

CDQ finished the new notification component, which will allow sending periodical or based-on-event notifications to users. In the first iteration, we will provide a new weekly email “Briefing email” with current statistics of CDQ and customer workspace.

The Briefing email consists of four sections:

• General information
• number of records of the data mirror
• number of records under CDQ management
• number of records in the CDQ POOL
• number of updates done by all org - last week
• Releases
• list and links to all releases from the last 7 days
• Data quality
• Records without Critical Violation per Country
• Records without Critical Violation over Time
• Data sharing
• Overlap ratio
• Current Sharing Status

The old bi-weekly emails will be shut down.

To turn on the Briefing email do the following steps:

• Go to the Global settings
• Choose the workspace and click on the new card – Manage notifications
• Create a new configuration
• Add users

2022-11-28

RO.TR (National Trade Register Office of Romania) is the next data source that can be actively monitored in Data Clinic app.

2022-11-22

Business partner records from European Medicines Agency's Organisation Management Services (SPOR.OMS) can now be monitored against updates in our Data Clinic app.

2022-11-21

We extended and improved the data quality rulebook to better cover the requirements on post codes in Kazakhstan.

Kazakhstan introduced a new seven-character postal code (pochtovye indeksy) system in 2016 to replace its six-digit (999999) code that had been in use since 1997. The new code has seven alpha-numeric characters (for example; D03K5Y2) and each code is intended to represent a single building. The new system is currently working in parallel with the old system, as many people continue to use the 6-digit codes.

A new rule was introduced that identifies the "old" post code format and provides users with this information (see Deprecated post code format identified (Kazakhstan)). Additionally, the general post code format rule does now allow for both versions of the post code (see Post code format invalid (Kazakhstan))

2022-11-18

The Economic Operators Registration and Identification number (EORI number) is a European Union registration and identification number for businesses which undertake the import or export of goods into or out of the EU. Any business or individual established in the EU (an economic operator) needs to obtain an EORI number from their national customs authority before commencing customs activities in the EU. The CDQ data model does now support the EORI number! Validation capabilities are not yet available.

2022-11-18

We have improved job cancellation flow in the job tables. Previously, 4 clicks were needed to cancel a job (selecting a job, clicking on drop-down, selecting action and confirming cancellation). Now the flow is down to 2 clicks (clicking on the (x) button and confirming the cancellation).

• Please note that the job cancellation is (for now) available only for: reports, duplicate, and linkage jobs.

2022-11-18

Reference data sources selected in BP update monitoring (configuration page) now are autopopulated on the Reports page in the BP Update Browser App. So now, there is no need to get back to the update monitoring configuration page to check which reference data sources were turned on.

For convenience, we also added a “Select all” checkbox that checks all data sources in the modal.

2022-11-17

OpenPeppol is a non-profit international association registered in Belgium, it's the governing body of the primary implementation and developer of PEPPOL specifications. PEPPOL stands for Pan-European Public Procurement On-Line, it's an electronic data interchange protocol, designed to simplify the purchase-to-pay process between government bodies and suppliers.

Since now Peppol records (currently over 630k maintained) are available via our Referencedata API and Lookup apps.

Of course, to have an access to this data source, it needs to be activated in Data Source Management in the Global Settings app.

2022-11-17

For the CDQ/Business Partner/Identifier/SG UEN it is now supported to check the consistency of the maintained name, post code and street against the business register of Singapore. Particularly the following rules were newly published:

• SG.BR)
• SG.BR)
• SG.BR)

2022-11-16

There are several smaller jurisdictions that issue business identifiers such as tax- or business registration numbers. We researched and added identifier types for the following jurisdictions and implemented additional data quality rules for ensuring data quality.

Greenland

Newly supported identifier types:

• CDQ/Business Partner/Identifier/GL CPR
• CDQ/Business Partner/Identifier/GL GER

Identifier format checks:

• Identifier format invalid (GER number (Greenland))
• Identifier format invalid (CPR number (Greenland))

Identifier schema checks:

• Identifier format inaccurate (GER number (Greenland))
• Identifier format inaccurate (CPR number (Greenland))

Jersey

Newly supported identifier types:

• CDQ/Business Partner/Identifier/JE TRN
• CDQ/Business Partner/Identifier/JE SSN

Identifier format checks:

• Identifier format invalid (Social Security Number (Jersey))
• Identifier format invalid (Tax Reference Number (Jersey))

Identifier schema checks:

• Identifier format inaccurate (Social Security Number (Jersey))
• Identifier format inaccurate (Tax Reference Number (Jersey))

Iceland

Newly supported identifier types:

• CDQ/Business Partner/Identifier/IS IIN
• CDQ/Business Partner/Identifier/IS VAT

Identifier format checks:

• Identifier format invalid (Value Added Tax Number (Iceland))
• Identifier format invalid (Icelandic Identification Number (Iceland))

Identifier schema checks:

• Identifier format inaccurate (Icelandic Identification Number (Iceland))
• Identifier format inaccurate (Value Added Tax Number (Iceland))

Faroe Islands

Newly supported identifier types:

• CDQ/Business Partner/Identifier/FO FPN
• CDQ/Business Partner/Identifier/FO FVN
• CDQ/Business Partner/Identifier/FO FIN

Identifier format checks:

• Identifier format invalid (Faroese Identification Number (Faroe Islands))
• Identifier format invalid (Faroese V Number (Faroe Islands))
• Identifier format invalid (Faroese P Number (Faroe Islands))

Identifier schema checks:

• Identifier format inaccurate (Faroese Identification Number (Faroe Islands))
• Identifier format inaccurate (Faroese P Number (Faroe Islands))
• Identifier format inaccurate (Faroese V Number (Faroe Islands))

2022-11-15

Yet another data source can be activated for update monitoring. This time we enabled UK.VAT.

Quick reminder - in order to turn update monitoring on, please go to Data Mirror > Data Clinic app, select you data source and then external data sources you wish to monitor for updates.

2022-11-14

For ensuring a high data quality in the CDQ Community Data Pool a strong Data Sharing Quality Gate is required. We extended the standard data quality ruleset for South Africa by the following rules:

• Unallowed company name (ZA).

• In South Africa a Company name, irrespective of its form or language, must end with one of the following expressions, as appropriate for the category of the particular company:

• (a) in the case of a personal liability Company, the name must end with the word ‘‘Incorporated’’ or its abbreviation ‘‘Inc.’’,

• (b) in the case of a private Company, the name must end with the expression ‘‘Proprietary Limited’’ or its abbreviation, ‘‘(Pty) Ltd.’’,

• (c) in the case of a public Company, the name must end with the word ‘‘Limited’’ or its abbreviation, ‘‘Ltd.’’.

• (d) in the case of a state-owned Company, the name must end with he expression ‘‘SOC Ltd.’’, and

• (e) in the case of a non-profit Company, the name must end with the expression ‘‘NPC’’.

• Identifier format invalid (VAT registration number (South Africa)).

• The VAT Number is a unique number, which consists of 10 digits and always starts with the number 4.

• Mandatory identifier not maintained (South Africa)

• We expect records that are entering the community data pool to follow the following constraint: A business partner in South Africa should have at least a CDQ/Business Partner/Identifier/ZA VAT or a CDQ/Business Partner/Identifier/ZA CRN.

2022-11-14

Business partners can now be linked with the CDQ.POOL for enabling continous updates from the sharing community by multiple identifiers. For example linking for linking your Danish business partners you may use now a EU VAT OR the local CVR number (company registration number).

In order to reflect this in the data sharing quality gate, new data quality rules that check for the availability of at least one of the required identifiers for linkage are introduced. These rules produce data quality defects of the criticality ERROR. The corresponding rules that just check for the availability of a particular identifier type (e.g. EU VAT) are now considered to be just of criticality INFO in the standard ruleset.

The following rules are now available:

• Mandatory identifier not maintained (Czech Republic)
• Mandatory identifier not maintained (Denmark)
• Mandatory identifier not maintained (Hungary)
• Mandatory identifier not maintained (India)
• Mandatory identifier not maintained (Italy)
• Mandatory identifier not maintained (Netherlands)
• Mandatory identifier not maintained (Norway)
• Mandatory identifier not maintained (Poland)
• Mandatory identifier not maintained (Spain)
• Mandatory identifier not maintained (United Kingdom)

2022-11-11

We newly support the following identifiers in our data model

• CDQ/Business Partner/Identifier/SM SSI
• CDQ/Business Partner/Identifier/SM COE

Along with these new identifier types the following data quality rules were added:

Identifier format:

• Identifier format invalid (Social Security Number (San Marino))
• Identifier format invalid (Tax Registration Number (San Marino))

Identifier schema:

• Identifier format inaccurate (Social Security Number (San Marino))
• Identifier format inaccurate (Tax Registration Number (San Marino))

2022-11-11

For ensuring a high data quality in the CDQ Community Data Pool a strong Data Sharing Quality Gate is required.

Some wrong format check of the postal code in Turkmenistan was identified in an existing rule of our standard data quality ruleset: see https://meta.cdq.com/Post_code_format_invalid_(Turkmenistan). The rule was improved and checks now post codes properly according to the following definition:

Postal codes in Turkmenistan consist of a block of 6 digits. It is the same code that was used before the independence of Turkmenistan from the Soviet Union. All codes commence with 7. The first three digits indicate the main town, the final three the nodal centre of the city or a rural post office.

2022-11-10

We are continuously expanding the list of data sources that can be activated for update monitoring. The next one is SK.FS providing data of Slovak business partners.

2022-11-09

Configurations for a distinct workspace for the CDQ Data Quality Checks can be read, created and updated, and deleted now via API. Please find the documentation of the new endpoints here!

2022-11-09

From now on, if you want to get detailed list of business partners violating data quality, you can easily get it via integration between Data Quality dashboard and Data Clinic. In the filter section of the Data Quality Dashboard, new button called Go to Data Clinic was added. The button respects your selection of filter options in the dashboard (e.g. data source and countries) and reflects the selection in the Data Clinic view.

2022-11-09

We have added a possibility of filtering by "External ID" field on the Data Clinic - Review Single page. We have also improved the display of the country filter - now we display only countries that have at least 1 BP (previously we displayed all countries).

2022-11-07

Update monitoring can be now activated also for companies from Hong Kong

2022-11-04

Internal Revenue Service (IRS) is another data source that can be now activated for the Business Partner Update Monitoring feature

2022-10-10

We are happy to share with you new chart in the DQ dashboard. The chart compares average data quality across countries. Next to the jitter chart focusing on countries in scope for given organisation, the new chart Data Quality Performance Benchmark by Country provides a comprehensive summary for all the countries across all of the organisations. The chart displays, apart from the average data quality, number of organisations having given country in scope. This is the tool for user to evaluate how reliable the average data quality score might be. The more organisations scoping the country, the more reliable the average data quality score is. Check it out and let us know.

2022-09-29

Some part of business partners from SPOR OMS data source contain Global Location Numbers which are now available in BP Lookup results.

2022-09-28

Merge of tabs per request and per match in one single tab

The batch lookup report has changed it's layout. More of you were asking, why do we maintain within the report two tabs if the content is similar. The only difference was, if given input business partner get a positive hit in external reference data or not.

All of this was driver for the change. From now on, you get one consolidated tab with all of the content. To easily filter out lines, where reference data API didn't provide any candidate, you can use the column No Match. If the columns value is set to yes, then you get just the blue line representing the input business partner.

As side effect, the avg generation time for the report was decreased by 15 %.

2022-09-21

We have introduced tooltips with provenances of Data in the Augmented Record view in the Data Clinic.

Additionally, for identifiers, we have introduced Matching Scores.

So now, users can make better-informed decisions about accepting decisions from augmented record.

2022-09-19

From now business partners with more than one address version can be shared in the CDQ.POOL. Previously if we detected more addresses the sharing was blocked and the business partner got the status: Under consideration.

To the pool will be taken only one address version – in the first place with characterset Latin and language: EN. Then, if the business partner doesn't have this combination will be taken the first address with Latin charset, or later EN language. If there is no information about the language and charset or there are available different combinations then the CDQ.POOL will be updated by the first address.

Second and further addresses won’t be shared in the CDQ.POOL. Only the address chosen in the sharing process will get updates from the POOL.

2022-09-11

We have added a tooltip with alternative addresses the Data Clinic review single page.

If there is more than 1 address, you will see a tooltip called "Alternative addresses" and you can preview/compare the addresses. The "Alternative addresses" tooltip also contains information about the charachter set and language.

This tooltip is available in the BP single lookup app.

2022-09-06

We have implemented extended record view in the Data Review single mode.

Now you can easily compare extended and original record within one click. Moreover, you can also compare the validation results for the original record vs validation results for the extended record.

2022-08-26

The standard data quality ruleset was extended by the following rule:

• Identifier checkdigit invalid (European value added tax identifier (Czech Republic)) Please see also the previous note

2022-08-25

For ensuring a high data quality in the CDQ Community Data Pool a strong Data Sharing Quality Gate is required. The standard data quality ruleset was extended by the following rules:

• Checkdigits for the ICO number in Czech Republic are now checked
• as well as for the DIC number

2022-08-22

We have introduced some improvements in the user workspace assignment.

Editing workspace has been split into two modals:

1. Workspace settings (“Edit workspace” button) - it’s a place where you can edit workspace’s name and enable features (like weekly email or setting as sharing workspace.

2. User assignment (“Members button”) it’s a place where you assign new users to the workspace. We have improved the display of this section and we have added a search bar to find exact users quicker.

2022-08-22

We have introduced the “Show configuration for” section in the Country-specific Data curation configurator.

Thanks to the new feature, we can easily see which configurations have been already saved and we can browse configurations for those countries with one click.

2022-08-19

We have removed a session timer from the Cloud Apps

There is no longer need for manual refreshing a session. The session is refreshed automatically, if there's interaction (a click, a scroll, etc).

If there is no activity for 30 minutes (no click, no scroll, no focused tab, etc) -> User will be logged out and we will display a message that the session has expired.

2022-08-18

Chorus Pro is an open provider of data about public institutions such as hospitals, kindergardens, universities etc. in France.

It offers around 200.000 records and now they all are available in our Reference Data API and Lookup applications.

In order to have an access to this data source, don't forget to activate it in Data Source Management in Global Settings app.

2022-08-09

Every workspace can have exactly one data mirror, but with mutiple data sources.

Making a request to Referencedata API with API Key associated with the workspace, the response will contain results only from the data mirror of the workspace, not from all data mirrors of the organization (like it was so far).

By default the whole data mirror is taken into considaration, but of course - user can select specific data sources in the request.

2022-07-23

Whenever a new workspace is created, we will automatically create a Data Mirror.

This feature was implemented in order to increase the usage of mirrors, monitors, and other additional features.

2022-07-11

Curation reports contains information about status of identifiers enrichment. So far, there were three types of statuses - Added, Modified and Deleted - according to the type of change of identifier from input data. Recently we added another change type - CONFIRMED - for identifiers that has not been changed in any way, but the curated identifier is exactly the same as the original.

In the screenshot attached you can see the example from API response, but the same information will be included in the curation reports.

2022-07-06

After several reviews, finally, the Data Sharing Dashboard is out and ready for you. The dashboard is accessible via Cloud APP in the section Data Mirror Hub next to the other two dashboard applications.

2022-06-23

Often requested feature finally delivered!

Now you can easily go back to the null value of the endpoint's parameter. When the parameter is chosen by the default or by the user, just click the cross (x) in the drop-down list to go back to the null value.

Check it by yourself with the curationLogResultStatus parameter in the following endpoint: Read Business Partner

2022-06-03

We are happy to announce that Fraud Case App received several improvements. From now on, while reporting a specific fraud case, some fields need to be populated before saving a new case is possible.

2022-05-31

Business Partner Lookup service and app allow to specify the data sources which user want to search for business partners from. So far only one data source could have been selected, but since now it is possible to specify multiple of them.

This change applies both in Cloud Apps (Single Business Partner Lookup and Business Partner Lookup Configurator) as well as in API endpoint.

Notice, that dataSource keyword became deprecated and replaced by dataSources which requires providing data sources names as an array, for example: "dataSources": [ "VIES", "AT.FON", "DE.RC" ]

2022-05-20

New colourist enhancements were implemented for better orientation in the Tutorials landing page.

Now you can navigate with colours to reach the right type of tutorial.

2022-05-16

We thank to everyone, who contributed to the review of the Data Quality Dashboard. We used your feedback and made changes to allow better user experience. Here is what is new/changed:

• Colour-coding of chart Records without Critical Violation per Country is now more clear in telling the story
• Benchmarking section has two new charts to support the message in existing Data Quality Performance Benchmark table. The overall benchmarking and benchmark broken down by country (top ten countries from data mirror - by total number of records for given country). The green/red bubble represents the organisation view, while the grey bubble are the other organisations in the benchmark set. If your bubble is red, your data quality is worse than the average, and it's green in opposite.
• We reduce whitespaces and big paddings in charts

2022-05-13

This tutorial presents a sequence of activities for sharing business partner data with the CDQ Community Data Pool and monitoring updates and statistics.

Check this tutorial on the Developer Portal.

2022-05-12

A lot of the configuration options (e.g. Generate Data Dump, Validation Configuration, etc) allow to select a specific country (or multiple countries).

However, using this feature was impractical because we were displaying all of the countries in the list, even if we didn't have any records for a particular country.

As of now, the country drop down lists are adjusted accordingly - we only countries if there are any records available.

2022-05-12

CDQ's natural person identification feature identifies and categorizes given business partner data that represents natural persons. It searches for evidence of personal information in the given data; particularly in the provided name. The identification process was improved to better categorize records that comprise titles in their name, such as Dr., Prof., PhD, Dr. med. etc. This feature improvement significantly reduces the false-positive rate.

2022-05-11

In the past, some of the users were struggling to choose the appropriate workspace after logging in, which could lead to making changes in the wrong workspace.

In order to address that, we have implemented a logic that “remembers” the last used workspace - once a user logs in again, the last used workspace is already selected.

This should help users working on multiple workspaces.

2022-05-11

Another 'big brother' dashboard is here – this time within the area of fraud prevention. The Risk & Compliance Dashboard contains bank data and fraud case information. Thanks to a great collaboration and dynamic, the DA Team completed the pipeline, a prototype and full implementation within 3,5 weeks. Within the new dashboard, a 'Benchmarking' section is implemented that contains an interactive chart with averages to easily compare organisations.

2022-05-11

Old tutorials in Quickstart pages were replaced by:

• links to new tutorials & instructions pages
• authorization introduction

2022-04-29

Recently we made a small improvement in applications with forms that contains identifier types selection drop-down.

Currently, after selecting a country name, all identifier types related to the country, are listed with their full names, which will be more readable and user-friendly.

2022-04-25

Before this new feature, all data monitors were started in the bi-weekly mode and executed on all data of the customer data source. If there were no changes in the customers' data or in the configuration then the results of validation would be the same.

To avoid this situation, be more near-real-time, and event-driven we prepared a new approach to keep the best quality of the data. Data validation or curation is performed only for data where was some change – added, deleted, or changed.

Results of validation/curation are stored in the processing log for each BP, and in the near future will be possible to use this data in f.e. in the collaboration process or Business Partner Updates.

With this release we changed existing apps:

Data Monitoring Configuration was moved to the Data Clinic app (Data Mirror APPs). Currently, there is possible to add not only data validation monitoring but also curation. Monitors can be executed with trigger mode.

Customers can also enforce the execution of the job on the whole data source immediately. To do that choose the data monitor and press the button „Enforce job now”

Update Monitoring configuration was also moved to the Data Clinic APP. For convenience, we also added a special button to select all ref data sources with one click.

The beta version of Data Clinic APP is available for all users with DATA_MIRROR_APP_MANAGER role.

2022-04-25

Check the Developer Guidelines page.

2022-04-22

This tutorial presents a sequence of activities for retrieving updates from a defined set of connected data sources and browsing & analyzing them.

Check this tutorial on the Developer Portal.

2022-04-07

New API provides services to manage review decisions.

Check the documentation and try it out on the Developer Portal.

2022-03-29

For ensuring a high data quality in the CDQ Community Data Pool a strong Data Sharing Quality Gate is required. The standard data quality ruleset was extended by the following rules:

South Africa

The new DQ rule for South Africa checks the validity of the format of CDQ/Business Partner/Identifier/ZA CRN. The correct format is YYYY/NNNNNN/NN, where:

• YYYY - the year of establishment

• NNNNNN (1st sequence) - the sequence # of a business entity in the registry

• NN (2nd sequence) - the type of the business entity, e.g.:

• 06 PUBLIC COMPANY

• 07 PRIVATE COMPANY

• 08 ARTICLE 21

• 09 LIMITED BY GUARANTEE

• 10 EXTERNAL COMPANY

• 12 EXTERNAL COMPANY UNDER SECTION 21A

• 21 INC

• 22 UNLIMITED

• 23 CLOSE CORPORATION

• 24 PRIMARY COOPERATIVE

• 25 SECONDARY COOPERATIVE

• 26 TERTIARY COOPERATIVE

• 30 STATE OWNED COMPANY (SOC LTD)

• 31 STATUTORY BODY

CDQ's identifier checks were extended with the following rule for South Africa:

• Identifier format invalid (Company registration number (South Africa))

Reunion

The existing DQ rule for post code format in Reunion was updated with a new regular expression that includes codes in the ranges 97400 - 97499, 97701-97751, 97801-97899:

• Post code format invalid (Reunion)

2022-03-25

When we know for a given identifier that it comprises a checksum or checkdigit, we check whether the identifier is consistent with respect to this checksum or checkdigit. There are already more than 90 data quality rules that perform such checks. However, each tax identifier has its own calculation logic (from simple to really complex). Sometimes there are edge cases that produce false positive rule violations, particularly if there is not a well documented reference of the checkdigit algorithm.

We recently improved some checkdigit calculations where we identified such edge cases:

Ireland

• Invalid checksum of EU VAT ID IE (Ireland)

Spain

• Invalid checksum of CIF number (Spain)
• Invalid checksum of NIF number (Spain)

Switzerland

• Identifier checkdigit invalid (Company identification number (Switzerland))
• Identifier checkdigit invalid (VAT registration number (Switzerland))

France

• Invalid checksum of EU VAT ID FR (France)

2022-03-23

For ensuring a high data quality in the CDQ Community Data Pool a strong Data Sharing Quality Gate is required. The standard data quality ruleset was extended by the following rules:

Malaysia

With effect from 11 October 2019, the Companies Commission of Malaysia (“SSM”) adopted a new unified registration number for businesses. The new registration number format consists of:

• First 4 digits: the year the business entity was registered, e.g. 2019 means the business vehicle was registered in the year 2019;

• Following 2 digits: business entity code, being:

• 01: local company;

• 02: foreign company;

• 03: business (register of business);

• 04: local limited liability partnership;

• 05: foreign limited liability partnership;

• 06: limited liability partnership for professional practice; and

• Last 6 digits: the registration number sequence.

CDQ's identifier checks were extended with the following rules for Malaysia:

• Identifier missing (Business Registration Number (Malaysia))
• Identifier format invalid (Business Registration Number (Malaysia))
• Deprecated identifier found (Business Registration Number (Malaysia))

Indonesia

• Identifier missing (Tax Identification Number (Indonesia))

Korea

• Identifier missing (Corporation ID (South Korea))

2022-03-18

Recently, we have implemented some helpful functionalities in the First Time Right application:

• Maximum Candidates Volume is available in Lookup Settings, so it's now possible to get more than default 10 results in lookup
• Business partners and natural persons can be now checked against sanctions and watch lists thanks to Screen Business Partner function
• Business partner attributes (like the name, address values and identifiers) from lookup result can be populated into the search mask using a button [Transfer values to search mask]. Thanks to this functionallity you don't need to copy all the values manually into the form fields, but have them filled instantly with one click and then use the data for validation or curation etc.

See the new functionalities in action in the attached recording.

2022-03-16

Our pioneer results in online visualization of data quality are here – welcome the Data Quality Dashboard! We have built our own technology to display data quality results as part of the cloud application. The dashboard is workspace sensitive (the change of workspace will trigger the refresh of the dashboard and load correct data reflecting the user selection). The dashboard is also secured with our latest IT security principles – data cannot be obtained by calling the dashboard URL directly.

It’s important to mention that the data quality dashboard works and displays only validation results which were generated by a scheduled job in the data mirror management configuration. Any other type of data validation results (custom runs in data mirror or ad-hoc customer runs) are ignored by the dashboard.

The Data Quality Dashboard is accessible from the cloud application landing page.

2022-03-12

All data quality rules that perform qualified checks against reference data are now supporting fuzzy comparisons. This means that differences in names such as Hotel Lindner vs. Lindner Hotel are now accepted. Each rule documentation shows explicitly the comparator and threshold that we are applying in the standard. This impacts all qualification rules against AT.FON and VIES, but e.g. not BZST as here the comparisons and decisions are performed by the data source itself.

2022-02-28

The rule https://meta.cdq.com/Unallowed_pattern_detected_(name_local) searches for patterns of unallowed values in the name such as links to duplicate or new records in order to identify data records that are not really representing company records.

For an easier management of such unallowed patterns and particularly enabling country specific checks the existing rule was splitted into atomic rules per country. We now avoid that patterns that are applicable for some, but not all countries produce incorrect rule violations. For instance, there is a pattern that searches for numbers with more than 7 digits in a name (e.g. CDQ AG 12345678). If such a pattern is identified the rule fires. However, while this is typically correct for Swiss records, in Brazil there are cases where the registration number is added to the name and thus the rule provides false-positives. Similarly, there are patterns which render a name dubious in case it consists of more than 7 words. Also this is relatively common in Brazil in contrast to e.g. Germany.

By managing these patterns now per country we avoid false positive rule violations. As the existing rule was as well part of the data sharing quality gate, we thereby also increase the number of records in our community data pool.

The new data quality rules can be browsed in the existing rule category: Name Patterns. The old rule will be archived.

2022-02-24

We are still working on increasing the number of data sources with the possibility to manage the quota. From now Quota Management is available also on:

• AU.BR
• AT.FON
• DnB
• BVD
• CH.UIDR
• VIES
• PL.NOBR

How to set the quota?

1. Go to the Global Management APP
2. Accept Terms of use and activate the data source
3. Provide credentials (if required)
4. Check the global quota for your organization
5. Set max quota for your organization and workspaces

2022-02-20

The Global location number (GLN) is part of the GS1 standards. It is a simple tool used to uniquely identify a location. The identifier is compliant with the norm ISO/IEC 6523. CDQ's standard data quality ruleset was extended by the following rules for ensuring the accuracy of the GLN.

Format

• Identifier format invalid (Global location number)

Checkdigit

• Identifier checkdigit invalid (Global location number)

2022-02-18

For ensuring a high data quality in the CDQ Community Data Pool a strong Data Sharing Quality Gate is required. The standard data quality ruleset was extended by the following rules:

Italy

• Identifier missing (Fiscal code (Italy))

Japan

• Identifier missing (Corporate number (Japan))

India

• Identifier missing (PAN code (India))

2022-02-16

To make Business Partner Update Browser APP more valuable and userfriendly we provided the following improvements:

• Added information about the type of change– „added”, „modified”, and „deleted
• Added new filters – by provenance, by change classification
• Fixed bug with name transformation in the BP table
• The UI of detail view improved

2022-02-15

D&B Storage is available in Data Store Manager app in a separate tab and it is a storage dedicated to maintain records from Dun & Bradstreet data source.

Records can be imported by uploading a csv or xlsx file with a list of DUNS numbers or CDQ ID identifiers.

The file should contain only one column and the first row should be named "DUNS" as a header.

Records then will be fetched and saved in CMPELKv2 format in a storage.

The content of a storage can be browsed (see screenshot) and downloaded as a XLS report. The report generator allows you to include business partners from specific countries or to generate a report from the entire storage.

It is possible also to interact (reading all records, fetching single records, importing new business partners, etc.) with D&B Storage via API

2022-02-02

The first iteration of the Business Partner Updates APP provides the functionality of browsing and filtering proposals of updates from selected reference data sources. To do that using web services we provided a new application, which can be used to check the whole list of your business partners, filter by the selected concept, country, or data. The second page is a detailed view of a selected business partner, where proposals of changes can be compared to the original data from the data mirror.

Check the Business Partner Updates APP

If you don’t have any updates check your settings or turn on monitoring:

1. Go to the Update Monitoring Configurator
2. Select the data source of your Data Mirror
3. Select reference Data Sources, which will provide updates
4. Save your configuration

2022-01-19

Business Partner Update provides information about changes on the relevant records from trusted data sources and from peers for your business partner data. Thanks to the Seed updates, the benefits from Business Partner Update Monitorings are available immediately, and don’t have to wait until the new update came from selected reference data sources.

To turn on updates

1. Go to the Update Monitoring Configurator
2. Select the data source of your Data Mirror
3. Select reference Data Sources, which will provide updates
4. Save your configuration

To check new Business Partner Updates generate the report in the Data Mirror Management APP or use our API.