# 2021 releases The 79 release notes published during 2021, newest first. This is an archive page. These notes were written at the time of each release and are kept for reference, so they may describe apps, endpoints and options that have since changed or been retired. For the current record of changes see the [Changelog](/documentation/_public/changelog), and for what a recent release means in practice see [Product news](/documentation/_public/product-news/product-news). ## December 2021 ### Bureau van Dijk data source added to Business Partner Lookup App *2021-12-17* BvD Orbis is one of the world’s most powerful comparable data resource on private companies. Bureau van Dijk treat and standardize data from a wide range of sources to provide you with value-added company information. The new data source is also available in [Batch Overlap Check APP](https://meta.cdq.com/App/Batch_Overlap_Check) ### Identifying legacy VATs in United Kingdom *2021-12-16* The data quality rulebook was extended by a data quality rule for UK: Deprecated identifier found (European value added tax identifier (United Kingdom)). It checks any given value for a business- or tax identifier in UK whether it is a European Value Added Tax Identifier which is now superseded by a new UK VAT number since Brexit. The rule is currently available in HYPERCARE status and can be tested. ### Augmented records in the business partner lookup extended *2021-12-15* While in the past augmented records (simplified: Golden Record) were only provisioned when there was a reference match in a primary data source, the logic allows now also for just matches in secondary sources (so called preferred data sources) for a country. Additionally, premium data from commercial providers such as D&B can be considered in the augmentation process as well now! ### CDQ POOL and CX POOL workspaces highlighted with a special label *2021-12-14* In the global setting next to the workspace name we added a special label informed, that this workspace is a sharing workspace of the CDQ or CatenaX Pool. This feature helps to find the most important workspaces and make it easier to gather data for analytical purpose ### Similarity and matching scores for more efficient enrichment reviews *2021-12-14* Name, legal address and business identifier enrichments performed by our data curation API now come with additional quality measures. The measures allow for a more efficient and improved judgement on the correctness or trustfulness of enrichments. In detail, the API and the regular Legal Entity Curation Report provide the following information: - Name similarity (in case there are names enriched from external sources) - Address similarity (in case there is a address enriched from external sources) The higher the similarity, the less differences are identified between the input data and the enriched data. A similarity score of >0.9 usually indicates a very high similarity. - For each enriched identifier three matching scores are provided. Enriching identifiers is the first step of data curation and all other enriched data is based on the available identifiers after this step. The enrichment is usually performed in a fuzzy mode. - Overall score considering business partner attributes and address - Business partner score which does not take address attributes into consideration - Address score which does only take address attributes into consideration ### Bank Data Lookup App Beta version is available *2021-12-13* Bank Data Lookup App allows searching for bank data in connected reference data sources. This feature is visible for users with the specific role added. Open Bank Data Sources available now: - Austria - Luxemburg - Netherlands - Norway - Slovakia The list of other countries that will be added soon: - German - Belgium - Switzerland - Cyprus - Czechia - Greece - Ireland - Lithuania - Malta - Poland On special request we can provide connection with Accuity data. **How to use the Bank Data Lookup App?** 1. Go to the [Bank Data Lookup APP](https://apps.cdq.com/dashboard/bank-data-lookup) 2. The required fields in search form: Bank Name AND Country AND City, OR SWIFT/BIC code 3. After adding all neccessary fields and clicking "Lookup Button" in Search Results section we can find all matched Bank Data. 4. Click in adequate match to go to "Bank Data Lookup Details" and check the results. The required fields in search form: Bank Name OR Country AND National Identifier OR SWIFT/BIC code ### Business Partner Lookup without country name now possible *2021-12-09* Until now, providing a name of the country was required to search for a business partner in the BP Lookup service and application. Now this is no longer mandatory. It is possible to search for business partners by entering only the name. In this case, results from countries where the name of the organization was found will be returned. ## November 2021 ### SAP outbound mapping is available! *2021-11-30* Thanks to this new feature our users can receive business partner records from our services not only in the CDQ data model but also in different, selected standards. The data are returned in the "key: value" format. In the first iteration, we provided possible to get data in the SAP format. To check details about SAP mapping please check the wiki page (mapping section): CDQ POOL This feature is available for the [Lookup Business Partner](https://www.apimatic.io/apidocs/referencedata/v/3_0#/rest/api-endpoints/business-partners/lookup-business-partners) and [Fetch Business Partner](https://www.apimatic.io/apidocs/referencedata/v/3_0#/rest/api-endpoints/business-partners/fetch-business-partner) API. To use it, it’s necessary to provide the name of the outbound mapping in the API call. In the future, there will be possible to add a custom outbound mapping and receive business partner data chosen by the customer data model. ### Filters and pagination for fetching relations was added. *2021-11-22* From now on relations can be filtered by: - relationship type - relationship class - relation end/start date ### Improvement of the CDQ cloud apps user experience *2021-11-19* Except for big features delivered by CDQ, there are many small improvements added on a daily basis to increase the satisfaction of using our services. - One of the most important topics last week was removing of automatic redirection of users to the unauthorized page from Cloud APPs. This unexpected behavior was very random, but we identified the problems and fixed them. - For customers using for example address versions we are happy to inform that from now on mappings containing „*value mappings*” can be added also via the APPs (see e.g. the Customizable Inbound Mappings and Transformations feature). Previously this option was possible only by using the API. - Another improvement provided in the last few days is the possibility to add more than 5 identifiers to a single business partner. Companies usually have fewer registration/tax numbers, but for this rare situation, this upgrade will solve the problem of mapping all needed data. ### Catena-X sharing pool launched! *2021-11-18* We are happy to announce that the Catena-X sharing pool MVP is launched on the CDQ platform. Catena-X is using an analog approach for sharing data as we have it already for our regular members. In a first step the pool was filled with the initial scope of data and some basic pool monitoring features have been implemented. Furthermore, Catena-X members are able to search the pool with their own established identifier named BPN. Catena X is the automotive network of companies like BMW, Daimler or Schaeffler created for increasing the automotive industry’s competitiveness, improving efficiency through industry-specific cooperation, and accelerating company processes through standardization and access to information and data. ### Natural person name replacement in accordance with GDPR regulations. *2021-11-18* To ensure GDPR compliance for bank account holders we replace natural person name in the bank account data with "Natural Person". ### Geographic coordinates provenance available in Golden Record *2021-11-10* Few months ago we introduced the provenances of enrichment in Golden Record - see https://meta.cdq.com/Release_note/20210818 Initial version contained information about provenances of: names, identifiers, legal forms, addressess, status and categories. From now on also provenance of geographic coordinates are available in Golden Record. ## October 2021 ### Performance increase when importing large data volumes to the CDQ Cloud Platform *2021-10-28* We have migrated the storage import jobs for all users to an improved implementation after having accomplished the testing phase. When importing large numbers of records (e.g. several hundreds of thousand or millions) a significant performance improvement can be observed. For selected clients the import was measured to perform a full update on a data mirror almost 20 times faster (4-6h to now only 15 minutes). ### Revised worldwide qualification rolled out with new profiles and features based approach *2021-10-27* We have rolled out the qualification approach to all EU VATs and selected additional identifiers such as for SIRETs, CNPJs or CH UIDs. Moreover, we have introduced new profiles and profiles management into the Data Quality Engine. We have enabled configurations for data validation jobs in order to make use of the predefined profiles that reflect particular use cases. As a result, users can avoid wasting time in configuring validation requirements. We have changed and extended the set of profiles as well as introduced the new set of dedicated features. Additionally, we have adapted existing qualification reports to the new profiles and features based approach by extending the qualification response model. Moreover, we unified statuses of data validation jobs in order to be more precise when providing validation results. With this a major change is introduced: From now on, a user will have to create a validation configuration first in order to use the Batch Data Validation app. Configurations can be generated using the Data Validation Configurator app. Useful details about the Data Validation Configurator application as well as about validation profiles can be found in the app itself. Performing qualified checks is now data quality rule based. For each concept that we are checking (name, locality, street and post code) a distinct rule for a given identifier is executed. For some identifiers a qualified check could be performed against multiple data sources. In such cases for each data source distinct rules are available. See for example the standard profile for data quality rules that check EU VAT identifiers against VIES. ### BP Lookup response extended with a new attribute "goldenRecordUse" *2021-10-20* New attribute has been added to Business Partner Lookup service (https://www.apimatic.io/apidocs/referencedata/v/3_0#/rest/api-endpoints/business-partners/lookup-business-partners): **"goldenRecordUse"** informs which records were used when creating a Golden Record. The new information can have either: - **"PRIMARY"** (for the base record according to the primary data source) - **"ENRICHMENT"** values for matches which contribute at least one attribute to the Golden Record. This feature is only relevant if a Golden Record is created, i.e. if feature SHOW_GOLDENRECORD_STANDARD or SHOW_GOLDENRECORD_QUICK is activated and can help grouping matches which are used for the Golden Record creation. ## September 2021 ### DNB records can be now downloaded as JSON files *2021-09-13* A new functionality in Business Partner Lookup app allows to download a single DNB record and save it to JSON file. The file contains Company Profile, Linkage, and Executives data (cmpelk v2). ## August 2021 ### Lookup requests and batch overlap check jobs are now configurable *2021-08-31* A new app has been just introduced into our portfolio. The Business Partner Lookup Configurator application allows the user to create custom lookup configurations, which can be used when sending single business partner lookup request or running a batch overlap check job. Once the configuration is saved, it can be used via API as well as in Batch Overlap Check web application. Moreover, business partner lookup configuration, similarily to data validation and data curation configurations, can be selected in the API Key Management App and assigned to an API key. ### Edition of the fraud case available in the APPs *2021-08-27* This is another improvement in the Fraud APPs area. Since today all cases added by your organization could be modify using APP. There are possible to change all added and empty fields. Additionally, there is an option to send alerts to the community, if you didn't do that during the creation of the fraud case. Remember that the community alert is possible only once per case. **How to edit the fraud case?** 1. Go to the [Fraud Case Browser APP](https://apps.cdq.com/dashboard/fraud/fraud-case-browser) 2. Choose the "My Organization Fraud Cases" checkbox and click search 3. Select specific fraud case 4. Scroll down and click on the "edit" button, next to the "Fraud Case Details" 5. Add your changes and click on the "save" button ### Provenance of enrichment in Golden Records now available *2021-08-18* In order to make the Golden Record enrichment more transparent, we added the provenance of business partner attributes, like: - names, - identifiers, - addresses, - legal form, - status, - categories. These information are available by hovering a mouse cursor over the (i) icon next to a corresponding value and contain a source of the data and the identifier of the CDQ record. ### Bank Account Whitelist Upload APP available *2021-08-17* Whitelist upload app allows sharing with the community of your bank accounts data. Information about the number of payments, last transaction date, IBAN, and so on are using in the calculation of the trust score and help to avoid the risk of fraud. This feature is available only by the app and visible for users with the Whitelist Manager role. **How to use the Whitelist upload app?** Upload file with special headers and wait until the job is finished. Files with incorrect records are rejected. It's possible to select the failed job to see detailed information about affected records and the type of bugs. For detailed information check instructions described in the Whitelist Upload App or use the in-app tutorial. ### Error handling in case of corrupted input data *2021-08-13* Recently we observed cases where data was imported (or at least tried to import) to a storage or data mirror but the input file contained corrupted lines. Records were not properly escaped which lead the system to the decision to cancel the import. The data import was now extended with the capability of identifying corrupted lines and skipping such records. The import itself will no longer fail but report the skipped rows after having finished the import. ### New In-App tutorials *2021-08-12* New app-tours allow for understanding the basic functionalities and required inputs of the following apps: - [Batch Business Partner Curation](https://apps.cdq.com/dashboard/data-curation/batch) - [Batch Address Curation](https://apps.cdq.com/dashboard/data-curation/address/batch) - [Single Business Partner Curation](https://apps.cdq.com/dashboard/data-curation/single-business-partner) - [Single Address Curation](https://apps.cdq.com/dashboard/data-curation/single-address) - [Single Sanction & Watchlist](https://apps.cdq.com/dashboard/single-sanction-watchlist) - [Batch Sanction & Watchlist](https://apps.cdq.com/dashboard/batch-sanction-watchlist) - [Bank Trust Score Check](https://apps.cdq.com/dashboard/fraud/bank-trust-score-check) - [Batch Bank Trust Score Check](https://apps.cdq.com/dashboard/batch-bank-trust-score-check) - [Whitelist Upload](https://apps.cdq.com/dashboard/fraud/whitelist-upload) - [Data Curation Configurator](https://apps.cdq.com/dashboard/data-curation-configurator) - [Report Fraud](https://apps.cdq.com/dashboard/fraud/report-fraud) - [Fraud Case Browser](https://apps.cdq.com/dashboard/fraud/fraud-case-browser) - [Natural Person Screening](https://apps.cdq.com/dashboard/natural-person-screening) ### Tax Identifiers in Brazil: Inscrição Estadual now in CDQ scope *2021-08-09* On individual state level in Brazil the Inscrição Estadual is assigned to companies. From a data quality perspective this bears some complexity as the identifier's format and checkdigit is defined differently per jurisdiction. Our data quality services now allow for checking the checkdigit of the state tax number for 27 jurisdictions in Brazil. See the full list below. ### Address Version *2021-08-02* Address version is available in our data model. An address version is a unique combination of: - Language - CDQ supports multiple language versions of addresses. Check our data model – Address language - Character set - CDQ supports multiple character sets for representing addresses. Check available character sets in our model – Address character set Address version is available using API via the import job: https://www.apimatic.io/apidocs/data-exchange/v/4_0#/rest/api-endpoints/data-import/start-import-job File import is not supported yet. **How to map address version?** Uploading many versions of the address required adding valueMaping. Check example1 and example2 of the Customizable Inbound Mappings and Transformations mapping. ## July 2021 ### Additional data quality rules available for testing *2021-07-23* The data quality rulebook was extended by a number of data quality rules. The rules are currently available in HYPERCARE status and can be tested. **Identification of old post code formats** - Deprecated post code format identified (Argentina) - Deprecated post code format identified (Portugal) **Checkdigit checks for business identifiers** - Identifier checkdigit invalid (National business register identifier (Austria)) - Identifier checkdigit invalid (NIF number (Portugal)) - Identifier checkdigit invalid (RUC number (Ecuador)) - Invalid checksum of EU VAT ID IE (Ireland) - Invalid checksum of FR SIRET (France) - Invalid checksum of Numero de Identificacion de Extranjero (Spain) **Format checks for identifiers** - Identifier format invalid (CPJ number (Costa Rica)) ### Business Partner Lookup enriched by a new data source from the USA *2021-07-23* Our BP Lookup service has been connected to a new data source - Internal Revenue Service, which offers data of over 1,7 million of organizations from the United States of America. ### In-App tutorials *2021-07-23* In-App tutorials have been introduced for currently two apps. Tutorials for all other apps will follow soon. These so called app-tours allow for understanding the basic functionalities and required inputs of the CDQ Cloud Apps. ### Business Partner Lookup: Configurable search result limitation *2021-07-21* The business partner lookup allows now to configure the maximum number of returned results. The former hard limit of 10 results is now the default value. The result size can be extended or limited from 1 up to 100 results. ### Data Sharing Quality Gate: New Data Quality Rules *2021-07-20* For ensuring a high data quality in the CDQ Community Data Pool a strong Data Sharing Quality Gate is required. The standard data quality ruleset was extended by the following rules: **Brazil** - Identifier missing (CNPJ number (Brazil)) **Canada** - Identifier missing (Corporation number (Canada)) - Identifier unknown (Corporation number (Canada)) **China** - Identifier missing (Business Registration Number (China)) **Singapore** - Identifier missing (UEN number (Singapore)) - Identifier unknown (UEN number (Singapore)) **Argentina** - Identifier missing (CUIT number (Argentina)) **Denmark** - Identifier missing (CVR number (Denmark)) - Identifier unknown (CVR number (Denmark)) - Identifier checkdigit invalid (CVR number (Denmark)) **Czech Republic** - Identifier missing (ICO number (Czech Republic)) - Identifier unknown (ICO number (Czech Republic)) ### Data quality rule checks for Polish business partners *2021-07-19* Data Sharing requires a strong Data Sharing Quality Gate. In the course of onboarding Poland for the data sharing process, the following changes or new rules have been introduced: - Identifier missing (NIP number (Poland)) added with criticality INFO. - Identifier missing (European value added tax identifier (Poland)). Criticality changed to INFO. - Mandatory identifier not maintained (Poland). Checks whether at least a NIP or a EU VAT Number is maintained. Criticality is ERROR. - Identifier missing (REGON (Poland)) added with criticality ERROR. This identifier is used for connecting client data with the CDQ Community Data Pool thus it is mandatory for making the sharing process working. This so called linkage strategy is defined in Collaborative Subscription Management for Poland. ### Upload of empty attributes in regular storages enabled *2021-07-19* Per default if during a storage upload any attribute is detected with no values, the attribute is not stored in the storage. The newly introduced feature “accept_empty_values”, does no longer delete attributes with no values but enforces the storage. The feature has been introduced in the storage management app as well as in the data mirror management app. ### Companies from Slovak Republic available in BP Lookup *2021-07-15* Yet another data source is connected to our Business Partner Lookup app. Over 270.000 companies from Slovakia registered as value added tax entities can be now searched in our service. ### Business Partner Lookup enriched by universities and colleges in USA *2021-07-13* There are nearly seven thousand Post Secondary Education facilities from United States available in our Business Partner Lookup service. The data are provided by Homeland Infrastructure Foundation-Level Data (HIFLD). ### Companies in Romania now available in the Business Partner Lookup *2021-07-09* Our data pool now connects to the The National Trade Register Office of Romania as an additional data source. Now companies from Romania can be searched using the business partner lookup and employed for enrichments. ## June 2021 ### Enable Jobs on Data Mirror *2021-06-25* Enablement to start jobs on the data mirror. In cloud apps we enabled to start jobs on the data mirror in following applications: - Batch Overlap Check - Batch Business Partner Curation - Batch Address Curation - Batch Data Validation - Duplicate Matching - Linkage Matching - Batch Sanction & Watchlist - Natural Person Screening The data mirror is accessible in the corresponding applications via the new tab on top called “Data Mirror”. All jobs started for the data mirror are shared and accessible per default for all other workspace members. We are working on, to also allow so called “private” jobs on the data mirror. Within the workspace, only one job can be started at once per job type. If e.g. another workspace member is already running a job on the mirror for a specific type, it is required to wait until the job is done. ### Enrichment of the county ISO codes (GB) *2021-06-15* ISO code enrichment is now available for counties of Great Britain. CDQ curation service provides codes for counties of each region: England, Scotland, Wales, and Northern Ireland. Codes are turned back in the following format: XXX, for example, Antrim and Newtownabbey (ANN). ### Duplicate Matching Configuration App *2021-06-14* In order to make editing the duplicate matching configuration easier and more user-friendly, the Duplicate Matching Configuration application was introduced. From now on the customer can upload existing configuration (xml) file or pick one already created before and modify all parameters, like: - main threshold - low/high values for all matching attributes - comparators and cleaners to be used during matching job - report headers definitions - Word Frequency and Replace Cleaners definitions Additionally, to make the editor even more usable, it is possible to select a storage file and pick the interesting attributes directly from it. While modifying the parameters the "live preview" on generated XML is visible on the right-hand side of a page. For those, who still want to edit the configuration directly in XML editor, there is still such option. ## May 2021 ### Fraud Case Browser APP *2021-05-28* The Fraud APPs section was extended by the Fraud Case Browser. The new feature allows reading all fraud cases provided by the community members. There are possibilities to filter cases by the date, type, and user's organization. Cases with disclosed attributes are divided in the details view by five main sections: - General information - like date, description or type, - Business Partner Details - name, locality, country, etc., - Bank Account Details - IBAN or other bank data, - Creator details - user, organization, time, - Disclosed Attributes - list of attributes disclosed for the community. ### Browsing uploaded and mapped data *2021-05-25* The Storage Manager App was extended by a browsing functionality. It is now possible to browse the uploaded data, and check in detail how an input record was mapped to the CDQ data model. With this feature it is transparent whether an upload was mapped and transformed as expected or if there were issues with the mapping or upload of the data. ### Matching configuration snapshot added to the duplicate analysis reports *2021-05-04* While experimenting with various matching configuration settings it is useful to have the matching configuration dumped to the report header. The configuration is now available in the metadata tab of the matching and consolidation reports. In future releases it will be presented not just as a configuration dump but per attribute (which comparators, cleaners and similarity scores are applied). ## April 2021 ### Extended tax and business identifier checks *2021-04-22* The identifier data quality checks have been extended by additional data quality rules. We now enable checking the format of D&B's DUNS, the existence of the Norwegian Organisation Number and the Canadian Corporation Number ### Creating data mirrors - self service for new workspaces enabled *2021-04-21* The Global Settings app does now not only allow for creating workspaces, but also to directly create a data mirror for the new workspace. During workspace setup the data mirror can be created and a name assigned to it. Additionally it is possible to activate a weekly summary mail on monitoring jobs that run on this mirror. ### Storage Manager allows the generation of data dumps *2021-04-19* The Data Storage Manager app now allows for downloading storages. ### Lookup by global identifiers such as DUNS and the Legal Entity Identifier (LEI) *2021-04-16* The Single Business Partner Lookup app now allows for just searching with country and global identifiers such as the DUNS and the Legal Entity Identifier (LEI). This removes the restriction on being able to just make use of local identifiers (e.g. domestic company registration numbers) in the context of the App. ### Batch lookup of bank account trust scores *2021-04-15* Enables a batch bank account lookup in the CDQ Community Bank Data Pool and the retrieval of the bank account's trust score. The results are provided in form of an excel report. The lookup result contains no information in case the respective bank account is not contained in the database. If the bank account is maintained then the result contains information about the bank account trust score, payment information, bank account details as well as the bank account owner information. ### FIPS codes for US counties *2021-04-14* FIPS codes are numbers which uniquely identify geographic areas in the United States. State-level FIPS codes have two digits, county-level FIPS codes have five digits of which the first two are the FIPS code of the state to which the county belongs. The CDQ Address Cleansing Services now support the enrichment of FIPS codes on region and county level. One typcial use case for getting to know the FIPS code of a business partner's location is the identification of tax jurisdictions, respectively the corresponding tax rates that are applied. ## March 2021 ### Broader coverage of businesses in New Zealand *2021-03-30* Our data pool now connects to the NZBN register of New Zealand as an additional data source. The NZBN Register contains information about New Zealand businesses, including all companies and other entity types from Companies Office registers, all public sector entities, and sole traders. ### Connection to the UK VAT Lookup established *2021-03-30* Since Brexit validation of GB VAT IDs is no longer possible via the European Commission's VIES services. The United Kingdom has established its own service for validating GB VAT IDs. Our data pool now connects to this service as an additional data source. This will allow for considering this service for VAT validation and for showing additional matches with the business partner lookup. ### Business Partner Update Monitoring now live with 21 data sources *2021-03-26* Customer and vendor data quality decreases, even if the data is not touched, e.g. due to address changed, M&A, or insolvencies. Keeping the data up-to-date manually is complex and high effort on a global scale. CDQ manages a number of update monitoring data sources. These data sources can be activated and then allow for monitoring any changes proactively. For doing so for records in a data mirror, linkage strategies are defined that uniquely link a record with the reference record in an update data source. Usually these links are established by unique identifiers. Update monitoring was established earlier this year. The number of data sources that can be activated has now increased. A full list of supported data sources can be found in the Business Partner Update Monitoring feature ### New US data sources: Businesses in the county of San Francisco and Los Angeles *2021-03-26* Two new public data source have been connected to the CDQ Cloud Services. One data source comprises the locations of businesses that pay taxes to the City and County of San Francisco. The second data source is a listing of all active businesses currently registered with the Office of Finance of the city of Los Angeles. ### Beta Version: Global Settings App and initial Quota Management available *2021-03-23* The Global Settings App enables managing organization-wide configurations such as creating, deleting or modifying workspaces and viewing & managing quotas for data sources. In the initial version the available and used quotas for address cleansing data sources: HERE and GMAPS are shown. ### Business Partner Lookup connects to the European Medicines Agency *2021-03-22* The European Medicines Agency (EMA) has launched the Organisation Management Service (OMS) to support regulatory activities throughout the European Union (EU). The CDQ business partner lookup does now enable access to the organizations and corresponding locations managed in SPOR OMS. ### Danish Company Registrations now available with the Business Partner Lookup *2021-03-12* A new public data source has been connected to the CDQ Cloud Services: The official database of Danish businesses. The CVR contains detailed information on all Danish limited companies. ### New records in the Business Partner Lookup: Companies in Norway *2021-03-12* The Norwegian authorities provide a database that contains information about different kinds of corporations which have been registered in Norway.This data source has been connected to the CDQ Cloud Services and is now available in the business partner lookup ### Open data from the Latvian Business Register connected *2021-03-10* A new public data source has been connected to the CDQ Cloud Services. The Register of Enterprises of the Republic of Latvia is a Latvian public body which registers companies, traders, their branches and representative offices. ### New app: "Natural Person Screening" *2021-03-05* The Natural Person Screening App allows to generate a report to identify classifications which includes natural personas. Under the classification we understand process of business partners classification in the natural person class and the other classes like legal entity. The classification is based on neural network algorithm. The report displays only those business partners which were classified either as company, natural person, or registered individual. Description App: https://meta.cdq.com/App/Natural_Person_Screening Description Report: https://meta.cdq.com/Report/Natural_Person_Screening_Report ### New feature: Address Curation reports are displaying CEDEX postal code and locality for French data *2021-03-03* Newly the address curation report is capable to provide the CEDEX postal code and CEDEX locality values being curated by our service and store them with remaining address concepts in the report. ## February 2021 ### New feature: Matching Candidate Review via Web Application enabled *2021-02-26* The decision log app enables to store decisions of report reviews for dedicated services into a storage. Currently this functionality is available for the matching service. (Duplicate & Linkage). One of the main goals to run a report, is to get information about data defects and to adjust then the corresponding information in the source system. Via services like duplicate matching, data profiling, data curation, data defect are detected and proposed with suggestions to improve it. All kind of services will never guarantee a 100% correctness. E.g., the duplicate identification, which is mainly based on fuzzy search, will always show some false-positive and false-negative values. The report, which is the basis for the review, contains now a field to mark such information. The reviewed report can then be uploaded in the decision-log app and is then ready to use in the next run, so that the reviews are respected. Please check out our use case description here: https://meta.cdq.com/Use_case/Iterative_Duplicate_Check ### Minor metadata change in the duplicate and consolidation reports *2021-02-19* The coversheet of the duplicate and consolidation reports has been extended with metadata about the matching configuration id that was used for creating the results. This allows for tracing the origin of results. ### Open data from the Czech Register of Economic Entities connected *2021-02-19* A new public data source has been connected to the CDQ Cloud Services. The Czech Register of Economic Entities can be now searched using the business partner lookup and employed for enrichments. There are more than 1 Mio records available. ### Significant Improvements on the Lookup Throughput *2021-02-17* Upgrades and optimizations on our underlying indexing infrastructure allow us now for a much higher performance of our Business Partner Lookup. In batch mode >80 requests per second can now be handled easily. For any other CDQ Cloud Services that rely on connected data sources this will lead to much faster results (e.g. identifier or legal address enrichment). Please note that for data sources to which we connect directly via web interfaces such as VIES we are limited by the response times of the corresponding services. The improvements just have an impact on data sources which we manage in our own infrastructure. ### Changes on the Duplicate and Linkage Matching App *2021-02-16* The Duplicate and Linkage Matching App have been revised to follow the same design like e.g. the Batch Data Validation App (see https://meta.cdq.com/Release_note/20210128). These two apps are now structured by Storage Selection, Job Selection and Report Selection. Jobs can now be also started only for specific countries. In this context new duplicate and record linkage reports have been introduced. They follow the identical structures of the legacy reports but will allow for faster change management in the future. Moreover, the reports come along with charts and figures for gaining a quick overview on the results. The reports are also designed and prepared for upcoming releases on considering matching group reviews in subsequent duplicate identification jobs. Additionally, these reports can now be generated by users directly via our matching API: https://www.apimatic.io/apidocs/data-matching/v/2_0#/rest/api-endpoints/analytics/build-matching-reports ### Selected fixes and improvements on Data Quality Rules *2021-02-12* We improved some of our Data Quality Rules that were providing ambiguous results. The checkdigit check for the Indian GST Number was returning wrong results in seldom cases (https://meta.cdq.com/Identifier_checkdigit_invalid_(GST_number_(India))). The implementation of the underlying algorithm was fixed. Additionally, data quality rules that check if PO Box and care of information is misplaced in e.g. the business partner's name now make use of our Regular Expression Library (https://meta.cdq.com/PO_Box_information_misplaced_(Name_LOCAL)). In this context some fuzzy parsing cases were improved (e.g. BOX as part of a correct business partner name). ### Open data from the Estonian Commercial Register connected *2021-02-11* A new public data source has been connected to the CDQ Cloud Services. The Estonian Commercial Register can be now searched using the business partner lookup and employed for enrichments. There are more than 300'000 Estonian company entries available. ### Dedicated Natural Person Screening Report *2021-02-09* A new standard report for natural person screening was introduced. It returns the categorization of given records as legal entity, natural persons or registered individuals. The report is currently only available via our Data Curation API and can be additionally requested via the CDQ Service Desk. The report displays only those business partners which were classified either as company, or natural person, or registered individual. In a second release there will be soon a new CDQ Cloud App for Natural Person Screening which allows then to generate this report. Additionally the report will be extended by a probability that measures the confidence in the categorization proposal. ### Administrative area type recognition *2021-02-07* Our Data Curation API was extended to return the type of administrative areas according to the harmonized CDQ data model. So for administrative areas on region level the type region (e.g. Rhineland Palatinate, or Bavaria in Germany) and correspondingly on county level the type county is returned (e.g. San Francisco County). ### Mass check against sanction lists now available via CDQ Cloud Apps *2021-02-04* The brand new batch sanction and watchlist lookup app provides eligible users with the capability of checking batches of records against sanction lists (such as OFAC lists). For a data storage the job can be started and as a result a sanction and watchlist report is generated for analyzing candidate matches in detail. Please note that the lookup and monitoring of sanction and watchlists needs dedicated activation and is limited by quotas! Access to the app has to be explicitly granted by your Customer Success Manager by assigning the user management role "Sanction List App User". ### Improved representation of legal hierarchy data *2021-02-03* In the business partner lookup app, D&B hierarchy output has been adjusted and is now shown completely (immediate parent, domestic ultimate, global ultimate). Furthermore, the total hierarchy count, the hierarchy level, and the entity type of the requested business partner are presented. In future releases it is planned to show additional D&B data (cmpelk) which is not considered yet in a structured way. ### Major milestone: Activation of update monitoring in CDQ Cloud Apps *2021-02-01* In the course of enabling a highly configurable monitoring of business partner updates, a major milestone was reached with this release. A new app (Update Monitoring Configurator) has been added to the CDQ Cloud Apps. It allows activating update monitoring for a selected data mirror, and its data sources. The connected data sources in the CDQ Data Pool that allow for update monitoring can be activated individually. An activation leads to an initial linkage of the records with the reference business partner records in the connected data sources. This takes up to 24 hours. After this initial activation, updates made in the connected data source are continuously monitored and made available. Currently a retrieval of updates is only possible via CDQ's Data Exchange API. A second release will offer the option for generating filterable update reports via the CDQ Cloud Apps. We'll inform as soon as we've reached the next milestone! ## January 2021 ### Country filtering for cloud apps introduced *2021-01-28* With this update several improvements on the cloud apps were introduced. The main feature extension is the possibility to limit job runs to only selected countries of records in a storage! In this context the following apps have been adapted and are represented in three panes: Batch Business Partner Curation, Batch Address Curation, Batch Lookup and Batch Validation App. They are structured by Storage Selection, Job Selection and Report Selection. This facilitates the generation of multiple reports for a job result. By selecting a storage only the jobs applied for this storage are shown. Additionally, the presentation of reports and dashboards in the validation app has been improved! ### Reference data retrieval for VAT qualification results via the German Bundeszentralamt für Steuern *2021-01-27* Legal aspects require a qualified check of European value added tax identifiers (EU VATs). The qualified check of EU VAT registration information takes as input the VAT number of a foreign company, the company location, postal code, street and company name and compares whether the information provided corresponds to the registered data in the VAT registration of the respective EU member state. The Bundeszentralamt für Steuern provides a service for German legal entities for checking the VAT for non-domestic (i.e. non-German) business partners. However it does not provide any address or name data when qualifying a EU VAT. There is just information about the validity of the given address and name compared to the reference data. The comparison is performed in a black box. Thus, in case there is some inconsistency identified now the registered data from the respective EU member state is searched via the VIES. The registration data (name, and address attributes) is then returned by the EU Qualification Report and via the CDQ Validation API. ### Revision of User Management Roles *2021-01-18* This release enables the basic self-service workflow for CDQ independent user management. In the global user management for the CDQ cloud services of an organization different roles can be assigned. The assignable roles have been revised and thereby especially the bureaucrat role was introduced. The bureaucrat role can be assigned for granting access to the user management itself. A bureaucrat can create/modify/delete users for the organization, he can assign any roles to an user and he can assign the the bureaucrat role to other users of the organization as well. ### Initial release of the Global Settings App *2021-01-16* A very early version of the Global Settings App has been made available. Over the upcoming weeks the app will allow for managing workspaces and organization-wide settings. In its first alpha version the app allows for requesting additional quota for our address data providers (i.e. Google Maps) ### Harmonization and ISO code enrichment for regions introduced *2021-01-14* Based on reference data maintained in the CDQ Community Metadata Repository administrative areas of type region are now harmonized and can be enriched in multiple language versions and their corresponding ISO 3166 region codes. The enrichment is activated by default in the address cleansing app and can be explicitly selected/configured on API level with the feature ENRICH_ADMINISTRATIVE_AREA_ISO ### Rules Engine Profiles can be selected in the data quality profiling app *2021-01-13* App users can now select between three profiles in the validation app. The standard profile does execute all CDQ Data Quality Rules. The qualification profile extends the standard profile with qualified checks of identifiers (check if given address and name data is fitting to reference data available for an identifier such as EU VATs). The quick profile allows for a quick validation by excluding data quality rules that are dependent on external data sources. ### Default configuration for record linkage *2021-01-08* App users can now download a default configuration file for record linkage. It can be directly used for creating own configs in a faster and less error prone way. The default config can be found in the record linkage app as part of the configuration management. ### Lookup App allows for searching with German business register id *2021-01-07* The business partner lookup app allows for searching by German business register id (German: Handelsregisternummer). The lookup form was extended with the issuing body of an id, e.g. "Amtsgericht Freiburg". This ensures unique results for a given business register id. ### Domain change of the CDQ Cloud Apps *2021-01-02* CDQ Cloud Apps are now available at https://apps.cdq.com. Please update your bookmarks! The old domain https://apps.cdq.ch is still active and redirects to the new address.