Data Cleansing Dashboard

Top ↑

There are two types of dashboard that each corresponds to a type of data cleansing or exception management (XM) process (i.e. market data or valuation data XM).

On this page, we will discuss:

Market Data XM Dashboard Description

We will discuss the various steps related to a market data XM dashboard:

  1. Dashboard creation
  2. Dynamic progress monitoring overview
  3. Break clearing phase description

1. Market Data XM Dashboard Creation

For the purpose of this example, you have first uploaded imported modified market data to the NEW Market Data GROUP to trigger a break during the data cleansing workflow. The .CSV import file with these modified data can be downloaded here. You will need to choose the option to replace duplicate data to override the existing market data.

Under Data Cleansing/Market Data/Dashboards, to create a market data XM dashboard:

  • Click on Add New (or view an exiting one by double-clicking on the line item)
  • Select the “Market Data” dashboard type
  • Input the relevant parameters (e.g. market data group and curve date)
  • Click on CREATE
Creating a MD XM dashboard
Data Cleansing/Market Data/Dashboards
Alt for image
After clicking Add New and selecting 'Market Data'
Data Cleansing/Market Data/Dashboards
Alt for image

A description of a dashboard’s attributes and corresponding permissible values are set out in the table below.

Field Name Description Permissible Values
Market Data Group The market data group that contains the raw market data Any existing market data group
TRS Market Data Group The TRS market data group that contains the raw index market data Any existing TRS market data group
Curve Date The curve date (set by default to the system date) YYYY-MM-DD (ISO 8601)

You can then start the data cleansing workflow, by clicking on Run.

After clicking on CREATE
Data Cleansing/Market Data/Dashboards
Alt for image

The status of a dashboard will go from ‘NOT_STARTED’ (after clicking on CREATE) to “IN_PROGRESS” (after clicking on Run) to “COMPLETED” (once all break clearing tasks are completed).

2. Dynamic Progress Monitoring Overview

The five phases of the data cleansing workflow related to market data are as follows:

  1. Market Data Upload
  2. Preliminary – break test calculation
  3. Preliminary - Break Clearing
  4. Overlay – break test calculation
  5. Overlay - Break Clearing

At the dashboard level, you can monitor the progress of the data cleansing workflow thought the evolution of each phase’s status that will go from ‘NOT_STARTED’ to “COMPLETED”, with an intermediary colour-coded status bar for the clearing phases.

Dashboard - XM progress monitoring
Data Cleansing/Market Data/Dashboards
Alt for image

Once all breaks have been resolved and approved, you can see the XM results for market data at the dashboard level.

Dashboard - XM Completed
Data Cleansing/Market Data/Dashboards
Alt for image

As you have first uploaded imported modified market data to the NEW Market Data GROUP to trigger a break during the data cleansing workflow, you can now either restore the original market data (as described below) or perform curve calibration and portfolio valuation using the Overlay data. The data needed to restore the original ones can be downloaded here. You will need to choose the option to replace duplicate data to override the existing modified market data.

3. Break Clearing Phase Description

A break clearing phase will be split into clearing tasks according to the task granularity settings per asset class.

When expanded, the information related to a clearing phase will set out the status of each underlying task.

If there are some breaks to be cleared (see clearing process), the task completion status and the colour (in bracket below) of the corresponding portion in the overall clearing phase status bar will evolve as follows:

  1. PENDING_RESOLUTION (grey)
  2. IN_RESOLUTION (royal blue)
  3. PENDING_APPROVAL (dark blue)
  4. IN_APPROVAL (turquoise)
  5. APPROVED (green)

Otherwise, if there is no break, the task’s status will automatically be set to ‘APPROVED’.

Valuation Data XM Dashboard Description

We will discuss the various steps related to a valuation data XM dashboard:

  1. Dashboard creation
  2. Dynamic progress monitoring overview
  3. Break clearing phase description

1. Valuation Data XM Dashboard Creation

Under Data Cleansing/Valuation Data/Dashboards, to create a valuation data XM dashboard:

  • Click on Add New (or view an exiting one by double-clicking on the line item)
  • Select the “Valuation Data” dashboard type
  • Input the relevant parameters (e.g. pricing slot and valuation date)
  • Click on CREATE
Creating a VD XM dashboard
Data Cleansing/Valuation Data/Dashboards
Alt for image
After clicking Add New and selecting 'Valuation Data'
Data Cleansing/Valuation Data/Dashboards
Alt for image

A description of a dashboard’s attributes and corresponding permissible values are set out in the table below.

Field Name Description Permissible Values
Pricing Slots A list of in-scope pricing slots Any existing Pricing Slot
Portfolios A list of companies / entities / portfolios Any existing Company ID / Entity ID / Portfolio ID
Valuation Date The valuation date (set by default to the system date) YYYY-MM-DD (ISO 8601)

You can then start the data cleansing workflow, by clicking on Run.

After clicking on CREATE
Data Cleansing/Valuation Data/Dashboards
Alt for image

The status of a dashboard will go from ‘NOT_STARTED’ (after clicking on CREATE) to “IN_PROGRESS” (after clicking on Run) to “COMPLETED” (once all break clearing tasks are completed).

2. Dynamic Progress Monitoring Overview

The six phases of the data cleansing workflow related to valuation data are as follows:

  1. Valuation Data Upload
  2. Valuation Calculations (applicable only if Xplain is one of the valuation data providers)
  3. break test calculation
  4. Break Clearing
  5. Overlay II break test calculation
  6. Overlay II Break Clearing

At the dashboard level, you can monitor the progress of the data cleansing workflow thought the evolution of each phase’s status that will go from ‘NOT_STARTED’ to “COMPLETED”, with an intermediary colour-coded status bar for the clearing phases.

Dashboard - XM progress monitoring
Data Cleansing/Valuation Data/Dashboards
Alt for image

As breaks are resolved and approved (partial submission), you can see the XM results for valuation data at the dashboard level. Cleared data (i.e. with status “VERIFIED”) will be released “as-you-go”, with the caveat that data that triggered a break will only be released once the overall task has been approved.

Dashboard - XM Completed
Data Cleansing/Valuation Data/Dashboards
Alt for image

3. Break Clearing Phase Description

A break clearing phase will be split into clearing tasks according to the task granularity settings per trade type.

When expanded, the information related to a clearing phase will set out the status of each underlying task.

If there are some breaks to be cleared (see clearing process), the task completion status and the colour (in bracket below) of the corresponding portion in the overall clearing phase status bar will evolve as follows:

  1. PENDING_RESOLUTION (grey)
  2. IN_RESOLUTION (royal blue)
  3. PENDING_APPROVAL (dark blue)
  4. IN_APPROVAL (turquoise)
  5. APPROVED (green)

Otherwise, if there is no break, the task’s status will automatically be set to ‘APPROVED’.

At the VD dashboard level, you will have the option to select and re-run a task (in its entirety or updated valuation data only).

Data Cleansing Results

Once cleared data are released, you will have the ability to:

  1. View the MD and VD XM results, where applicable
  2. Override manually the VD results
  3. View Xplain’s PV Calculation results, if Xplain is one of the valuation data providers
  4. Use MD XM results (e.g. preliminary or overlay data) as a market data source when calibrating curves or valuing a portfolio, where applicable.

Cleared data (i.e. with status “VERIFIED”) will be released “as-you-go”, with the caveat that data that triggered a break will only be released once the overall task has been approved.

Saved results will have to be archived if you want to re-rerun the data cleansing workflow on the same market data group / pricing slot or portfolio and for the same curve/ valuation date.

After saving a Valuation Data dashboard, XM VD results will also be accessible on a trade level in the trade valuation history screen (see Trade Valuation History).

1. Viewing Data Cleansing Results

Once a market data XM workflow is completed, you can access/export the results in the “Market Data Data Cleansing Results” window.

Viewing market data XM results
Data Cleansing/Market Data/Dashboards/'NEW Market Data GROUP' XM Dashboard
Alt for image

Through a valuation data XM workflow, as tasks get completed, you can access/export two types of valuation results by clicking on the relevant icon in the “PORTFOLIO Valuations” window:

  1. Valuation data XM results
  2. Xplain’s valuation results, for trades where Xplain is one of the valuation data providers
Viewing valuation data XM results
Data Cleansing/Valuation Data/Dashboards/NEWCOMP Dashboard/Portfolio Valuations
Alt for image
After clicking 'Data Cleansing - Valuation Results' icon
Valuations/Results
Alt for image

The VD data cleansing results will include a subset of each trade’s details, as well as the final valuation summary, as set out in the table below.

Field Name Description Permissible Values
PV (Calculation Currency) The final trade valuation following the VD XM workflow, expressed in the calculation currency Numeric
Calculation Currency The currency in which valuation data are expressed The Trade Currency or the Reporting Currency, as applicable
Valuation Data Provider Name The data provider associated to the data source of the final trade valuation An existing valuation data provider
Overlay Source The data source of the final trade valuation Primary (P1) | Secondary (P2) | Tertiary (P3) | Quaternary (P4) | Accounting cost | Deal cost | Manual | Multiple | Do not price

2. Overriding Valuation Data XM Results

At the end of a valuation data XM workflow, you can manually override a valuation data, subject to evidence being uploaded, as it will impact the final reported numbers.

For the purpose of this example, a dummy evidence file can be downloaded here.

After selecting the trade(s) whose valuation needs to be overriden
Valuations/Results
Alt for image
After clicking on OVERRIDE Valuation
Valuations/Results
Alt for image
After inputting the new value, writing a comment and uploading evidence, and
clicking on Apply OVERRIDE
Valuations/Results
Alt for image
After confirming by clicking on Apply OVERRIDE
Valuations/Results
Alt for image

3. Accessing Xplain PV Calculation Results

Where Xplain is one of the valuation data providers, you will be able to access the results of the valuations performed during the VD data cleansing workflow (Xplain PV calculation results), as described in PV Calculations - Run and Results.

Accessing Xplain PV calculation results
Data Cleansing/Valuation Data/Dashboards/Dashboard Results
Alt for image

4. Using MD Data Cleansing Results in Curve Calibrations

Once the data cleansing results from a MD or Combined Dashboard have been saved, you can choose to use the cleaned market data in a Curve Calibration, in both the PV Calculation Settings and Curve Calibration Parameters, by setting Market Data SOURCE to one of the four permissible values given in the table below.

Market Data Source Permissible Values

MARKET DATA SOURCE Description
Raw Primary Use raw data from the primary market data provider (default)
Raw Secondary Use raw data from the secondary market data provider
Preliminary Primary (*) Use preliminary data for the primary market data provider
Preliminary Secondary (*) Use preliminary data for the secondary market data provider
Overlay (*) Use overlay data

(*) This will fail if not all relevant preliminary (or overlay market data) is available.


Introduction to Xplain
Curves
Portfolios
Data
Valuations
Data Cleansing
Preferences
Admin
Importing and Versioning
XVA Module
TRS Module