How to Handle Duplicate Records in Bold BI

Published:

In Bold BI, handling duplicate records is a common task that users may encounter. This is especially true when working with JSON data, which is flattened into a table format to be stored in a SQL database. When JSON data contains multiple arrays, multiplication logic is used to combine the array values, which can produce duplicate records.

Working with Multiple Tables

If you’re working with multiple tables, you’ll need to join these tables and save them in order to use them in widget configurations. To perform table joins, you should have a common field across all the tables. However, even if you import your data as separate tables, you may still encounter duplicate records when joining. To avoid this, you can create separate data sources by selecting only the specific array item in each data source to configure the widgets.

Using Filter Options

To further refine your data and avoid displaying duplicate or invalid data, you can use the filter options available at the widget configuration level. By selecting a unique value from other arrays, you can filter the data so that the dashboard displays the correct values. Even if you’re using a single data source with duplicate records, adding a filter in each widget configuration can help avoid showing invalid data.

Steps to Apply Filters to Widgets

Open the widget configuration panel.
Navigate to the ‘Filters’ section.
In the Filter pop-up window, choose the ‘Rank’ option and then select the mode. From the Column drop-down, choose the required measure field and save it.

By following these steps, you can effectively manage and display your data in Bold BI without worrying about duplicate or invalid records.