Articles in this section
Category / Section

How to Use Regex to Fetch and Combine Tables from Elastic Search with Bold BI's Web API Data Connection

Published:

Integrating and visualizing data from Elastic Search in Bold BI dashboards can be accomplished by using regex patterns to fetch and combine tables, known as indices, via a Web API data connection. Here's a step-by-step guide on how to achieve this.


Steps to Integrate Elastic Search Indices into Bold BI

  1. Create new dashboard from Bold BI home page and click on Add Data Source icon and click on Create New option.           create-new-datasource.png
  2. Select Web API Data Connector from the data source listing page.      choose-web-api-datasource.png
  3. Provide a name for your data source and add the API URL with the index name pattern `message-*` (e.g., `https://your_elastic_search_instance:port/_cat/indices/message-*?v=true&s=index'). Select either Extract or Live mode connection and click on the Connect option.add-elastic-search-indices-url.png  preview-and-connect-web-datasource.png
  4. In the Preview Grid pop-up, you can see the Index column with the list of indices named `message-`. Now, click Connect to proceed.           choose-schema-page.png
  5. Now, drag and drop the result table in data design view page and click on Dashboard Parameter icon to create a list dashboard parameter.
       drag-and-drop-indexvalue-table.png
  6. Create a list dashboard parameter like below screen shot with the column Index and save the data source.           create-index-list-dashboard-param.png
  7. Add another Web API data source, enter the URL with the dashboard parameter syntax (e.g., `https://your_elastic_search_instance:port/@{{:GetIndex.Indexlist}}/_search`) and connect the data source.              create-datasource-with-index-param.png
  8. In the preview grid, ignore unwanted schemas, review the available columns of an index and click on Connect to finalize the data source.            choose-schema-index-data.png
  9. Drag and drop the result table onto the data design view page, click on Data Preview to view the data from all indices and save the data source.             drag-and-drop-index-data-table.png
  10. Utilize the newly created data source to build your dashboard with data from all indices in Elastic Search.
To enhance performance, utilize the extract mode data source in Web API and set a scheduled refresh interval to obtain the live data.

By following these steps, you can effectively integrate and visualize Elastic Search data within Bold BI dashboards, harnessing the power of regex to streamline your data connections.


Additional Reference

Ensure that you have the appropriate permissions and access to Elastic Search and Bold BI before attempting to connect and fetch data.

Was this article useful?
Like
Dislike
Help us improve this page
Please provide feedback or comments
SM
Written by Sammanasu Mary Jesuraj
Updated:
Comments (0)
Please  to leave a comment
Access denied
Access denied