How can auto refresh be enabled for File System data source in ETL?
Utilizing the File System data source in ETL allows for seamless streaming of files from the local filesystem using the reader source, as well as enabling automatic refreshing of the File System data source through ETL.
How can one set up a file system data source in an ETL process?
-
Click a
Bold ETL
.
-
Click
Add Project
and provide the name for the new project.
-
Select the newly created project and add the
FileSystem
template.
-
Please modify the file path, sheet name, and type (such as excel, csv, or jsonl) in the template.
For instance, in a Windows environment.
Type : excel
File path : D:\sample.xlsx
Sheet Name - Sheet1 -
Please save the template after you have updated the details.
Schedule ETL Job
-
Click
Schedules
and select the createdfilesystemds
project.
-
For on-demand refresh, click
Run Now
.
-
After completing the on-demand refresh, the data source will be created in Bold BI.
-
To schedule the refresh hourly, please click the
Schedule
option. Based on the schedule, data can be retrieved and moved to the Bold BI data source.
- Only one sheet file can be included in a single filesystem template.
- According to the hourly refresh schedule, data can be retrieved and transferred to the Bold BI data source.