Deploy ETL on Azure container Instance

This section explains how to install the Bold ETL application on Azure Container Instance.

Prerequisites

• Azure CLI
• Azure Resource Group
• Azure storage account
• File Shares are created in the name of boldetl on the storage account.
  
  

Steps to deploy the Bold BI application on Azure Container Instance

1. Create a configuration file with the name boldetl.yaml for the Bold BI application.

   apiVersion: '2019-12-01'
   location: <location>
   name: boldetl
   properties:
     containers:
     - name: boldetl
       properties:
         environmentVariables: []
         image: <image tag>
         ports:
         - port: 80
         - port: 443
         resources:
           requests:
             cpu: 2.0
             memoryInGB: 4
         volumeMounts:
         - mountPath: /application/app_data
           name: filesharevolume
     osType: Linux
     restartPolicy: Always
     ipAddress:
       type: Public
       ports:
       - port: 80
       - port: 443
       dnsNameLabel: <dns-name-label>
     volumes:
     - name: filesharevolume
       azureFile:
         sharename: boldetl
         storageAccountName: <storage-account-name>
         storageAccountKey: <storage-account-key>
   tags: {}
   type: Microsoft.ContainerInstance/containerGroups
   
   

• location - Choose the location where you plan to deploy your app. Our recommended location is eastus
  

  

• In the resources section, you can increase the configuration as shown below:
  Example:

  requests:
      cpu: 4.0
      memoryInGB: 8
  

• image: - Specify a image tag
  

  
  
  Example:
  image: gcr.io/boldbi-294612/bold-etl:7.5.13

• dnsNameLabel - Specify a DNS name label for your container. The name must be unique within the Azure region where you create the container instance. Your container will be publicly reachable at <dns-name-label>.<region>.azurecontainer.io
  

  

• Enter the storageAccountName and storageAccountKey in configuration file.
  Example:
  storageAccountName: filestorageboldbi
  storageAccountKey: naskjnsadnncalnnks=ajdsnkda
  

  

2. Open the terminal or PowerShell on the local machine and activate the Azure account using AzureCLI.
3. Run the following command to deploy the Bold BI application on Azure portal.

   az container create --resource-group <resource group name> --file <configuration file with path>
   

   Example : - az container create --resource-group boldetl --file D:\boldetl.yaml
   
   
4. Once the container is created in the Azure instance, you can obtain the output text for the resource creation directly in the terminal.
5. You can access the application on the public DNS that is generated within the Container instance itself.
   
   
6. Bold ETL application hosted as like below
   
   

7. Create Project using this. connecting MSSQL please use below template in Bold ETL

version: 1
encrypt_credentials: true
plugins:
 extractors:
   - name: MSSQL
     connectorname: MSSQL
     config:
       host: servername
       port: 1433
       username: user
       database: dbname
       password: password
       drivername: mssql+pyodbc
       #if ODBC Driver 18 for SQL Server is installed, use the following driver: ODBC Driver 18 for SQL Server
       driver: ODBC Driver 17 for SQL Server 
     select:
     - ga

8. Please refer the below links to working with Bold ETL
   Bold ETL UG : Working with ETL
   Sample Transformation