Disclaimer
Big Analytixs Platform Azure Engineering Guide
Release 1.0.0.1
Copyright © Big Analytixs. All rights reserved.
This software and related documentation are provided under a license agreement containing restrictions on use and disclosure and are protected by intellectual property laws. Except as expressly permitted in your license agreement or allowed by law, you may not use, copy, reproduce, translate, broadcast, modify, license, transmit, distribute, exhibit, perform, publish, or display any part, in any form, or by any means. Reverse engineering, disassembly, or decompilation of this software, unless required by law for interoperability, is prohibited. The information contained herein is subject to change without notice and is not warranted to be error-free. If you find any errors, please report them to us in writing.
This document is intended for:
BAPCORE Administrators
BAPCORE Developers
BAPCORE Architects
This document is a walkthrough to run, re-run and delete workload through Big Analytixs UI
Pre-requisites:
The list of tools required to run/develop in the UI are as follows:
Visual Studio Code (Developers only)
Python 3.8.10
Flask 1.1.4
Node 14.17.6
npm 7.24.1
R 3.6.3
Big Analytixs Libraries
Batch Management
Batch management includes running workloads and Managing workloads. It keeps track of all the workloads that ran for which layer as well as the result of it.
Run Workload
Before running a workload, it is important to have appropriate data in the required data lake. By clicking on the run workload from the menu we get to the below page -
It requires details such as “Module Name”, “Entity Name” and “Rule From Layer” to run a workload for the selected data layer. On submit it will display a loader while running the workload in the background and when it is done will display a “SUCCESS” or “FAILURE” response on the screen.
The parameters that can be used as inputs for the “Rule From Layer” are as follows:
S.No. | Rule From Layer | Rule To Layer(Defaulted) |
|---|---|---|
1. | SDL | FDL |
2. | FDL | BDL |
3. | BDL | BAL |
The workloads would be run from and to the above respective layers
Manage Workload
It is a grid having all the batches which have run previously.
The Grid displays Module Name, Entity Name, To Layer, From Layer, Batch_id, Workload Status, and Workload State for all the batches that run before. It also provides an option for a re-run and deleting batch.