Module ETL
Module EM-ETL (Extract, Transform, Load) supports you in the ETL processes. The objective is to extract the data from the various internal and external data sources, prepare it and load it into the Big Data database according to the data model. To achieve a high degree of automation, the ETL processes can be scheduled as jobs. For this purpose, the module offers you the following functionalities:
Management
Capture ETL processes, assign responsibilities, and perform manually. To avoid double entry, most of the data is taken from the Process Management and Data Management modules. By changing the status, the release into production takes place here.
Creation
Design the ETL process by defining the data source, data structure and fields, and transformation and mapping. The ETL process can then be tested.
Planning
Summary of ETl processes to ETL jobs. To achieve a high level of automation, ETL jobs can be scheduled daily, weekly or monthly.
Tracking
The ETL jobs are displayed in the calendar as appointments. This makes it possible to track which ETL jobs are scheduled, which have already been processed, and to what extent errors have occurred during processing.
This post is also available in: German
