Projects

This part of the knowledge base will explain using the Projects tab to create ETL packages for data loads.

ETL

ETL = Extract, Transform, Load. It is a method of getting data from one system to another. In this case, Builder → Atmolytics.

Most ETLs are complex, time consuming manual error prone processes. Our Auto ETL is uniquely designed to create simple wide data structures with comprehensive documentation. Data quality issues are supported in a sympathetic manner by allowing all data into the database with validation rules assessing the correctness when compared to the forms definitions. This simple structure combined with the validation rules significantly reduces the cost of implementing an ETL. This works by allowing the user to create an “ETL package” that defines the data they intend to transfer.

An organisation may require more than one ETL package (e.g. one for production, one for test). For this they can create separate “projects” - a “project” is a wrapper for all versions of an ETL package.