Category: ETL
-
The All Roads Project – Loading the CCC Data from Staging Area
For the All Roads Project, the Catechism data have been staged. It is on to loading the data into the landing set of tables.
-
Staging Data from Semi-Structured Text Files to Structured Tables – The All Roads Project
Data Engineering requires the ability to do more than just pull and load files. You will need to be able to cleanse and prepare the source into a useable format. This article dives into what was done to stage the CCC data previously collected for The All Roads Project.
-
A Primer on Source to Target Mapping
A Source to Target Map is a blueprint for putting together your systems. This is where you will build out the contract for how data will flow into (and/or out of) your system. This posting will go into the basics of creating that data contract.
-
Control Your ETL
In the world of ETL (Extract, Transform, and Load), there are many ways to get from point A to point B. The coding direction you take all depends on what you are trying to end on. Are you going for a data warehouse structure, a data lake, or a generalized…
Andy’s Neural Works 
You must be logged in to post a comment.