Category: System Design
-
A Text-Based Dungeon Crawler, Part 1 – Defining the Concept and Requirements

A new series filled with the fun of defining requirements for a game.
-
Staging Data from Semi-Structured Text Files to Structured Tables – The All Roads Project

Data Engineering requires the ability to do more than just pull and load files. You will need to be able to cleanse and prepare the source into a useable format. This article dives into what was done to stage the CCC data previously collected for The All Roads Project.
-
Designing the Database Structures for The All Roads Project

Designing a database is a fun process. I will step through the basics of conceptual, logical, and physical design. The end result will be used for The All Roads Project.
-
Announcing A New Project with Higher Goals
With this being the Easter Season, it is the perfect time to embark on a new analytics project involving religious text. I discuss the different aspects of what I am hoping to accomplish.
-
Designing for a Low-Code Web Scraping Process Using Apple Shortcuts

Happy Leap Day! Even in the realm of low-code software development, proper design techniques are still needed. Here is an approach I took for a web scraping process.
-
An Exploration of Random Numbers – Part 4: Conclusion with an Experiment

In the conclusion of this series on random numbers, I challenge the AI with another go. Let’s see what results!
-
An Exploration of Random Numbers – Part 2: Quality

How does someone determine if a random number generator is good? In part 2 of this series, I will explore possible solutions to this question.
-
Scope Your Data Capture
Avoid over-engineering your data capture efforts by keeping on target.
-
A Primer on Source to Target Mapping
A Source to Target Map is a blueprint for putting together your systems. This is where you will build out the contract for how data will flow into (and/or out of) your system. This posting will go into the basics of creating that data contract.
-
Control Your ETL
In the world of ETL (Extract, Transform, and Load), there are many ways to get from point A to point B. The coding direction you take all depends on what you are trying to end on. Are you going for a data warehouse structure, a data lake, or a generalized…


You must be logged in to post a comment.