Skip to content

Posts

All the articles I've posted.

Mar 15, 2024

ChatGPT thoughts on Dependency Injection

This answer from ChatGPT, whether or not Direct Injection is a good pattern to adopt in any project, is spot on. Go for it if you are ready to embrace the associated complexity. Don't go for it, if you lean toward simplicity.

Read →
Mar 15, 2024

The Modern Data Stack: Empowering Data-Driven Organizations with Dagster, dbt, Great Expectations, Superset, and DataHub

The modern data stack, combining tools like Dagster, dbt, Great Expectations, Superset, and DataHub, empowers organizations to efficiently manage, transform, and derive insights from their data. By adopting these best-in-class tools, data teams can streamline workflows, improve data quality, and drive data-driven decision-making.

Read →
Mar 15, 2024

Introduction to Dagster

Dagster is a data orchestrator that simplifies and optimizes data processing workflows for machine learning and analytics. It introduces concepts such as software-designed assets, Ops, Graphs, Jobs, Repositories, Workspaces, Materialization, Schedules, Sensors, and Backfills. These components work together to provide a flexible and intuitive framework for defining, executing, and monitoring complex data pipelines, enabling data engineers and analysts to efficiently manage and orchestrate their workflows.

Read →
Dec 18, 2023

Ship KumoMTA logs with Filebeat

Ship KumoMTA logs with Filebeat

Read →
Nov 13, 2021

Quick page testing with Alpine CURL

Using a docker image with alpine and curl to test the content of a web page

Read →
Nov 12, 2021

How to replace Docker Desktop with Portainer

Using Multipass with Portainer on Mac and Windows

Read →
Oct 27, 2020

Kubernetes Concepts

Understanding Kubernetes

Read →
Sep 23, 2020

Cloud Pipelines

Execute video batch and control the flow

Read →