✦ New articles every week

Learn to build software that lasts.

Long-form engineering articles, hands-on tutorials and structured courses — written by practitioners, for practitioners.

Latest writing

All articles →

Free tools for data engineers

Size Spark output, draft tables from JSON, generate SQL checks.

All tools →
Apache SparkFree

Spark File Size & Partition Planner

Work out how many files a Spark job should write for a target file size, with partitionBy, task slots and maxRecordsPerFile, and every assumption shown.

PostgreSQLFree

JSON to PostgreSQL DDL Generator

Paste sample JSON records and get a PostgreSQL CREATE TABLE: inferred types, safe column names, jsonb or flattened nesting, and every decision explained.

SQL & Data QualityFree

SQL Data Quality Check Generator

Describe a table, pick rules (required, unique, accepted values, non-negative, dates) and get read-only PostgreSQL checks, each explained, plus constraints.

DatabricksFree

Databricks Cluster Cost Calculator

Work out a Databricks cluster's monthly cost from DBUs/hour, your price per DBU and node count, with the cloud VM cost kept separate and every step shown.

OrchestrationFree

Cron & Airflow Schedule Builder

Enter a cron expression or Airflow preset (@daily, @hourly) to see its next run times, a plain-language description and common Airflow gotchas explained.

Learn at your own pace.

Create a free account to enroll in courses and track what you're learning.

Create free account