Blog / Data Engineering

Posts on Data Engineering

All Golang (9) Architecture (7) Getting started (4) Security (4) DevOps (3) homelab (3) Kubernetes (3) Microservices (3) server (3) TypeScript (3) AI (2) Backend (2) cisco (2) Data Engineering (2) Development (2) networking (2) Performance (2) rack (2) Cloud (1) Cloud Native (1) Enterprise (1) Frontend (1) hardware (1) Infrastructure (1) Productivity (1)
Real-Time Data Pipelines with TypeScript and Kafka
TypeScript Data Engineering Architecture

Real-Time Data Pipelines with TypeScript and Kafka

How I build type-safe, event-driven data pipelines using TypeScript and KafkaJS -- from schema validation to dead letter queues to exactly-once processing.
High-Performance ETL Pipelines in Go
Data Engineering Golang Performance

High-Performance ETL Pipelines in Go

A failure-model-first walkthrough of streaming ETL in Go — bounded concurrency, backpressure, context cancellation, poison records, and the mistakes that blow up memory under real load.