Obi Madu's Blog

Obi Madu's Blog

Latest articles and thought pieces from my professional and technical journey.

Featured articles

Latest articles

01-09 / 18
Penpot and Design to Code
Design9 min read

Penpot and Design to Code

An intro to Penpot as a design tool, and how its open file format, token model, and plugin API make design-to-code a first-class workflow instead of a handoff.

One Codebase, Web and Desktop
System Design12 min read

One Codebase, Web and Desktop

How to design a Tauri app so the same React code runs in the browser and on the desktop, by putting the runtime differences behind a service interface.

Demystifying OpenSpec
FeaturedAI Engineering8 min read

Demystifying OpenSpec

OpenSpec profiles, schemas, artifacts, config, skills, and delta specs, explained simply.

Adding a Free WAF to My Homebox: CrowdSec AppSec Tutorial ft. Traefik and Dokploy
FeaturedSecurity10 min read

Adding a Free WAF to My Homebox: CrowdSec AppSec Tutorial ft. Traefik and Dokploy

A complete guide on how I protect my Homebox applications with CrowdSec's AppSec WAF, a Traefik plugin, and Dokploy.

Architecting AI Gateway Budgets: Virtual Keys, Provider Keys, and Distributed Quota Enforcement
AI Engineering12 min read

Architecting AI Gateway Budgets: Virtual Keys, Provider Keys, and Distributed Quota Enforcement

A blueprint for designing a global AI quota system. How to separate request execution from budget truth under high concurrency.

LiteLLM vs. Bifrost: Choosing an AI Gateway
AI Engineering9 min read

LiteLLM vs. Bifrost: Choosing an AI Gateway

A practical comparison of LiteLLM's Python-based distributed state and Bifrost's Go-based raw performance, to help you choose an AI gateway.

Pooling API Keys with Bifrost
System Design9 min read

Pooling API Keys with Bifrost

A practical guide to configuring API key pooling in Bifrost, and how to safely scale it across multiple nodes by externalizing your rate limits.

LiteLLM as a Distributed AI Gateway
FeaturedAI Engineering8 min read

LiteLLM as a Distributed AI Gateway

How to pool API keys and multiple backends under a single model id to increase your rate limit capacity, and how LiteLLM keeps that pooling consistent across multiple nodes.

Scaling AI Gateways: How to Pool API Keys and Survive Rate Limits
AI Engineering10 min read

Scaling AI Gateways: How to Pool API Keys and Survive Rate Limits

Learn how to overcome strict LLM provider rate limits by pooling API keys, and explore the 3-layer architecture required for distributed token tracking.