Obi Madu's Blog

Obi Madu's Blog

Latest articles and thought pieces from my professional and technical journey.

Featured articles

Latest articles

01-09 / 15
One Codebase, Web and Desktop
System Design12 min read

One Codebase, Web and Desktop

How to design a Tauri app so the same React code runs in the browser and on the desktop, by putting the runtime differences behind a service interface.

Architecting AI Gateway Budgets: Virtual Keys, Provider Keys, and Distributed Quota Enforcement
AI Engineering12 min read

Architecting AI Gateway Budgets: Virtual Keys, Provider Keys, and Distributed Quota Enforcement

A blueprint for designing a global AI quota system. How to separate request execution from budget truth under high concurrency.

LiteLLM vs. Bifrost: Choosing an AI Gateway
AI Engineering9 min read

LiteLLM vs. Bifrost: Choosing an AI Gateway

A practical comparison of LiteLLM's Python-based distributed state and Bifrost's Go-based raw performance, to help you choose an AI gateway.

Pooling API Keys with Bifrost
System Design9 min read

Pooling API Keys with Bifrost

A practical guide to configuring API key pooling in Bifrost, and how to safely scale it across multiple nodes by externalizing your rate limits.

LiteLLM as a Distributed AI Gateway
FeaturedAI Engineering8 min read

LiteLLM as a Distributed AI Gateway

How to pool API keys and multiple backends under a single model id to increase your rate limit capacity, and how LiteLLM keeps that pooling consistent across multiple nodes.

Scaling AI Gateways: How to Pool API Keys and Survive Rate Limits
AI Engineering10 min read

Scaling AI Gateways: How to Pool API Keys and Survive Rate Limits

Learn how to overcome strict LLM provider rate limits by pooling API keys, and explore the 3-layer architecture required for distributed token tracking.

Architecting Reliable Mobile Billing
FeaturedMobile20 min read

Architecting Reliable Mobile Billing

A real-world look at fixing mobile subscription billing when webhooks, sandbox purchases, and user identity break down.

OAuth vs OIDC: Access Tokens vs ID Tokens
System Design20 min read

OAuth vs OIDC: Access Tokens vs ID Tokens

A practical explanation of OAuth, OIDC, access tokens, and ID tokens without the usual authentication confusion.

React Native and Expo, Explained Simply
Mobile20 min read

React Native and Expo, Explained Simply

Understand how React Native and Expo really work, from native builds to OTA updates and development workflows.