Yash DabhadeAI Engineer

← Projects

Completed Open source · Go · LLM infrastructure

GoLLMKit

Unified multi-LLM gateway for OpenAI, Anthropic, and Google with failover, token accounting, and encrypted key management.

Problem

Every service re-implemented provider SDKs, retries, and key handling differently.

Approach

One Go gateway with intelligent failover, live token accounting, key rotation, rate limiting, retries, and AES-GCM encrypted keys.

Outcome

80% less integration effort; 25% model cost reduction.

GitHub ↗