github·Tools and apps
FastAPI Jev Micro-Gateway
Production Python microservice featuring automatic semantic response caching, rate limiting, and fallback fallback routing for Jev API calls.
Open GitHub ⚡ Handles 10k req/sec with Redis
Can this inbound decision request be satisfied by the localized LRU cache?
Jev sits between the incoming context and the next system action. Rather than generating lengthy, slow natural language that requires brittle regex parsing, Jev returns non-autoregressive, calibrated probabilities that downstream code can immediately execute.
01cache_hitPrimary action
02cached_confidenceConfidence score
03ttlFallback route