Inference
-
The Serving Layer Is Learning What a Session Is
AIBrix v0.8.0 adds Redis-backed session pinning to its inference gateway, so a multi-turn agent keeps hitting the replica that already holds its KV-cache state. What that changes about serving agents, and what it does not.