Announcing KServe v0.15: Advancing Generative AI Model Serving
KServe v0.15 introduces enhanced support for generative AI workloads, including advanced features for serving large language models (LLMs), improved model and KV caching mechanisms, and integration with Envoy AI Gateway.