๐ Tutorial: KV-Cache Wins You Can Feel: Building AI-Aware LLM Routing on Kubernetes - Tyler Michael Smith, Red Hat; Kay Yan, DaoCloud; Vita Bortnikov, Nili Guy & Maroon Ayoub, IBM
ai infrastructurefoundation modelsapplied ai
My interest is distributed systems with focus on High Availability and Scalability. In the last years I am working on Microservices Framework and my team is among Istio leaders. I am also interested in managing different workloads with Kubernetes, specifically VMs.