📚 Tutorial: KV-Cache Wins You Can Feel: Building AI-Aware LLM Routing on Kubernetes - Tyler Michael Smith, Red Hat; Kay Yan, DaoCloud; Vita Bortnikov, Nili Guy & Maroon Ayoub, IBM
ai infrastructurefoundation modelsapplied ai
Tyler received a PhD in Computer Science at The University of Texas at Austin, studying high performance dense linear algebra - microkernels, parallelism, and theoretical lower bounds on data movement.. After a postdoc at ETH Zürich, he joined Neural Magic, first working on a graph...