Nili Guy

Nili is a Research Manager and Senior Technical Staff Member at IBM Research, co-creator of llm-d, and an expert in distributed inference and Kubernetes-native AI systems. She has led key open-source and productized inference initiatives across IBM's AI platforms.

1 talk 1 conference AI & Machine Learning

All talks · newest first

KubeCon + CloudNativeCon Day 5 Elicium 1 75m talk 6m read

📚 Tutorial: KV-Cache Wins You Can Feel: Building AI-Aware LLM Routing on Kubernetes - Tyler Michael Smith, Red Hat; Kay Yan, DaoCloud; Vita Bortnikov, Nili Guy & Maroon Ayoub, IBM

Maroon Ayoub, Tyler Michael Smith, Kay Yan, Vita Bortnikov, Nili Guy

ai infrastructurefoundation modelsapplied ai

video