Foundation Models

Building the models everything else runs on — LLM and multimodal architecture, pre-training, scaling laws, and evaluation.

• large language models
• LLMs
• transformers
• model architecture
• pre-training
• scaling laws
• tokenization
• attention mechanisms
• multimodal models
• vision-language models
• model compression
• distillation
• quantization
• mixture of experts
• emergent capabilities
• benchmarking
• model evaluation