Vision & Multimodal

Multimodal LLMs: LLaVA, Flamingo, GPT-4V

The vision-encoder-plus-projector-plus-LLM recipe that dominates open multimodal models, why Flamingo's perceiver design still matters for video, and what native-multimodal frontier models do differently.

advanced · 9 min read · Premium