Multimodal Glossary

Browse 8 multimodal terms defined in plain English, from the cultural dictionary of computing.

8 Multimodal Terms

CLIP: A multimodal model trained to align images and text in a shared embedding space. It influences how models are trained, evaluated, or served, and it can...
CLIP Model: A model trained to align images and text in a shared embedding space so they can be compared semantically.
Cross-Attention: An attention mechanism where one sequence attends to representations computed from another sequence. It influences how models are trained, evaluated, or...
Gemini: Google's family of multimodal AI models, succeeding the PaLM series, capable of processing and generating text, code, images, audio, and video. Gemini launched...
Gemini Model: A model in Google's Gemini family, commonly discussed in the context of multimodal AI, assistants, and foundation-model competition.
GPT-4: OpenAI's fourth-generation Generative Pre-trained Transformer, a large multimodal model capable of processing both text and images. Released in March 2023,...
Large Multimodal Model: A large model trained to understand or generate across multiple modalities such as text, image, or audio. It influences how models are trained, evaluated, or...
Multi-Modal: Describing AI systems that can process or generate more than one modality, such as text, images, audio, or video. Multi-modal systems are useful when tasks...