Perception Encoder Audiovisual (PE-AV)
Meta's Perception Encoder Audiovisual (PE-AV) is a state-of-the-art multimodal model that embeds audio, video, audio-video, and text into a joint embedding space. Trained using contrastive learning on approximately 100 million audio-video pairs with text captions, PE-AV enables powerful cross-modal retrieval and understanding across audio, video, and text modalities. ([marktechpost.com](https://www.marktechpost.com/2025/12/22/meta-ai-open-sourced-perception-encoder-audiovisual-pe-av-the-audiovisual-encoder-powering-sam-audio-and-large-scale-multimodal-retrieval/?utm_source=openai))
Meta's Perception Encoder Audiovisual (PE-AV) is a state-of-the-art multimodal model that embeds audio, video, audio-video, and text into a joint embedding space. Trained using contrastive learning on approximately 100 million audio-video pairs with text captions, PE-AV enables powerful cross-modal retrieval and understanding across audio, video, and text modalities. ([marktechpost.com](https://www.marktechpost.com/2025/12/22/meta-ai-open-sourced-perception-encoder-audiovisual-pe-av-the-audiovisual-encoder-powering-sam-audio-and-large-scale-multimodal-retrieval/?utm_source=openai))
- 01Embeds audio, video, and text into a unified embedding space
- 02Trained on 100 million audio-video pairs with text captions
- 03Enables cross-modal retrieval and understanding
- 04Achieves state-of-the-art performance on multiple benchmarks
- 05Supports tasks like video retrieval from text and audio retrieval from video