vLLM-Omni vv0.14.0
vLLM-Omni is an open-source framework that extends vLLM's support to omni-modality model inference and serving, encompassing text, image, video, and audio data processing. It introduces support for non-autoregressive architectures like Diffusion Transformers and offers heterogeneous outputs, facilitating complex model workflows.
Omni-modality support for text, image, video, and audio data processing
Integration of non-autoregressive architectures such as Diffusion Transformers
Heterogeneous outputs from traditional text generation to multimodal outputs
PricingFree
Versionv0.14.0