Author

Yadan Wei

2 public articles

Build real-time voice applications with vLLM-Omni on SageMaker AI – Part 1

Yadan WeiSep 29, 2026, 12:15 AM8 min read

The gist: Deploy a text-to-speech model on Amazon SageMaker AI with the AWS vLLM-Omni Deep Learning Container and stream generated speech over a persistent bidirectional connection. This Part 1 tutorial deploys Qwen3-TTS and streams speech through a Gradio application.

Artificial intelligence

Generate images and video with vLLM-Omni on SageMaker AI – Part 2

Yadan WeiSep 29, 2026, 12:15 AM10 min read

The gist: Deploy two generative media models from one AWS vLLM-Omni Deep Learning Container on Amazon SageMaker AI. Generate an image with FLUX.2-klein through real-time inference, then animate it into video with Wan2.1-VACE through asynchronous inference, and retrieve the MP4 from Amazon S3.

All articles loaded

Build real-time voice applications with vLLM-Omni on SageMaker AI – Part 1

Generate images and video with vLLM-Omni on SageMaker AI – Part 2

Hot ranking