AI is changing the world. Don't stay behind. Clear summaries, community insight, delivered without the noise. Subscribe to never miss a beat.

Nvidia PersonaPlex 7B on Apple Silicon: Full-Duplex Speech-to-Speech in Swift

NVIDIA PersonaPlex 7B on Apple Silicon: Full-Duplex Speech-to-Speech in Native Swift with MLX

blog.ivan.digital

March 5, 2026

5 min read

🔥🔥🔥🔥🔥

64/100

Summary

NVIDIA PersonaPlex 7B enables full-duplex speech-to-speech communication on Apple Silicon, allowing simultaneous listening and speaking. The qwen3-asr-swift library processes audio in real-time, streaming generated audio chunks without a multi-step pipeline.

Key Takeaways

NVIDIA released PersonaPlex 7B, a full-duplex speech-to-speech model that operates natively on Apple Silicon, enabling simultaneous listening and speaking without a transcription step.
The PersonaPlex model processes audio tokens directly through a unified pipeline, significantly reducing latency compared to traditional voice assistant systems that use multiple models.
The optimized PersonaPlex model has been quantized to 4-bit, reducing its size from 16.7 GB to approximately 5.3 GB while maintaining performance.
The system utilizes the Mimi audio codec, which was previously developed for text-to-speech applications, allowing for efficient audio processing and streaming.

Read original article

Community Sentiment

Mixed

Positives

The introduction of PersonaPlex on Apple Silicon showcases the potential for full-duplex speech-to-speech capabilities, which could enhance interactive applications in the future.
Users are eager for improved speech-to-text models, indicating a strong demand for advancements in this area, particularly for dictation and real-time processing.
The ability to run models locally on devices like Mac could democratize access to advanced AI tools, making them more accessible for developers and users alike.

Concerns

PersonaPlex currently lacks interactive conversation capabilities, limiting its usefulness as a practical tool despite its innovative features.
Users express frustration over the availability of TTS models that can handle mixed bilingual use cases and perform well in non-ideal audio conditions, highlighting a gap in the market.
Concerns about the potential dangers of AI applications in voice technology suggest a need for careful consideration of ethical implications and safety measures.