Jonathan KemperView the LinkedIn Profile of Jonathan Kemper

Sep 27, 2026

Nvidia released Nemotron 3 Diarization, an AI model that identifies which speaker is talking at any given moment in a conversation. The model has about 100 million parameters, and its weights are freely available. It can tell apart up to eight speakers and detect when multiple people talk at the same time. More participants, heavy background noise, or reverb push error rates higher. Paired with a speech recognition system like Parakeet, the model can produce transcripts with speaker labels, though only anonymous ones like "speaker_2." It works with both recordings and live audio.

In the VoiceArena Diarization Benchmark v1, the freely available Nemotron 3 leads with a DER of 14.7% and outperforms its predecessor, Streaming Sortformer, by 41%.

The audio buffer can be set to four levels ranging from 30.4 down to 0.32 seconds. Shorter buffers generally reduce accuracy. On the Diarization-Bench from VoiceArena, the model currently sits in first place with a 14.72 percent error rate, ahead of the next best system at 19.3 percent. The benchmark is strict. Overlapping speech counts, and even tiny misalignments at speaker transitions are scored as errors. Compared to its predecessor, Streaming Sortformer, the new model cuts the error rate by an average of 41 percent across eight test scenarios when using a 1.04-second buffer.