What is speaker diarization?

Definition

A system detects speech, compares voice characteristics across segments and groups segments likely to come from the same person. It can attach speaker labels to a transcript when the timing of words and speaker turns can be aligned.

Labels such as Speaker 1 normally distinguish voices without identifying people by name. Overlapping speech, very short turns and background noise can cause missed or incorrect assignments.

ELI5

Imagine listening to a meeting and marking the times each voice starts and stops. You can keep track of who took each turn even if you do not know their names.

For example, a meeting transcript might show Speaker 1 asking a question and Speaker 2 answering.

Does diarization turn speech into words?

No. Transcription produces the words, while diarization identifies when different speakers are talking.

Can two people talk at once?

Yes. Some systems can label overlapping speech, but overlap makes the task harder.

  1. Hervé Bredin in a light-blue hoodie beside the blue and white headline Who Said What on black.
Definition card for speaker diarization: What is speaker diarization?

Speaker diarization divides recorded speech into time segments and labels which speaker is talking in each segment.