• Overview
• Publications
• Software
  • Framework
  • Evaluation
  • Clustering
  • Speaker embedding
  • Other sotware
• Datasets
• Leaderboards
• Other learning materials
  • Tech blog
  • Video tutorials
• Products

This is a curated list of awesome Speaker Diarization papers, libraries, datasets, and other resources.

The purpose of this repo is to organize the world’s resources for speaker diarization, and make them universally accessible and useful.

To add items to this page, simply send a pull request.

• Meeting Transcription Using Virtual Microphone Arrays
• Speaker diarisation using 2D self-attentive combination of embeddings

• Fully Supervised Speaker Diarization
• Diarization is Hard: Some Experiences and Lessons Learned for the JHU Team in the Inaugural DIHARD Challenge
• JHU Diarization System Description
• ODESSA at Albayzin Speaker Diarization Challenge 2018
• Neural speech turn segmentation and affinity propagation for speaker diarization
• Multimodal Speaker Segmentation and Diarization using Lexical and Acoustic Cues via Sequence to Sequence Neural Networks

• Speaker Diarization with LSTM
• Speaker diarization using deep neural network embeddings
• Speaker diarization using convolutional neural network for statistics accumulation refinement
• pyannote. metrics: a toolkit for reproducible evaluation, diagnostic, and error analysis of speaker diarization systems
• Speaker Change Detection in Broadcast TV using Bidirectional Long Short-Term Memory Networks
• Speaker Diarization using Deep Recurrent Convolutional Neural Networks for Speaker Embeddings

• A Speaker Diarization System for Studying Peer-Led Team Learning Groups

• Diarization resegmentation in the factor analysis subspace

• A study of the cosine distance-based mean shift for telephone speech diarization
• Speaker diarization with PLDA i-vector scoring and unsupervised calibration
• Artificial neural network features for speaker diarization

• Unsupervised methods for speaker diarization: An integrated and iterative approach

• PLDA-based Clustering for Speaker Diarization of Broadcast Streams
• Speaker diarization of meetings based on speaker role n-gram models

• Speaker diarization: A review of recent research

• Speaker Diarization for Meeting Room Audio

• Stream-based speaker segmentation using speaker factors and eigenvoices

• An overview of automatic speaker diarization systems
• A spectral clustering approach to speaker diarization

Link	Language	Description
SIDEKIT for diarization (s4d)	Python	An open source package extension of SIDEKIT for Speaker diarization.
pyAudioAnalysis	Python	Python Audio Analysis Library: Feature Extraction, Classification, Segmentation and Applications.
AaltoASR	Python & Perl	Speaker diarization scripts, based on AaltoASR.
LIUM_SpkDiarization	Java	LIUM_SpkDiarization is a software dedicated to speaker diarization (i.e. speaker segmentation and clustering). It is written in Java, and includes the most recent developments in the domain (as of 2013).
kaldi-asr	Bash	Example scripts for speaker diarization on a portion of CALLHOME used in the 2000 NIST speaker recognition evaluation.
Alize LIA_SpkSeg	C++	ALIZÉ is an opensource platform for speaker recognition. LIA_SpkSeg is the tools for speaker diarization.
pyannote-audio	Python	Neural building blocks for speaker diarization: speech activity detection, speaker change detection, speaker embedding.
pyBK	Python	Speaker diarization using binary key speaker modelling. Computationally light solution that does not require external training data.
Speaker-Diarization	Python	Speaker diarization using uis-rnn and GhostVLAD. An easier way to support openset speakers.

Link	Language	Description
pyannote-metrics	Python	A toolkit for reproducible evaluation, diagnostic, and error analysis of speaker diarization systems.
SimpleDER	Python	A lightweight library to compute Diarization Error Rate (DER).
modified NIST md-eval.pl	Perl	From Mary Tai Knox
NIST md-eval-v21.pl	Perl	From jitendra
NIST md-eval-22.pl	Perl	From nryant
dscore	Python & Perl	Diarization scoring tools.
Sequence Match Accuracy	Python	Match the accuracy of two sequences with Hungarian algorithm.

Link	Language	Description
uis-rnn	Python & PyTorch	Google's Unbounded Interleaved-State Recurrent Neural Network (UIS-RNN) algorithm, for Fully Supervised Speaker Diarization.
SpectralCluster	Python	Spectral clustering with affinity matrix refinement operations.
sklearn.cluster	Python	scikit-learn clustering algorithms.
PLDA	Python	Probabilistic Linear Discriminant Analysis & classification, written in Python.
PLDA	C++	Open-source implementation of simplified PLDA (Probabilistic Linear Discriminant Analysis).

Link	Language	Description
VB Diarization	Python	VB Diarization with Eigenvoice and HMM Priors.

• StateOfTheArt.ai
• DIHARD 2018

• Literature Review For Speaker Change Detection by Halil Erdoğan
• Speaker Diarization: Separation of Multiple Speakers in an Audio File by Jaspreet Singh

• Google's Diarization System: Speaker Diarization with LSTM by Google
• Fully Supervised Speaker Diarization: Say Goodbye to clustering by Google
• Speaker Diarization: Optimal Clustering and Learning Speaker Embeddings by Microsoft Research
• Robust Speaker Diarization for Meetings: the ICSI system by Microsoft Research