A Study of Data Selection Strategies for Pre-training Self-Supervised Speech Models.

Titouan Parcollet https://orcid.org/0000-0003-0672-1346

Ryan Whetten Titouan Parcollet Marco Dinarelli Yannick Estève A Study of Data Selection Strategies for Pre-training Self-Supervised Speech Models. 2026 January abs/2601.20896 CoRR https://doi.org/10.48550/arXiv.2601.20896 db/journals/corr/corr2601.html#abs-2601-20896 streams/journals/corr

Salah Zaiem Youcef Kemiche Titouan Parcollet Slim Essid Mirco Ravanelli Speech self-supervised representations benchmarking: A case for larger probing heads. 101695 2025 89 Comput. Speech Lang. https://doi.org/10.1016/j.csl.2024.101695 db/journals/csl/csl89.html#ZaiemKPER25 streams/journals/csl

Yuan Tseng Titouan Parcollet Rogier C. van Dalen Shucong Zhang Sourav Bhattacharya Evaluation of LLMs in Speech is Often Flawed: Test Set Contamination in Large Language Models for Speech Recognition. ASRU 2025 1-8 conf/asru/2025 https://doi.org/10.1109/ASRU65441.2025.11434665 db/conf/asru/asru2025.html#TsengPDZB25 streams/conf/asru Shucong Zhang Titouan Parcollet Rogier C. van Dalen Sourav Bhattacharya Benchmarking Rotary Position Embeddings for Automatic Speech Recognition. ASRU 2025 1-7 conf/asru/2025 https://doi.org/10.1109/ASRU65441.2025.11434788 db/conf/asru/asru2025.html#ZhangPDB25 streams/conf/asru Titouan Parcollet Rogier van Dalen Shucong Zhang Sourav Bhattacharya Linear Time Complexity Conformers with SummaryMixing for Streaming Speech Recognition. 1-5 2025 ICASSP https://doi.org/10.1109/ICASSP49660.2025.10889844 conf/icassp/2025 db/conf/icassp/icassp2025.html#ParcolletDZB25 Rogier C. van Dalen Shucong Zhang Titouan Parcollet Sourav Bhattacharya Robust Unsupervised Adaptation of a Speech Recogniser Using Entropy Minimisation and Speaker Codes. 2025 INTERSPEECH https://doi.org/10.21437/Interspeech.2025-903 conf/interspeech/2025 db/conf/interspeech/interspeech2025.html#DalenZPB25 Titouan Parcollet Yuan Tseng Shucong Zhang Rogier C. van Dalen Loquacious Set: 25, 000 Hours of Transcribed and Diverse English Speech Recognition Data for Research and Commercial Use. 2025 INTERSPEECH https://doi.org/10.21437/Interspeech.2025-720 conf/interspeech/2025 db/conf/interspeech/interspeech2025.html#ParcolletTZD25 Ryan Whetten Lucas Maison Titouan Parcollet Marco Dinarelli Yannick Estève Towards Early Prediction of Self-Supervised Speech Model Performance. 2025 INTERSPEECH https://doi.org/10.21437/Interspeech.2025-34 conf/interspeech/2025 db/conf/interspeech/interspeech2025.html#WhettenMPDE25

Ryan Whetten Lucas Maison Titouan Parcollet Marco Dinarelli Yannick Estève Towards Early Prediction of Self-Supervised Speech Model Performance. 2025 January abs/2501.05966 CoRR https://doi.org/10.48550/arXiv.2501.05966 db/journals/corr/corr2501.html#abs-2501-05966 streams/journals/corr

Shucong Zhang Titouan Parcollet Rogier van Dalen Sourav Bhattacharya Benchmarking Rotary Position Embeddings for Automatic Speech Recognition. 2025 January abs/2501.06051 CoRR https://doi.org/10.48550/arXiv.2501.06051 db/journals/corr/corr2501.html#abs-2501-06051 streams/journals/corr

Titouan Parcollet Yuan Tseng Shucong Zhang Rogier van Dalen Loquacious Set: 25,000 Hours of Transcribed and Diverse English Speech Recognition Data for Research and Commercial Use. 2025 May abs/2505.21578 CoRR https://doi.org/10.48550/arXiv.2505.21578 db/journals/corr/corr2505.html#abs-2505-21578 streams/journals/corr

Yuan Tseng Titouan Parcollet Rogier van Dalen Shucong Zhang Sourav Bhattacharya Evaluation of LLMs in Speech is Often Flawed: Test Set Contamination in Large Language Models for Speech Recognition. 2025 May abs/2505.22251 CoRR https://doi.org/10.48550/arXiv.2505.22251 db/journals/corr/corr2505.html#abs-2505-22251 streams/journals/corr

Rogier C. van Dalen Shucong Zhang Titouan Parcollet Sourav Bhattacharya Robust Unsupervised Adaptation of a Speech Recogniser Using Entropy Minimisation and Speaker Codes. 2025 June abs/2506.10653 CoRR https://doi.org/10.48550/arXiv.2506.10653 db/journals/corr/corr2506.html#abs-2506-10653 streams/journals/corr

Titouan Parcollet Ha Nguyen Solène Evain Marcely Zanon Boito Adrien Pupier Salima Mdhaffar Hang Le 0001 Sina Alisamir Natalia A. Tomashenko Marco Dinarelli Shucong Zhang Alexandre Allauzen Maximin Coavoux Yannick Estève Mickael Rouvier Jérôme Goulian Benjamin Lecouteux François Portet Solange Rossato Fabien Ringeval Didier Schwab Laurent Besacier LeBenchmark 2.0: A standardized, replicable and enhanced framework for self-supervised representations of French speech. 101622 2024 86 Comput. Speech Lang. https://doi.org/10.1016/j.csl.2024.101622 db/journals/csl/csl86.html#ParcolletNEBPMLATDZACER24 streams/journals/csl

Mirco Ravanelli Titouan Parcollet Adel Moumen Sylvain de Langen Cem Subakan Peter Plantinga Yingzhi Wang 0002 Pooneh Mousavi Luca Della Libera Artem Ploujnikov Francesco Paissan Davide Borra Salah Zaiem Zeyu Zhao 0004 Shucong Zhang Georgios Karakasidis Sung-Lin Yeh Pierre Champion Aku Rouhe Rudolf Braun Florian Mai Juan Zuluaga-Gomez Seyed Mahed Mousavi Andreas Nautsch Ha Nguyen Xuechen Liu 0001 Sangeet Sagar Jarod Duret Salima Mdhaffar Gaëlle Laperrière Mickael Rouvier Renato De Mori Yannick Estève Open-Source Conversational AI with SpeechBrain 1.0. 333:1-333:11 2024 25 J. Mach. Learn. Res. https://jmlr.org/papers/v25/24-0991.html db/journals/jmlr/jmlr25.html#RavanelliPMLSP024

Ryan Whetten Titouan Parcollet Marco Dinarelli Yannick Estève Open Implementation and Study of Best-RQ for Speech Processing. 460-464 2024 ICASSP Workshops https://doi.org/10.1109/ICASSPW62465.2024.10626364 conf/icassp/2024w db/conf/icassp/icassp2024w.html#WhettenPDE24 streams/conf/icassp Titouan Parcollet Rogier van Dalen Shucong Zhang Sourav Bhattacharya SummaryMixing: A Linear-Complexity Alternative to Self-Attention for Speech Recognition and Understanding. 2024 INTERSPEECH https://doi.org/10.21437/Interspeech.2024-40 conf/interspeech/2024 db/conf/interspeech/interspeech2024.html#ParcolletDZB24 Shucong Zhang Titouan Parcollet Rogier van Dalen Sourav Bhattacharya Linear-Complexity Self-Supervised Learning for Speech Processing. 2024 INTERSPEECH https://doi.org/10.21437/Interspeech.2024-500 conf/interspeech/2024 db/conf/interspeech/interspeech2024.html#ZhangPDB24 Ryan Whetten Titouan Parcollet Adel Moumen Marco Dinarelli Yannick Estève An Analysis of Linear Complexity Attention Substitutes With Best-RQ. 169-176 2024 SLT https://doi.org/10.1109/SLT61566.2024.10832323 conf/slt/2024 db/conf/slt/slt2024.html#WhettenPMDE24 streams/conf/slt Ryan Whetten Titouan Parcollet Marco Dinarelli Yannick Estève Implémentation ouverte et étude de BEST-RQ pour le traitement de la parole. 412-420 2024 TALN (JEP) https://aclanthology.org/2024.jeptalnrecital-jep.42 conf/taln/2024jep db/conf/taln/jep2024.html#WhettenPDE24 streams/conf/taln

Ryan Whetten Titouan Parcollet Marco Dinarelli Yannick Estève Open Implementation and Study of BEST-RQ for Speech Processing. 2024 abs/2405.04296 CoRR https://doi.org/10.48550/arXiv.2405.04296 db/journals/corr/corr2405.html#abs-2405-04296

Mirco Ravanelli Titouan Parcollet Adel Moumen Sylvain de Langen Cem Subakan Peter Plantinga Yingzhi Wang 0002 Pooneh Mousavi Luca Della Libera Artem Ploujnikov Francesco Paissan Davide Borra Salah Zaiem Zeyu Zhao 0004 Shucong Zhang Georgios Karakasidis Sung-Lin Yeh Pierre Champion Aku Rouhe Rudolf Braun Florian Mai Juan Zuluaga-Gomez Seyed Mahed Mousavi Andreas Nautsch Xuechen Liu 0001 Sangeet Sagar Jarod Duret Salima Mdhaffar Gaëlle Laperrière Mickael Rouvier Renato De Mori Yannick Estève Open-Source Conversational AI with SpeechBrain 1.0. 2024 abs/2407.00463 CoRR https://doi.org/10.48550/arXiv.2407.00463 db/journals/corr/corr2407.html#abs-2407-00463 streams/journals/corr

Salah Zaiem Titouan Parcollet Slim Essid Less Forgetting for Better Generalization: Exploring Continual-learning Fine-tuning Methods for Speech Self-supervised Representations. 2024 abs/2407.00756 CoRR https://doi.org/10.48550/arXiv.2407.00756 db/journals/corr/corr2407.html#abs-2407-00756 streams/journals/corr

Shucong Zhang Titouan Parcollet Rogier van Dalen Sourav Bhattacharya Linear-Complexity Self-Supervised Learning for Speech Processing. 2024 abs/2407.13377 CoRR https://doi.org/10.48550/arXiv.2407.13377 db/journals/corr/corr2407.html#abs-2407-13377 streams/journals/corr

Jarod Duret Yannick Estève Titouan Parcollet Analyzing Speech Unit Selection for Textless Speech-to-Speech Translation. 2024 abs/2407.18332 CoRR https://doi.org/10.48550/arXiv.2407.18332 db/journals/corr/corr2407.html#abs-2407-18332 streams/journals/corr

Ryan Whetten Titouan Parcollet Adel Moumen Marco Dinarelli Yannick Estève An Analysis of Linear Complexity Attention Substitutes with BEST-RQ. 2024 abs/2409.02596 CoRR https://doi.org/10.48550/arXiv.2409.02596 db/journals/corr/corr2409.html#abs-2409-02596 streams/journals/corr

Titouan Parcollet Rogier van Dalen Shucong Zhang Sourav Batthacharya Linear Time Complexity Conformers with SummaryMixing for Streaming Speech Recognition. 2024 abs/2409.07165 CoRR https://doi.org/10.48550/arXiv.2409.07165 db/journals/corr/corr2409.html#abs-2409-07165 streams/journals/corr

Xinchi Qiu Titouan Parcollet Javier Fernández-Marqués Pedro P. B. de Gusmao Yan Gao 0016 Daniel J. Beutel Taner Topal Akhil Mathur Nicholas D. Lane A First Look into the Carbon Footprint of Federated Learning. 129:1-129:23 2023 24 J. Mach. Learn. Res. https://jmlr.org/papers/v24/21-0445.html db/journals/jmlr/jmlr24.html#QiuPFGGBTML23

Jarod Duret Benjamin O'Brien Yannick Estève Titouan Parcollet Enhancing Expressivity Transfer in Textless Speech-to-Speech Translation. 1-8 2023 ASRU https://doi.org/10.1109/ASRU57964.2023.10389647 conf/asru/2023 db/conf/asru/asru2023.html#DuretOEP23 Adel Moumen Titouan Parcollet Stabilising and Accelerating Light Gated Recurrent Units for Automatic Speech Recognition. 1-5 2023 ICASSP https://doi.org/10.1109/ICASSP49357.2023.10095763 conf/icassp/2023 db/conf/icassp/icassp2023.html#MoumenP23 Salah Zaiem Robin Algayres Titouan Parcollet Slim Essid Mirco Ravanelli Fine-Tuning Strategies for Faster Inference Using Speech Self-Supervised Models: A Comparative Study. 1-5 2023 ICASSP Workshops https://doi.org/10.1109/ICASSPW59220.2023.10193042 conf/icassp/2023w db/conf/icassp/icassp2023w.html#ZaiemAPER23 Salah Zaiem Titouan Parcollet Slim Essid Automatic Data Augmentation for Domain Adapted Fine-Tuning of Self-Supervised Speech Representations. 67-71 2023 INTERSPEECH https://doi.org/10.21437/Interspeech.2023-1040 conf/interspeech/2023 db/conf/interspeech/interspeech2023.html#ZaiemPE23 Titouan Parcollet Shucong Zhang Rogier van Dalen Alberto Gil C. P. Ramos Sourav Bhattacharya On the (In)Efficiency of Acoustic Feature Extractors for Self-Supervised Speech Representation Learning. 581-585 2023 INTERSPEECH https://doi.org/10.21437/Interspeech.2023-1510 conf/interspeech/2023 db/conf/interspeech/interspeech2023.html#ParcolletZDRB23 Shucong Zhang Malcolm Chadwick Alberto Gil C. P. Ramos Titouan Parcollet Rogier van Dalen Sourav Bhattacharya Real-Time Personalised Speech Enhancement Transformers with Dynamic Cross-attended Speaker Representations. 804-808 2023 INTERSPEECH https://doi.org/10.21437/Interspeech.2023-1066 conf/interspeech/2023 db/conf/interspeech/interspeech2023.html#ZhangCRPDB23 Florian Mai Juan Zuluaga-Gomez Titouan Parcollet Petr Motlícek HyperConformer: Multi-head HyperMixer for Efficient Speech Recognition. 2213-2217 2023 INTERSPEECH https://doi.org/10.21437/Interspeech.2023-1611 conf/interspeech/2023 db/conf/interspeech/interspeech2023.html#MaiZPM23 Salah Zaiem Youcef Kemiche Titouan Parcollet Slim Essid Mirco Ravanelli Speech Self-Supervised Representation Benchmarking: Are We Doing it Right? 2873-2877 2023 INTERSPEECH https://doi.org/10.21437/Interspeech.2023-1087 conf/interspeech/2023 db/conf/interspeech/interspeech2023.html#ZaiemKPER23 Jarod Duret Yannick Estève Titouan Parcollet Learning Multilingual Expressive Speech Representation for Prosody Prediction without Parallel Data. 184-190 2023 SSW https://doi.org/10.21437/SSW.2023-29 conf/ssw/2023 db/conf/ssw/ssw2023.html#DuretEP23

Adel Moumen Titouan Parcollet Stabilising and accelerating light gated recurrent units for automatic speech recognition. 2023 abs/2302.10144 CoRR https://doi.org/10.48550/arXiv.2302.10144 db/journals/corr/corr2302.html#abs-2302-10144

Salah Zaiem Robin Algayres Titouan Parcollet Slim Essid Mirco Ravanelli Fine-tuning Strategies for Faster Inference using Speech Self-Supervised Models: A Comparative Study. 2023 abs/2303.06740 CoRR https://doi.org/10.48550/arXiv.2303.06740 db/journals/corr/corr2303.html#abs-2303-06740

Florian Mai Juan Zuluaga-Gomez Titouan Parcollet Petr Motlícek HyperConformer: Multi-head HyperMixer for Efficient Speech Recognition. 2023 abs/2305.18281 CoRR https://doi.org/10.48550/arXiv.2305.18281 db/journals/corr/corr2305.html#abs-2305-18281

Salah Zaiem Youcef Kemiche Titouan Parcollet Slim Essid Mirco Ravanelli Speech Self-Supervised Representation Benchmarking: Are We Doing it Right? 2023 abs/2306.00452 CoRR https://doi.org/10.48550/arXiv.2306.00452 db/journals/corr/corr2306.html#abs-2306-00452

Salah Zaiem Titouan Parcollet Slim Essid Automatic Data Augmentation for Domain Adapted Fine-Tuning of Self-Supervised Speech Representations. 2023 abs/2306.00481 CoRR https://doi.org/10.48550/arXiv.2306.00481 db/journals/corr/corr2306.html#abs-2306-00481

Jarod Duret Titouan Parcollet Yannick Estève Learning Multilingual Expressive Speech Representation for Prosody Prediction without Parallel Data. 2023 abs/2306.17199 CoRR https://doi.org/10.48550/arXiv.2306.17199 db/journals/corr/corr2306.html#abs-2306-17199

Titouan Parcollet Rogier van Dalen Shucong Zhang Sourav Bhattacharya Sumformer: A Linear-Complexity Alternative to Self-Attention for Speech Recognition. 2023 abs/2307.07421 CoRR https://doi.org/10.48550/arXiv.2307.07421 db/journals/corr/corr2307.html#abs-2307-07421

Salah Zaiem Youcef Kemiche Titouan Parcollet Slim Essid Mirco Ravanelli Speech Self-Supervised Representations Benchmarking: a Case for Larger Probing Heads. 2023 abs/2308.14456 CoRR https://doi.org/10.48550/arXiv.2308.14456 db/journals/corr/corr2308.html#abs-2308-14456

Titouan Parcollet Ha Nguyen Solène Evain Marcely Zanon Boito Adrien Pupier Salima Mdhaffar Hang Le 0001 Sina Alisamir Natalia A. Tomashenko Marco Dinarelli Shucong Zhang Alexandre Allauzen Maximin Coavoux Yannick Estève Mickael Rouvier Jérôme Goulian Benjamin Lecouteux François Portet Solange Rossato Fabien Ringeval Didier Schwab Laurent Besacier LeBenchmark 2.0: a Standardized, Replicable and Enhanced Framework for Self-supervised Representations of French Speech. 2023 abs/2309.05472 CoRR https://doi.org/10.48550/arXiv.2309.05472 db/journals/corr/corr2309.html#abs-2309-05472

Jarod Duret Benjamin O'Brien Yannick Estève Titouan Parcollet Enhancing expressivity transfer in textless speech-to-speech translation. 2023 abs/2310.07279 CoRR https://doi.org/10.48550/arXiv.2310.07279 db/journals/corr/corr2310.html#abs-2310-07279

Salah Zaiem Titouan Parcollet Slim Essid Abdelwahab Heba Pretext Tasks Selection for Multitask Self-Supervised Audio Representation Learning. 1439-1453 2022 16 IEEE J. Sel. Top. Signal Process. 6 https://doi.org/10.1109/JSTSP.2022.3195430 db/journals/jstsp/jstsp16.html#ZaiemPEH22

Yan Gao 0016 Titouan Parcollet Salah Zaiem Javier Fernández-Marqués Pedro P. B. de Gusmao Daniel J. Beutel Nicholas D. Lane End-to-End Speech Recognition from Federated Acoustic Models. 7227-7231 2022 ICASSP https://doi.org/10.1109/ICASSP43922.2022.9747161 conf/icassp/2022 db/conf/icassp/icassp2022.html#GaoPZFGBL22 Xinchi Qiu Javier Fernández-Marqués Pedro P. B. de Gusmao Yan Gao 0016 Titouan Parcollet Nicholas Donald Lane ZeroFL: Efficient On-Device Training for Federated Learning with Local Sparsity. 2022 ICLR https://openreview.net/forum?id=2sDQwC_hmnM conf/iclr/2022 db/conf/iclr/iclr2022.html#QiuFGGPL22 Salah Zaiem Titouan Parcollet Slim Essid Automatic Data Augmentation Selection and Parametrization in Contrastive Self-Supervised Speech Representation Learning. 669-673 2022 INTERSPEECH https://doi.org/10.21437/Interspeech.2022-10191 conf/interspeech/2022 db/conf/interspeech/interspeech2022.html#ZaiemPE22 Yan Gao 0016 Javier Fernández-Marqués Titouan Parcollet Abhinav Mehrotra Nicholas D. Lane Federated Self-supervised Speech Representations: Are We There Yet? 3809-3813 2022 INTERSPEECH https://doi.org/10.21437/Interspeech.2022-10644 conf/interspeech/2022 db/conf/interspeech/interspeech2022.html#GaoFPML22 Salima Mdhaffar Jarod Duret Titouan Parcollet Yannick Estève End-to-end model for named entity recognition from speech without paired training data. 4068-4072 2022 INTERSPEECH https://doi.org/10.21437/Interspeech.2022-10231 conf/interspeech/2022 db/conf/interspeech/interspeech2022.html#MdhaffarDPE22 Yan Gao 0016 Javier Fernández-Marqués Titouan Parcollet Pedro P. B. de Gusmao Nicholas D. Lane Match to Win: Analysing Sequences Lengths for Efficient Self-Supervised Learning in Speech and Audio. 115-122 2022 SLT https://doi.org/10.1109/SLT54892.2023.10023410 conf/slt/2022 db/conf/slt/slt2022.html#GaolFPGL22 Yannick Estève Tania Jiménez Titouan Parcollet Marcely Zanon Boito Actes de la 29e Conférence sur le Traitement Automatique des Langues Naturelles. Volume 1 : conférence principale, TALN-RECITAL 2022, Avignon, France, June 27 - July 1, 2022 TALN-RECITAL ATALA 2022 https://aclanthology.org/volumes/2022.jeptalnrecital-taln/ db/conf/taln/taln2022-1.html

Salima Mdhaffar Jarod Duret Titouan Parcollet Yannick Estève End-to-end model for named entity recognition from speech without paired training data. 2022 abs/2204.00803 CoRR https://doi.org/10.48550/arXiv.2204.00803 db/journals/corr/corr2204.html#abs-2204-00803

Yan Gao 0016 Javier Fernández-Marqués Titouan Parcollet Abhinav Mehrotra Nicholas D. Lane Federated Self-supervised Speech Representations: Are We There Yet? 2022 abs/2204.02804 CoRR https://doi.org/10.48550/arXiv.2204.02804 db/journals/corr/corr2204.html#abs-2204-02804

Salah Zaiem Titouan Parcollet Slim Essid Automatic Data Augmentation Selection and Parametrization in Contrastive Self-Supervised Speech Representation Learning. 2022 abs/2204.04170 CoRR https://doi.org/10.48550/arXiv.2204.04170 db/journals/corr/corr2204.html#abs-2204-04170

Xinchi Qiu Javier Fernández-Marqués Pedro Porto Buarque de Gusmão Yan Gao 0016 Titouan Parcollet Nicholas Donald Lane ZeroFL: Efficient On-Device Training for Federated Learning with Local Sparsity. 2022 abs/2208.02507 CoRR https://doi.org/10.48550/arXiv.2208.02507 db/journals/corr/corr2208.html#abs-2208-02507

Yan Gao 0016 Javier Fernández-Marqués Titouan Parcollet Pedro P. B. de Gusmao Nicholas D. Lane Match to Win: Analysing Sequences Lengths for Efficient Self-supervised Learning in Speech and Audio. 2022 abs/2209.15575 CoRR https://doi.org/10.48550/arXiv.2209.15575 db/journals/corr/corr2209.html#abs-2209-15575

Yan Gao 0016 Titouan Parcollet Nicholas D. Lane Distilling Knowledge from Ensembles of Acoustic Models for Joint CTC-Attention End-to-End Speech Recognition. 138-145 2021 ASRU https://doi.org/10.1109/ASRU51503.2021.9688302 conf/asru/2021 db/conf/asru/asru2021.html#GaoPL21 Solène Evain Ha Nguyen Hang Le 0001 Marcely Zanon Boito Salima Mdhaffar Sina Alisamir Ziyi Tong Natalia A. Tomashenko Marco Dinarelli Titouan Parcollet Alexandre Allauzen Yannick Estève Benjamin Lecouteux François Portet Solange Rossato Fabien Ringeval Didier Schwab Laurent Besacier <i>LeBenchmark</i>: A Reproducible Framework for Assessing Self-Supervised Representation Learning from Speech. 1439-1443 2021 Interspeech https://doi.org/10.21437/Interspeech.2021-556 conf/interspeech/2021 db/conf/interspeech/interspeech2021.html#EvainNLBMATTDPA21 Paul-Gauthier Noé Mohammad MohammadAmini Driss Matrouf Titouan Parcollet Andreas Nautsch Jean-François Bonastre Adversarial Disentanglement of Speaker Representation for Attribute-Driven Privacy Preservation. 1902-1906 2021 Interspeech https://doi.org/10.21437/Interspeech.2021-1712 conf/interspeech/2021 db/conf/interspeech/interspeech2021.html#NoeMMPNB21 Salah Zaiem Titouan Parcollet Slim Essid Conditional Independence for Pretext Task Selection in Self-Supervised Speech Representation Learning. 2851-2855 2021 Interspeech https://doi.org/10.21437/Interspeech.2021-1027 conf/interspeech/2021 db/conf/interspeech/interspeech2021.html#ZaiemPE21 Titouan Parcollet Mirco Ravanelli The Energy and Carbon Footprint of Training End-to-End Speech Recognizers. 4583-4587 2021 Interspeech https://doi.org/10.21437/Interspeech.2021-456 conf/interspeech/2021 db/conf/interspeech/interspeech2021.html#ParcolletR21 Solène Evain Ha Nguyen Hang Le 0001 Marcely Zanon Boito Salima Mdhaffar Sina Alisamir Ziyi Tong Natalia A. Tomashenko Marco Dinarelli Titouan Parcollet Alexandre Allauzen Yannick Estève Benjamin Lecouteux François Portet Solange Rossato Fabien Ringeval Didier Schwab Laurent Besacier Task Agnostic and Task Specific Self-Supervised Learning from Speech with LeBenchmark. 2021 NeurIPS Datasets and Benchmarks https://datasets-benchmarks-proceedings.neurips.cc/paper/2021/hash/b3e3e393c77e35a4a3f3cbd1e429b5dc-Abstract-round2.html conf/nips/2021db db/conf/nips/neurips2021db.html#EvainNLBMATTDPA21 Loren Lugosch Piyush Papreja Mirco Ravanelli Abdelwahab Heba Titouan Parcollet Timers and Such: A Practical Benchmark for Spoken Language Understanding with Numbers. 2021 NeurIPS Datasets and Benchmarks https://datasets-benchmarks-proceedings.neurips.cc/paper/2021/hash/34173cb38f07f89ddbebc2ac9128303f-Abstract-round1.html conf/nips/2021db db/conf/nips/neurips2021db.html#LugoschPRHP21

Xinchi Qiu Titouan Parcollet Javier Fernández-Marqués Pedro Porto Buarque de Gusmão Daniel J. Beutel Taner Topal Akhil Mathur Nicholas D. Lane A first look into the carbon footprint of federated learning. 2021 abs/2102.07627 CoRR https://arxiv.org/abs/2102.07627 db/journals/corr/corr2102.html#abs-2102-07627

Loren Lugosch Piyush Papreja Mirco Ravanelli Abdelwahab Heba Titouan Parcollet Timers and Such: A Practical Benchmark for Spoken Language Understanding with Numbers. 2021 abs/2104.01604 CoRR https://arxiv.org/abs/2104.01604 db/journals/corr/corr2104.html#abs-2104-01604

Akhil Mathur Daniel J. Beutel Pedro Porto Buarque de Gusmão Javier Fernández-Marqués Taner Topal Xinchi Qiu Titouan Parcollet Yan Gao 0016 Nicholas D. Lane On-device Federated Learning with Flower. 2021 abs/2104.03042 CoRR https://arxiv.org/abs/2104.03042 db/journals/corr/corr2104.html#abs-2104-03042

Salah Zaiem Titouan Parcollet Slim Essid Conditional independence for pretext task selection in Self-supervised speech representation learning. 2021 abs/2104.07388 CoRR https://arxiv.org/abs/2104.07388 db/journals/corr/corr2104.html#abs-2104-07388

Solène Evain Ha Nguyen Hang Le 0001 Marcely Zanon Boito Salima Mdhaffar Sina Alisamir Ziyi Tong Natalia A. Tomashenko Marco Dinarelli Titouan Parcollet Alexandre Allauzen Yannick Estève Benjamin Lecouteux François Portet Solange Rossato Fabien Ringeval Didier Schwab Laurent Besacier LeBenchmark: A Reproducible Framework for Assessing Self-Supervised Representation Learning from Speech. 2021 abs/2104.11462 CoRR https://arxiv.org/abs/2104.11462 db/journals/corr/corr2104.html#abs-2104-11462

Yan Gao 0016 Titouan Parcollet Javier Fernández-Marqués Pedro P. B. de Gusmao Daniel J. Beutel Nicholas D. Lane End-to-End Speech Recognition from Federated Acoustic Models. 2021 abs/2104.14297 CoRR https://arxiv.org/abs/2104.14297 db/journals/corr/corr2104.html#abs-2104-14297

Mirco Ravanelli Titouan Parcollet Peter Plantinga Aku Rouhe Samuele Cornell Loren Lugosch Cem Subakan Nauman Dawalatabad Abdelwahab Heba Jianyuan Zhong Ju-Chieh Chou Sung-Lin Yeh Szu-Wei Fu Chien-Feng Liao Elena Rastorgueva François Grondin William Aris Hwidong Na Yan Gao 0016 Renato De Mori Yoshua Bengio SpeechBrain: A General-Purpose Speech Toolkit. 2021 abs/2106.04624 CoRR https://arxiv.org/abs/2106.04624 db/journals/corr/corr2106.html#abs-2106-04624

Salah Zaiem Titouan Parcollet Slim Essid Pretext Tasks selection for multitask self-supervised speech representation learning. 2021 abs/2107.00594 CoRR https://arxiv.org/abs/2107.00594 db/journals/corr/corr2107.html#abs-2107-00594

Titouan Parcollet Mohamed Morchid Georges Linarès A survey of quaternion neural networks. 2957-2982 2020 53 Artif. Intell. Rev. 4 https://doi.org/10.1007/s10462-019-09752-1 https://www.wikidata.org/entity/Q127354042 db/journals/air/air53.html#ParcolletML20

Titouan Parcollet Mohamed Morchid Xavier Bost Georges Linarès Renato De Mori Real to H-Space Autoencoders for Theme Identification in Telephone Conversations. 198-210 2020 28 IEEE ACM Trans. Audio Speech Lang. Process. https://doi.org/10.1109/TASLP.2019.2950596 db/journals/taslp/taslp28.html#ParcolletMBLM20

Titouan Parcollet Mohamed Morchid Georges Linarès E2E-SINCNET: Toward Fully End-To-End Speech Recognition. 7714-7718 2020 ICASSP https://doi.org/10.1109/ICASSP40776.2020.9053954 conf/icassp/2020 db/conf/icassp/icassp2020.html#ParcolletML20 Paul-Gauthier Noé Titouan Parcollet Mohamed Morchid CGCNN: Complex Gabor Convolutional Neural Network on Raw Speech. 7724-7728 2020 ICASSP https://doi.org/10.1109/ICASSP40776.2020.9054220 conf/icassp/2020 db/conf/icassp/icassp2020.html#NoePM20 Xinchi Qiu Titouan Parcollet Mirco Ravanelli Nicholas D. Lane Mohamed Morchid Quaternion Neural Networks for Multi-Channel Distant Speech Recognition. 329-333 2020 INTERSPEECH https://doi.org/10.21437/Interspeech.2020-1682 conf/interspeech/2020 db/conf/interspeech/interspeech2020.html#QiuPRLM20 Titouan Parcollet Xinchi Qiu Nicholas D. Lane FusionRNN: Shared Neural Parameters for Multi-Channel Distant Speech Recognition. 1678-1682 2020 INTERSPEECH https://doi.org/10.21437/Interspeech.2020-2102 conf/interspeech/2020 db/conf/interspeech/interspeech2020.html#ParcolletQL20

Paul-Gauthier Noé Titouan Parcollet Mohamed Morchid CGCNN: Complex Gabor Convolutional Neural Network on raw speech. 2020 abs/2002.04569 CoRR https://arxiv.org/abs/2002.04569 db/journals/corr/corr2002.html#abs-2002-04569

Xinchi Qiu Titouan Parcollet Mirco Ravanelli Nicholas D. Lane Mohamed Morchid Quaternion Neural Networks for Multi-channel Distant Speech Recognition. 2020 abs/2005.08566 CoRR https://arxiv.org/abs/2005.08566 db/journals/corr/corr2005.html#abs-2005-08566

Yan Gao 0016 Titouan Parcollet Nicholas D. Lane Distilling Knowledge from Ensembles of Acoustic Models for Joint CTC-Attention End-to-End Speech Recognition. 2020 abs/2005.09310 CoRR https://arxiv.org/abs/2005.09310 db/journals/corr/corr2005.html#abs-2005-09310

Daniel J. Beutel Taner Topal Akhil Mathur Xinchi Qiu Titouan Parcollet Nicholas D. Lane Flower: A Friendly Federated Learning Research Framework. 2020 abs/2007.14390 CoRR https://arxiv.org/abs/2007.14390 db/journals/corr/corr2007.html#abs-2007-14390

Xinchi Qiu Titouan Parcollet Daniel J. Beutel Taner Topal Akhil Mathur Nicholas D. Lane A first look into the carbon footprint of federated learning. 2020 abs/2010.06537 CoRR https://arxiv.org/abs/2010.06537 db/journals/corr/corr2010.html#abs-2010-06537

Paul-Gauthier Noé Mohammad MohammadAmini Driss Matrouf Titouan Parcollet Jean-François Bonastre Adversarial Disentanglement of Speaker Representation for Attribute-Driven Privacy Preservation. 2020 abs/2012.04454 CoRR https://arxiv.org/abs/2012.04454 db/journals/corr/corr2012.html#abs-2012-04454

Titouan Parcollet Quaternion neural networks. (Réseaux de neurones fondés sur l'algèbre des quaternions). 2019 University of Avignon, France https://tel.archives-ouvertes.fr/tel-02884252 Titouan Parcollet Mohamed Morchid Georges Linarès Réseaux de neurones convolutifs de quaternions pour l'identification de thèmes de conversations téléphoniques. 2019 CORIA https://doi.org/10.24348/coria.2019.CORIA_2019_paper_21 conf/coria/2019 db/conf/coria/coria2019.html#ParcolletML19 Mirco Ravanelli Titouan Parcollet Yoshua Bengio The Pytorch-kaldi Speech Recognition Toolkit. 6465-6469 2019 ICASSP https://doi.org/10.1109/ICASSP.2019.8683713 conf/icassp/2019 db/conf/icassp/icassp2019.html#RavanelliPB19 Titouan Parcollet Mohamed Morchid Georges Linarès Quaternion Convolutional Neural Networks for Heterogeneous Image Processing. 8514-8518 2019 ICASSP https://doi.org/10.1109/ICASSP.2019.8682495 conf/icassp/2019 db/conf/icassp/icassp2019.html#ParcolletML19 Titouan Parcollet Mohamed Morchid Georges Linarès Renato De Mori Bidirectional Quaternion Long Short-term Memory Recurrent Neural Networks for Speech Recognition. 8519-8523 2019 ICASSP https://doi.org/10.1109/ICASSP.2019.8683583 conf/icassp/2019 db/conf/icassp/icassp2019.html#ParcolletMLM19 Titouan Parcollet Mirco Ravanelli Mohamed Morchid Georges Linarès Chiheb Trabelsi Renato De Mori Yoshua Bengio Quaternion Recurrent Neural Networks. 2019 ICLR (Poster) https://openreview.net/forum?id=ByMHvs0cFQ conf/iclr/2019 db/conf/iclr/iclr2019.html#ParcolletRMLTMB19 Titouan Parcollet Mohamed Morchid Xavier Bost Georges Linarès M2H-GAN: A GAN-Based Mapping from Machine to Human Transcripts for Speech Understanding. 804-808 2019 INTERSPEECH https://doi.org/10.21437/Interspeech.2019-2662 conf/interspeech/2019 db/conf/interspeech/interspeech2019.html#ParcolletMBL19 Titouan Parcollet Mohamed Morchid Georges Linarès Renato De Mori Real to H-Space Encoder for Speech Recognition. 4415-4419 2019 INTERSPEECH https://doi.org/10.21437/Interspeech.2019-1539 conf/interspeech/2019 db/conf/interspeech/interspeech2019.html#ParcolletMLM19

Titouan Parcollet Mohamed Morchid Xavier Bost Georges Linarès M2H-GAN: A GAN-based Mapping from Machine to Human Transcripts for Speech Understanding. 2019 abs/1905.01957 CoRR http://arxiv.org/abs/1905.01957 db/journals/corr/corr1905.html#abs-1905-01957

Titouan Parcollet Mohamed Morchid Georges Linarès Renato De Mori Real to H-space Encoder for Speech Recognition. 2019 abs/1906.08043 CoRR http://arxiv.org/abs/1906.08043 db/journals/corr/corr1906.html#abs-1906-08043

Titouan Parcollet Ying Zhang 0033 Mohamed Morchid Chiheb Trabelsi Georges Linarès Renato de Mori Yoshua Bengio Quaternion Convolutional Neural Networks for End-to-End Automatic Speech Recognition. 22-26 2018 INTERSPEECH https://doi.org/10.21437/Interspeech.2018-1898 conf/interspeech/2018 db/conf/interspeech/interspeech2018.html#ParcolletZMTLMB18 Titouan Parcollet Mohamed Morchid Georges Linarès Renato De Mori Quaternion Convolutional Neural Networks For Theme Identification Of Telephone Conversations. 685-691 2018 SLT https://doi.org/10.1109/SLT.2018.8639676 conf/slt/2018 db/conf/slt/slt2018.html#ParcolletMLM18

Titouan Parcollet Mirco Ravanelli Mohamed Morchid Georges Linarès Chiheb Trabelsi Renato De Mori Yoshua Bengio Quaternion Recurrent Neural Networks. 2018 abs/1806.04418 CoRR http://arxiv.org/abs/1806.04418 db/journals/corr/corr1806.html#abs-1806-04418

Titouan Parcollet Ying Zhang 0033 Mohamed Morchid Chiheb Trabelsi Georges Linarès Renato De Mori Yoshua Bengio Quaternion Convolutional Neural Networks for End-to-End Automatic Speech Recognition. 2018 abs/1806.07789 CoRR http://arxiv.org/abs/1806.07789 db/journals/corr/corr1806.html#abs-1806-07789

Titouan Parcollet Mohamed Morchid Georges Linarès Renato De Mori Bidirectional Quaternion Long-Short Term Memory Recurrent Neural Networks for Speech Recognition. 2018 abs/1811.02566 CoRR http://arxiv.org/abs/1811.02566 db/journals/corr/corr1811.html#abs-1811-02566

Titouan Parcollet Mohamed Morchid Georges Linarès Quaternion Convolutional Neural Networks for Heterogeneous Image Processing. 2018 abs/1811.02656 CoRR http://arxiv.org/abs/1811.02656 db/journals/corr/corr1811.html#abs-1811-02656

Mirco Ravanelli Titouan Parcollet Yoshua Bengio The PyTorch-Kaldi Speech Recognition Toolkit. 2018 abs/1811.07453 CoRR http://arxiv.org/abs/1811.07453 db/journals/corr/corr1811.html#abs-1811-07453

Titouan Parcollet Mirco Ravanelli Mohamed Morchid Georges Linarès Renato De Mori Speech recognition with quaternion neural networks. 2018 abs/1811.09678 CoRR http://arxiv.org/abs/1811.09678 db/journals/corr/corr1811.html#abs-1811-09678

Titouan Parcollet Mohamed Morchid Georges Linarès Deep quaternion neural networks for spoken language understanding. 504-511 2017 ASRU https://doi.org/10.1109/ASRU.2017.8268978 conf/asru/2017 db/conf/asru/asru2017.html#ParcolletML17 Titouan Parcollet Mohamed Morchid Georges Linarès Réseaux de neurones de quaternions pour le traitement du langage. 297-310 2017 CORIA https://doi.org/10.24348/coria.2017.31 conf/coria/2017 db/conf/coria/coria2017.html#ParcolletML17 Titouan Parcollet Mohamed Morchid Georges Linarès Quaternion Denoising Encoder-Decoder for Theme Identification of Telephone Conversations. 3325-3328 2017 INTERSPEECH https://doi.org/10.21437/Interspeech.2017-1029 conf/interspeech/2017 db/conf/interspeech/interspeech2017.html#ParcolletML17 Titouan Parcollet Mohamed Morchid Pierre-Michel Bousquet Richard Dufour Georges Linarès Renato De Mori Quaternion Neural Networks for Spoken Language Understanding. 362-368 2016 SLT https://doi.org/10.1109/SLT.2016.7846290 conf/slt/2016 db/conf/slt/slt2016.html#ParcolletMBDLM16 Richard Dufour Mohamed Morchid Titouan Parcollet Tracking dialog states using an Author-Topic based representation. 544-551 2016 SLT https://doi.org/10.1109/SLT.2016.7846316 conf/slt/2016 db/conf/slt/slt2016.html#DufourMP16 Robin Algayres Sina Alisamir Alexandre Allauzen William Aris Sourav Batthacharya Yoshua Bengio Laurent Besacier Daniel J. Beutel Sourav Bhattacharya Marcely Zanon Boito Jean-François Bonastre Davide Borra Xavier Bost Pierre-Michel Bousquet Rudolf Braun Malcolm Chadwick Pierre Champion Ju-Chieh Chou Maximin Coavoux Samuele Cornell Rogier C. van DalenRogier van Dalen Nauman Dawalatabad Marco Dinarelli Richard Dufour Jarod Duret Slim Essid Yannick Estève Solène Evain Javier Fernández-Marqués Szu-Wei Fu Yan Gao 0016 Jérôme Goulian François Grondin Pedro Porto Buarque de GusmãoPedro P. B. de Gusmao Abdelwahab Heba Tania Jiménez Georgios Karakasidis Youcef Kemiche Nicholas D. LaneNicholas Donald Lane Sylvain de Langen Gaëlle Laperrière Hang Le 0001 Benjamin Lecouteux Chien-Feng Liao Luca Della Libera Georges Linarès Xuechen Liu 0001 Loren Lugosch Florian Mai Lucas Maison Akhil Mathur Driss Matrouf Salima Mdhaffar Abhinav Mehrotra Mohammad MohammadAmini Mohamed Morchid Renato De MoriRenato de Mori Petr Motlícek Adel Moumen Pooneh Mousavi Seyed Mahed Mousavi Hwidong Na Andreas Nautsch Ha Nguyen Paul-Gauthier Noé Benjamin O'Brien Francesco Paissan Piyush Papreja Peter Plantinga Artem Ploujnikov François Portet Adrien Pupier Xinchi Qiu Alberto Gil C. P. Ramos Elena Rastorgueva Mirco Ravanelli Fabien Ringeval Solange Rossato Aku Rouhe Mickael Rouvier Sangeet Sagar Didier Schwab Cem Subakan Natalia A. Tomashenko Ziyi Tong Taner Topal Chiheb Trabelsi Yuan Tseng Yingzhi Wang 0002 Ryan Whetten Sung-Lin Yeh Mohamed Salah ZaïemSalah Zaiem Shucong Zhang Ying Zhang 0033 Zeyu Zhao 0004 Jianyuan Zhong Juan Zuluaga-Gomez