Distinguished Research Scientist
Speech & Audio Senior Team Leader

Mitsubishi Electric Research Laboratories (MERL)
Speech & Audio Group
201 Broadway, 8th Floor
Cambridge, MA 02139, USA
E-mail:

新着情報

• 2024年1月1日付けで「IEEEフェロー」に昇格しました。
• SANE 2023 を１０月２６日にNYUのBrooklynキャンパスにてJuan Bello 先生(NYU) と John Hershey と一緒に主催することになしました。
• Interspeech 2023にてMulti-talker methods in Speech ProcessingのSpecial SessionをPeter Bell, Michael Akeroyd, Jon Barker, Marc Delcroix, Liang Lu, Jinyu Li, Cassia Valentini, DeLiang Wang と共同主催しています。16件の論文がAcceptされました。
• Darius Petermannの論文 "Hyperbolic Audio Source Separation" がICASSP 2023 の Best Student Paper Award を受賞しました。アルゴリズムとデモインタフェースのコードを Github にて公開しています： Hyper-Unmix。
• CMU-MERL の共同チームが DCASE 2023 Challenge Task 6A "Automated Audio Captioning"のトップランクを取りました。
• 2023年3月～6月までTélécom ParisのGaël Richard先生のチームで招待研究員として研究していました。

研究分野

MERLでは、主に音声強調や音源分離のための音響信号処理の研究に従事しています。音響モデル、言語モデル、トピックモデル、自然言語処理、対話システム、ユーザ行動予測等々、音声処理のあらゆる側面を含めたSpeech and Audio teamの他のプロジェクトにも積極的に参加しています。

博士課程やポスドク時代では、雑音中の単一話者や複数話者のピッチ推定、スペクトログラムの無矛盾性を考慮した信号処理、振幅スペクトログラムからの高速時系列復元、調波構造拘束つき混合正規分布モデルや非負値行列因子分解（NMF）のさまざまな拡張を用いたモデル・ベース音源分離についての研究を行っていました。

研究業績

お願い: 引用の際、BibTeXをご使用の場合は名前を Le Roux, Jonathan または Jonathan {Le Roux} と書いていただくようお願い申し上げます。

• 学術論文

  Stefan Uhlich, Giorgio Fabbro, Masato Hirano, Shusuke Takahashi, Gordon Wichern, Jonathan Le Roux, Dipam Chakraborty, Sharada Mohanty, Kai Li, Yi Luo, Jianwei Yu, Rongzhi Gu, Roman Solovyev, Alexander Stempkovskiy, Tatiana Habruseva, Mikhail Sukhovei, Yuki Mitsufuji, "The Sound Demixing Challenge 2023 - Cinematic Demixing Track," in Transactions of the International Society for Music Information Retrieval, 2024. Christoph Boeddeker, Aswin Shanmugam Subramanian, Gordon Wichern, Reinhold Haeb-Umbach, Jonathan Le Roux, "TS-SEP: Joint Diarization and Separation Conditioned on Estimated Speaker Embeddings," in IEEE/ACM Transactions on Audio, Speech, and Language Processing, 2024. [arXiv]. Darius Petermann, Gordon Wichern, Aswin Shanmugam Subramanian, Zhong-Qiu Wang, Jonathan Le Roux, "Tackling the Cocktail Fork Problem for Separation and Transcription of Real-World Soundtracks," in IEEE/ACM Transactions on Audio, Speech, and Language Processing, 2023. [arXiv]. Zhong-Qiu Wang, Gordon Wichern, Shinji Watanabe, Jonathan Le Roux, "STFT-Domain Neural Speech Enhancement with Very Low Algorithmic Latency," in IEEE/ACM Transactions on Audio, Speech, and Language Processing, Nov. 2022. [arXiv]. Yosuke Higuchi, Niko Moritz, Jonathan Le Roux, Takaaki Hori, "Momentum Pseudo-Labeling: Semi-Supervised ASR with Continuously Improving Pseudo-Labels," in IEEE Journal of Selected Topics in Signal Processing, Vol. 16, No. 6, pp. 1424-1438, Sep. 2022. [pdf]. Zhong-Qiu Wang, Gordon Wichern, Jonathan Le Roux, "Convolutive Prediction for Monaural Speech Dereverberation and Noisy-Reverberant Speaker Separation," in IEEE/ACM Transactions on Audio, Speech, and Language Processing, Nov. 2021. [arXiv]. Zhong-Qiu Wang, Gordon Wichern, Jonathan Le Roux, "On The Compensation Between Magnitude and Phase in Speech Separation," in IEEE Signal Processing Letters. [arXiv]. Chiori Hori, Masato Tsuchiya, Siheng Chen, Anoop Cherian, Takaaki Hori, Bret Harsham, tim K. Marks, Jonathan Le Roux, Anthony Vetro, "Scene-aware Interaction Technology Based on Multimodal Sensing Information," in Society of Automotive Engineers of Japan, May 2021. [.pdf] (in Japanese) Fatemeh Pishdadian, Gordon Wichern, Jonathan Le Roux, "Finding Strength in Weakness: Learning to Separate Sounds with Weak Supervision," in IEEE/ACM Transactions on Audio, Speech, and Language Processing, Vol. 28, pp. 2386–2399, Sep. 2020. [arXiv] Ryo Aihara, Gordon Wichern, Jonathan Le Roux, "Deep Clustering-based Single Channel Speech Separation and Recent Advances," in Acoustical Science and Technology, Vol. 41, No. 2, pp. 465–471, Mar. 2020. 相原龍, ウィシャーン・ゴードン, ルルー・ジョナトン, "Deep clusteringによるシングルチャネル音源分離とらその発展," in 音響学会誌, Feb. 2020. Jonathan Le Roux, Gordon Wichern, Shinji Watanabe, Andy Sarroff, John R. Hershey, "Phasebook and Friends: Leveraging Discrete Representations for Source Separation," in IEEE Journal of Selected Topics in Signal Processing, Special Issue on Data Science: Machine Learning for Audio Signal Processing, May 2019. [.bib] [arXiv] Tomoki Hayashi, Shinji Watanabe, Tomoki Toda, Takaaki Hori, Jonathan Le Roux, Kazuya Takeda, "Duration-Controlled LSTM for Polyphonic Sound Event Detection," in IEEE/ACM Transactions on Audio, Speech and Language Processing, vol. 25, no. 11, pp. 2059–2070, Nov. 2017. [.bib] Takaaki Hori, Zhuo Chen, Hakan Erdogan, John R. Hershey, Jonathan Le Roux, Vikramjit Mitra, Shinji Watanabe, "Multi-Microphone Speech Recognition Integrating Beamforming, Robust Feature Extraction, and Advanced DNN/RNN Backend," in Computer Speech & Language, vol. 46, pp. 401–418, Nov. 2017. [.bib] Yuuki Tachioka, Shinji Watanabe, Jonathan Le Roux, John R. Hershey, "Prior-based binary masking and discriminative methods for reverberant and noisy speech recognition using distant stereo microphones," Journal of Information Processing , Vol. 25, pp. 407–416, Jun. 2017. [.bib] 太刀岡勇気, 渡部晋治, ルルー・ジョナトン, ハーシー・ジョン, "低ランクDNN音響モデルの騒音下音声認識での評価と系列の識別学習," 情報処理学会論文誌, Vol. 57, No. 3, pp. 1080–1088, Mar. 2016. [.pdf] [.bib] Timo Gerkmann, Martin Krawczyk-Becker and Jonathan Le Roux, "Phase Processing for Single-Channel Speech Enhancement: History and recent advances," IEEE Signal Processing Magazine, Vol. 32, No. 2, Mar. 2015. (Obligatory IEEE Copyright Notice) [.pdf] [.bib] Jonathan Le Roux and Emmanuel Vincent, "Consistent Wiener Filtering for Audio Source Separation," IEEE Signal Processing Letters, Vol. 20, No. 3, Mar. 2013. (Obligatory IEEE Copyright Notice) [.pdf] [.bib] [code] Jonathan Le Roux, Hirokazu Kameoka, Nobutaka Ono, Alain de Cheveigné and Shigeki Sagayama, "Computational Auditory Induction as a Missing-Data Model-Fitting Problem with Bregman Divergence," Speech Communication (Special issue on Perceptual and Statistical Audition), Vol. 53, Issue 5, pp. 658–676, May-June 2011. ScienceDirect (DOI Link). [.pdf] [.bib] Jonathan Le Roux, Hirokazu Kameoka, Nobutaka Ono, Alain de Cheveigné and Shigeki Sagayama, "Single and Multiple F0 Contour Estimation through Parametric Spectrogram Modeling of Speech in Noisy Environments," IEEE Transactions on Audio, Speech and Language Processing, Vol. 15, No. 4, pp. 1135–1145, May 2007. (Obligatory IEEE Copyright Notice) [.pdf] [.bib] Erik McDermott, Timothy J. Hazen, Jonathan Le Roux, Atsushi Nakamura and Shigeru Katagiri, "Discriminative Training for Large Vocabulary Speech Recognition using Minimum Classification Error," IEEE Transactions on Audio, Speech and Language Processing, Vol. 15, No. 1, pp. 203–223, Jan. 2007. (Obligatory IEEE Copyright Notice) [.pdf] [.bib]

• 書籍

  John Hershey, Jonathan Le Roux, Shinji Watanabe, Scott Wisdom, Zhuo Chen, Yusuf Isik, "Novel deep architectures in speech processing," in New Era for Robust Speech Recognition: Exploiting Deep Learning, S. Watanabe, M. Delcroix, F. Metze, J. R. Hershey, Eds. Springer, 2017. Hakan Erdogan, John Hershey, Shinji Watanabe, Jonathan Le Roux, "Deep recurrent networks for separation and recognition of single-channel speech in non-stationary background audio," in New Era for Robust Speech Recognition: Exploiting Deep Learning, S. Watanabe, M. Delcroix, F. Metze, J. R. Hershey, Eds. Springer, 2017. John R. Hershey, Steven J. Rennie, and Jonathan Le Roux, "Factorial Models for Noise Robust Speech Recognition," in: Techniques for Noise Robustness in Automatic Speech Recognition, T. Virtanen, R. Singh, and B. Raj, Eds. Wiley. [.pdf], [.bib] [Amazon] Nobutaka Ono, Kenichi Miyamoto, Hirokazu Kameoka, Jonathan Le Roux, Yuuki Uchiyama, Emiru Tsunoo, Takuya Nishimoto and Shigeki Sagayama, "Harmonic and Percussive Sound Separation and Its Application to MIR-Related Tasks," in Advances in Music Information Retrieval, ser. Studies in Computational Intelligence, Z. W. Ras and A. Wieczorkowska, Eds. Springer, 2010, vol. 274, pp. 213–236. [.bib]

• 国際会議論文(査読あり)

  Chang-Bin Jeon, Gordon Wichern, François G. Germain, Jonathan Le Roux, "Why does music source separation benefit from cacophony?," in IEEE ICASSP Satellite Workshop on Explainable Machine Learning for Speech and Audio (XAI-SA), IEEEXplore Track, Apr. 2024. Junghyun Koo, Gordon Wichern, François G. Germain, Sameer Khurana, Jonathan Le Roux, "Understanding and Controlling Generative Music Transformers by Probing Individual Attention Heads," in IEEE ICASSP Satellite Workshop on Explainable Machine Learning for Speech and Audio (XAI-SA), Workshop Track, Apr. 2024. Zexu Pan, Gordon Wichern, François G. Germain, Aswin Subramanian, Jonathan Le Roux, "Late Audio-Visual Fusion for In-The-Wild Speaker Diarization," in Hands-free Speech Communication and Microphone Arrays (HSCMA), Apr. 2024. [arXiv]. Shih-Lun Wu, Xuankai Chang, Gordon Wichern, Jee-weon Jung, François G. Germain, Jonathan Le Roux, Shinji Watanabe, "Improving Audio Captioning Models with Fine-grained Audio Features, Text Embedding Supervision, and LLM Mix-up Augmentation," in Proc. IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP), Apr. 2024. Yoshiki Masuyama, Gordon Wichern, François G. Germain, Zexu Pan, Sameer Khurana, Chiori Hori, Jonathan Le Roux, "NIIRF: Neural IIR Filter Field for HRTF Upsampling and Personalization," in Proc. IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP), Apr. 2024. [Github] Zexu Pan, Gordon Wichern, François G. Germain, Sameer Khurana, Jonathan Le Roux, "NeuroHeed+: Improving Neuro-steered Speaker Extraction with Joint Auditory Attention Detection," in Proc. IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP), Apr. 2024. Dimitrios Bralios, Gordon Wichern, François G. Germain, Zexu Pan, Sameer Khurana, Chiori Hori, Jonathan Le Roux, "Generation or Replication: Auscultating Audio Latent Diffusion Models," in Proc. IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP), Apr. 2024. Chiori Hori, Pu Wang, Mahbub Rahman, Cristian Vaca-Rubio, Sameer Khurana, Anoop Cherian, Jonathan Le Roux, "Wi-Fi based Indoor Monitoring Enhanced by Multimodal Fusion," in Proc. IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP), Apr. 2024. Teysir Baoueb, Haocheng Liu, Mathieu Fontaine, Jonathan Le Roux, Gaël Richard, "SpecDiff-GAN: A Spectrally-Shaped Noise Diffusion GAN for Speech and Music Synthesis," in Proc. IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP), Apr. 2024. Haocheng Liu, Teysir Baoueb, Mathieu Fontaine, Jonathan Le Roux, Gaël Richard, "GLA-Grad: A Griffin-Lim Extended Waveform Generation Diffusion Model," in Proc. IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP), Apr. 2024. Zexu Pan, Gordon Wichern, Yoshiki Masuyama, Francois Germain, Sameer Khurana, Chiori Hori, Jonathan Le Roux, "Scenario-Aware Audio-Visual TF-GridNet for Target Speech Extraction," in Proc. IEEE Automatic Speech Recognition and Understanding Workshop (ASRU), Dec. 2023. Shih-Lun Wu, Xuankai Chang, Gordon Wichern, Jee-weon Jung, François G Germain, Jonathan Le Roux, Shinji Watanabe, "On the Use of Pretrained Deep Audio Encoders for Automated Audio Captioning Tasks," in Proc. International Symposium on Future Active Safety Technology toward zero traffic accidents (FAST-zero), Nov. 2023. Francois Germain, Gordon Wichern, Jonathan Le Roux, "Hyperbolic Unsupervised Anomalous Sound Detection," in Proc. IEEE Workshop on Applications of Signal Processing to Audio and Acoustics (WASPAA), Oct. 2023. Ricardo Falcon Perez, Gordon Wichern, Francois Germain, Jonathan Le Roux, "Location as Supervision for Weakly Supervised Multi-Channel Source Separation of Machine Sounds," in Proc. IEEE Workshop on Applications of Signal Processing to Audio and Acoustics (WASPAA), Oct. 2023. Chiori Hori, Puyuang Peng, David Harwath, Xinyu Liu, Kei Ota, Siddarth Jain, Radu Corcodel, Devesh K. Jha, Diego Romeres, Jonathan Le Roux, "Style-transfer based Spoken Language understanding for Robot Action Sequence Acquisition from Videos," in Proc. ISCA Interspeech, Aug. 2023. Ke Chen, Gordon Wichern, Francois Germain, Jonathan Le Roux, "Pac-HuBERT: Self-Supervised Music Source Separation via Hidden-Unit BERT and Primitive Auditory Features," in Proc. IEEE ICASSP Satellite Workshop on Self-supervision in Audio, Speech and Beyond (SASB), Jun. 2023. [arXiv] Darius Petermann, Gordon Wichern, Aswin Subramanian, Jonathan Le Roux, "Hyperbolic Audio Source Separation," in Proc. IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP), Jun. 2023. [arXiv] [Github] (Best Student Paper Award) Rohith Aralikatti, Christoph Boeddeker, Gordon Wichern, Aswin Subramanian, Jonathan Le Roux, "Reverberation as Supervision for Speech Separation," in Proc. IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP), Jun. 2023. [arXiv] Efthymios Tzinis, Gordon Wichern, Paris Smaragdis, Jonathan Le Roux, "," in Proc. IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP), Jun. 2023. [arXiv] Dimitrios Bralios, Efthymios Tzinis, Gordon Wichern, Paris Smaragdis, Jonathan Le Roux, "Latent Iterative Refinement for Modular Source Separation," in Proc. IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP), Jun. 2023. [arXiv] Hao Yen, François G. Germain, Gordon Wichern, Jonathan Le Roux, "Cold Diffusion for Speech Enhancement," in Proc. IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP), Jun. 2023. [arXiv]. Satvik Venkatesh, Gordon Wichern, Aswin Subramanian, Jonathan Le Roux, "Improved Domain Generalization via Disentangled Multi-Task Learning in Unsupervised Anomalous Sound Detection," in Proc. DCASE Workshop, Nov. 2022. [pdf] Efthymios Tzinis, Gordon Wichern, Aswin Subramanian, Paris Smaragdis, Jonathan Le Roux, "Heterogeneous Target Speech Separation," in Proc. ISCA Interspeech, Sep. 2022. [pdf] Chiori Hori, Takaaki Hori, Jonathan Le Roux, "Low-Latency Streaming Scene-aware Interaction Using Audio-Visual Transformers," in Proc. ISCA Interspeech, Sep. 2022. [pdf] Darius Petermann, Gordon Wichern, Zhong-Qiu Wang, Jonathan Le Roux, "The Cocktail Fork Problem: Three-Stem Audio Separation for Real-World Soundtracks," in Proc. IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP), May 2022. [arXiv] [Demo] [Github] [Divide and Remaster (DnR) dataset] Olga Slizovskaia, Gordon Wichern, Zhong-Qiu Wang, Jonathan Le Roux, "Locate This, Not That: Class-Conditioned Sound Event DOA Estimation," in Proc. IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP), May 2022. [arXiv] Niko Moritz, Takaaki Hori, Shinji Watanabe, Jonathan Le Roux, "Sequence Transduction with Graph-based Supervision," in Proc. IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP), May 2022. [arXiv]. Xuankai Chang, Niko Moritz, Takaaki Hori, Shinji Watanabe, Jonathan Le Roux, "Extended Graph Temporal Classification for Multi-Speaker End-to-End ASR," in Proc. IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP), May 2022. [arXiv]. Yosuke Higuchi, Niko Moritz, Jonathan Le Roux, Takaaki Hori, "Advancing Momentum Pseudo-Labeling with Conformer and Initialization Strategy," in Proc. IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP), May 2022. [arXiv]. Ankit Parag Shah, Shijie Geng, Peng Gao, Anoop Cherian, Takaaki Hori, Tim K. Marks, Jonathan Le Roux, Chiori Hori, "Audio-Visual Scene-Aware Dialog and Reasoning Using Audio-Visual Transformers with Joint Student-Teacher Learning," in Proc. IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP), May 2022. Chiori Hori, Ankit Parag Shah, Shijie Geng, Peng Gao, Anoop Cherian, Takaaki Hori, Jonathan Le Roux, Tim K. Marks, "Overview of Audio Visual Scene-Aware Dialog with Reasoning Track for Natural Language Generation in DSTC10," in Proc. 10th Dialog System Technology Challenge Workshop at AAAI (DSTC10), Feb. 2022. Ankit Parag Shah, Takaaki Hori, Jonathan Le Roux, Chiori Hori, "DSTC10-AVSD Submission System with Reasoning using Audio-Visual Transformers with Joint Student-Teacher Learning," in Proc. 10th Dialog System Technology Challenge Workshop at AAAI (DSTC10), Feb. 2022. Anoop Cherian, Chiori Hori, Tim K. Marks, Jonathan Le Roux, "(2.5+1)D Spatio-Temporal Scene Graphs for Video Question Answering," in Proc. AAAI Conference on Artificial Intelligence (AAAI), Feb. 2022. Zhong-Qiu Wang, Gordon Wichern, Jonathan Le Roux, "Convolutive Prediction for Reverberant Speech Separation," in Proc. IEEE Workshop on Applications of Signal Processing to Audio and Acoustics (WASPAA), Oct. 2021. [arXiv] Gordon Wichern, Ankush Chakrabarty, Zhong-Qiu Wang, Jonathan Le Roux, "Anomalous sound detection using attentive neural processes," in Proc. IEEE Workshop on Applications of Signal Processing to Audio and Acoustics (WASPAA), Oct. 2021. Moitreya Chatterjee, Jonathan Le Roux, Narendra Ahuja, Anoop Cherian, "Visual Scene Graphs for Audio Source Separation," in Proc. IEEE International Conference on Computer Vision (ICCV), Oct. 2021. [arXiv] Niko Moritz, Takaaki Hori, Jonathan Le Roux, "Dual Causal/Non-Causal Self-Attention for Streaming End-to-End Speech Recognition," in Proc. ISCA Interspeech, Sep. 2021. [arXiv] Takaaki Hori, Niko Moritz, Chiori Hori, Jonathan Le Roux, "Advanced Long-context End-to-end Speech Recognition Using Context-expanded Transformers," in Proc. ISCA Interspeech, Sep. 2021. [arXiv] Yosuke Higuchi, Niko Moritz, Jonathan Le Roux, Takaaki Hori, "Momentum Pseudo-Labeling for Semi-Supervised Speech Recognition," in Proc. ISCA Interspeech, Sep. 2021. [arXiv] Chiori Hori, Takaaki Hori, Jonathan Le Roux, "Optimizing Latency for Online Video Captioning Using Audio-Visual Transformers," in Proc. ISCA Interspeech, Sep. 2021. [arXiv] Yun-Ning Hung, Gordon Wichern, Jonathan Le Roux, "Transcription Is All You Need: Learning to Separate Musical Mixtures with Score as Supervision," in Proc. IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP), Jun. 2021. [arXiv] Sameer Khurana, Niko Moritz, Takaaki Hori, Jonathan Le Roux, "Unsupervised Domain Adaptation for Speech Recognition via Uncertainty Driven Self-Training," in Proc. IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP), Jun. 2021. [arXiv] Niko Moritz, Takaaki Hori, Jonathan Le Roux, "Capturing Multi-Resolution Context by Dilated Self-Attention," in Proc. IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP), Jun. 2021. [arXiv] Niko Moritz, Takaaki Hori, Jonathan Le Roux, "Semi-Supervised Speech Recognition via Graph-based Temporal Classification," in Proc. IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP), Jun. 2021. [arXiv] Shijie Geng, Peng Gao, Moitreya Chatterjee, Chiori Hori, Jonathan Le Roux, Yongfeng Zhang, Hongsheng Li, Anoop Cherian, "Dynamic Graph Representation Learning for Video Dialog via Multi-Modal Shuffled Transformers," in Proc. AAAI Conference on Artificial Intelligence (AAAI), Feb. 2021. [arXiv] Niko Moritz, Gordon Wichern, Takaaki Hori, Jonathan Le Roux, "All-in-One Transformer: Unifying Speech Recognition, Audio Tagging, and Event Detection," in Proc. ISCA Interspeech, Oct. 2020. [.pdf] [.bib] Takaaki Hori, Niko Moritz,Chiori Hori, Jonathan Le Roux, "Transformer-based Long-context End-to-end Speech Recognition," in Proc. ISCA Interspeech, Oct. 2020. [.pdf] [.bib] Tejas Jayashankar, Jonathan Le Roux, Pierre Moulin, "Detecting Audio Attacks on ASR Systems with Dropout Uncertainty," in Proc. ISCA Interspeech, Oct. 2020. [arXiv] [.pdf] [.bib] Ethan Manilow, Gordon Wichern, Jonathan Le Roux, "Hierarchical Musical Source Separation," in Proc. International Society for Music Information Retrieval (ISMIR) Conference, Oct. 2020. [Paper, Poster, Video] [.pdf] [.bib] (Best Poster Award, Best Video Award) Prem Seetharaman, Gordon Wichern, Bryan Pardo, Jonathan Le Roux, "AutoClip: Adaptive Gradient Clipping for Source Separation Networks," in Proc. IEEE International Workshop on Machine Learning for Signal Processing (MLSP), Sep. 2020. [arXiv] [.pdf] [.bib] Prem Seetharaman, Gordon Wichern, Jonathan Le Roux, Bryan Pardo, "Bootstrapping unsupervised deep music separation from primitive auditory grouping principles," in ICML Workshop on Self-Supervision in Audio and Speech (SAS), Jul. 2020. [arXiv] [.pdf] [.bib] Fatemeh Pishdadian, Gordon Wichern, Jonathan Le Roux, "Learning to Separate Sounds From Weakly-Labeled Scenes," in Proc. IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP), May 2020. [.pdf] [.bib] Matthew Maciejewski, Gordon Wichern, Emmett McQuinn, Jonathan Le Roux, "WHAMR!: Noisy and Reverberant Single-Channel Speech Separation," in Proc. IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP), May 2020. [arXiv] [.pdf] [.bib] Xuankai Chang, Wangyou Zhang, Yanmin Qian, Jonathan Le Roux, Shinji Watanabe, "End-to-End Multi-speaker Speech Recognition with Transformer," in Proc. IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP), May 2020. [arXiv] [.pdf] [.bib] Niko Moritz, Takaaki Hori, Jonathan Le Roux, "Streaming Automatic Speech Recognition with the Transformer Model," in Proc. IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP), May 2020. [arXiv] [.pdf] [.bib] Leda Sarı, Niko Moritz, Takaaki Hori, Jonathan Le Roux, "Unsupervised Speaker Adaptation Using Attention-Based Speaker Memory for End-To-End ASR," in Proc. IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP), May 2020. [.pdf] [.bib] Niko Moritz, Takaaki Hori, Jonathan Le Roux, "Streaming End-to-End Speech Recognition with Joint CTC-Attention Based Models," in Proc. IEEE Automatic Speech Recognition and Understanding Workshop (ASRU), Dec. 2019. [.pdf] [.bib] Xuankai Chang, Wangyou Zhang, Yanmin Qian, Jonathan Le Roux, Shinji Watanabe, "MIMO-SPEECH: End-to-End Multi-Channel Multi-Speaker Speech Recognition," in Proc. IEEE Automatic Speech Recognition and Understanding Workshop (ASRU), Dec. 2019. [.pdf] [.bib] (Best Paper Award) Ethan Manilow, Gordon Wichern, Prem Seetharaman, Jonathan Le Roux, "Cutting Music Source Separation Some Slakh: A Dataset to Study the Impact of Training Data Quality and Quantity," in Proc. IEEE Workshop on Applications of Signal Processing to Audio and Acoustics (WASPAA), Oct. 2019. [.pdf] [.bib] Ilya Kavalerov, Scott Wisdom, Hakan Erdogan, Brian Patton, Kevin Wilson, Jonathan Le Roux, John Hershey, "Universal Sound Separation," in Proc. IEEE Workshop on Applications of Signal Processing to Audio and Acoustics (WASPAA), Oct. 2019. [.pdf] [.bib] Gordon Wichern, Emmett McQuinn, Joe Antognini, Michael Flynn, Richard Zhu, Dwight Crow, Ethan Manilow, Jonathan Le Roux, "WHAM!: Extending Speech Separation to Noisy Environments," in Proc. ISCA Interspeech, Sep. 2019. [.pdf] [.bib] Niko Moritz, Takaaki Hori, Jonathan Le Roux, "Unidirectional Neural Network Architectures for End-to-End Automatic Speech Recognition," in Proc. ISCA Interspeech, Sep. 2019. [.pdf] [.bib] Hiroshi Seki, Takaaki Hori, Shinji Watanabe, Niko Moritz, Jonathan Le Roux, "Vectorized Beam Search for CTC-Attention-based Speech Recognition," in Proc. ISCA Interspeech, Sep. 2019. [.pdf] [.bib] Hiroshi Seki, Takaaki Hori, Shinji Watanabe, Jonathan Le Roux, John R. Hershey, "End-to-End Multi-Lingual Multi-Speaker Speech Recognition," in Proc. ISCA Interspeech, Sep. 2019. [.pdf] [.bib] Niko Moritz, Takaaki Hori, Jonathan Le Roux, "Triggered Attention for End-to-End Speech Recognition," in Proc. IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP), May 2019. [.pdf] [.bib] Jonathan Le Roux, Gordon Wichern, Shinji Watanabe, Andy Sarroff, John R. Hershey, "The Phasebook: Building complex masks via discrete representations for source separation," in Proc. IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP), May 2019. [.pdf] [.bib] Jonathan Le Roux, Scott Wisdom, Hakan Erdogan, John R. Hershey, "SDR — half-baked or well done?," in Proc. IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP), May 2019. [.pdf] [.bib] [arXiv] [Code to reproduce the figures] Prem Seetharaman, Gordon Wichern, Jonathan Le Roux, Bryan Pardo, "Bootstrapping single-channel source separation via unsupervised spatial clustering on stereo mixtures," in Proc. IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP), May 2019. [.pdf] [.bib] [arXiv] Prem Seetharaman, Gordon Wichern, Shrikant Venkataramani, Jonathan Le Roux, "Class-conditional embeddings for music source separation," in Proc. IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP), May 2019. [.pdf] [.bib] [arXiv] Ryo Aihara, Toshiyuki Hanazawa, Yohei Okato, Gordon Wichern, Jonathan Le Roux, "Teacher-student deep clustering for low-delay single channel speech separation," in Proc. IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP), May 2019. [.pdf] [.bib] Takaaki Hori, Ramon Astudillo, Tomoki Hayashi, Yu Zhang, Shinji Watanabe, Jonathan Le Roux, "Cycle-consistency training for end-to-end speech recognition," in Proc. IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP), May 2019. [.pdf] [.bib] [arXiv] Gordon Wichern, Jonathan Le Roux, "Phase reconstruction with learned time-frequency representations for single-channel speech separation," in Proc. IEEE International Workshop on Acoustic Signal Enhancement (IWAENC), Sep. 2018. [.pdf] [.bib] Zhong-Qiu Wang, Jonathan Le Roux, DeLiang Wang, John R. Hershey, "End-to-End Speech Separation with Unfolded Iterative Phase Reconstruction," in Proc. ISCA Interspeech, Sep. 2018. [.pdf] [.bib] Hiroshi Seki, Shinji Watanabe, Takaaki Hori, Jonathan Le Roux, John R. Hershey, "A Purely End-to-end System for Multi-speaker Speech Recognition," in Proc. Annual Meeting of the Association for Computational Linguistics (ACL), Jul. 2018. [.pdf] [.bib] Hiroshi Seki, Shinji Watanabe, Takaaki Hori, Jonathan Le Roux, John R. Hershey, "An End-to-End Language-Tracking Speech Recognizer for Mixed-Language Speech," in Proc. IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP), Apr. 2018. [.pdf] [.bib] Shane Settle, Jonathan Le Roux, Takaaki Hori, Shinji Watanabe, John R. Hershey, "End-to-End Multi-Speaker Speech Recognition," in Proc. IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP), Apr. 2018. [.pdf] [.bib] Zhong-Qiu Wang, Jonathan Le Roux, John R. Hershey, "Alternative Objective Functions for Deep Clustering," in Proc. IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP), Apr. 2018. [.pdf] [.bib] Zhong-Qiu Wang, Jonathan Le Roux, John R. Hershey, "Multi-Channel Deep Clustering: Discriminative Spectral and Spatial Embeddings for Speaker-Independent Speech Separation," in Proc. IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP), Apr. 2018. [.pdf] [.bib] (Best Student Paper Award) Paul Magron, Jonathan Le Roux, Tuomas Virtanen, "Consistent anisotropic Wiener filtering for audio source separation," in Proc. IEEE Workshop on Applications of Signal Processing to Audio and Acoustics (WASPAA), Oct. 2017. [.pdf] [.bib] Yuuki Tachioka, Tomohiro Narita, Iori Miura, Takanobu Uramoto, Natsuki Monta, Shingo Uenohara, Kenichi Furuya, Shinji Watanabe, Jonathan Le Roux, "Coupled initialization of multi-channel non-negative matrix factorization based on spatial and spectral information," in Proc. ISCA Interspeech, Aug. 2017. [.pdf] [.bib] Yi Luo, Zhuo Chen, John R. Hershey, Jonathan Le Roux, Nima Mesgarani, "Deep Clustering and Conventional Networks for Music Separation: Stronger Together," in Proc. IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP), Mar. 2017. [.pdf] [.bib] [arXiv] [demo] (Ranked 1st out of 5 teams at the MIREX 2016 Singing Voice Separation Task) Tomoki Hayashi, Shinji Watanabe, Tomoki Toda, Takaaki Hori, Jonathan Le Roux, Kazuya Takeda, "BLSTM-HMM Hybrid System Combined with Sound Activity Detection Network for Polyphonic Sound Event Detection," in Proc. IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP), Mar. 2017. [.pdf] [.bib] Shinji Watanabe, Takaaki Hori, Jonathan Le Roux, John R. Hershey, "Student-Teacher Network Learning with Enhanced Features," in Proc. IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP), Mar. 2017. [.pdf] [.bib] Takaaki Hori, Hai Wang, Chiori Hori, Shinji Watanabe, Bret A. Harsham, Jonathan Le Roux, John R. Hershey, Yusuke Koji, Yi Jing, Zhaocheng Zhu, Takeyuki Aikawa, "Dialog State Tracking with Attention-Based Sequence-to-Sequence Learning," in Proc. IEEE Workshop on Spoken Language Technology (SLT), Dec. 2016. [.pdf] [.bib] (Ranked 2nd out of 9 submissions at DSTC5 Dialog State Tracking Challenge) Scott Wisdom, Thomas Powers, John R. Hershey, Jonathan Le Roux, Les Atlas, "Full-Capacity Unitary Recurrent Neural Networks," in Proc. Advances in Neural Information Processing Systems (NIPS), Dec. 2016. [.pdf] [.bib] [Spotlight video] [Code] Hakan Erdogan, Tomoki Hayashi, John R. Hershey, Takaaki Hori, Chiori Hori, Wei-Ning Hsu, Suyoun Kim, Jonathan Le Roux, Zhong Meng, Shinji Watanabe, "Multi-Channel Speech Recognition: LSTMs All the Way Through," in Proc. CHiME Workshop, pp. 45--48, Sep. 2016. [.pdf] [.bib] (Ranked 3rd out of 15 submissions at the 4th CHiME Speech Separation and Recognition Challenge, 6-channel track) Yusuf Isik, Jonathan Le Roux, Zhuo Chen, Shinji Watanabe, John R. Hershey, "Single-Channel Multi-Speaker Separation using Deep Clustering," in Proc. ISCA Interspeech (Interspeech 2016), Sep. 2016. [.pdf] [.bib] [Demos and code to generate the dataset] Hakan Erdogan, John R. Hershey, Shinji Watanabe, Michael Mandel, Jonathan Le Roux, "Improved MVDR beamforming using single-channel mask prediction networks," in Proc. ISCA Interspeech (Interspeech 2016), Sep. 2016. [.pdf] [.bib] Tomoki Hayashi, Shinji Watanabe, Tomoki Toda, Takaaki Hori, Jonathan Le Roux, Kazuya Takeda, "Bidirectional LSTM-HMM Hybrid System for Polyphonic Sound Event Detection," in Proc. DCASE2016 Workshop (DCASE2016), Sep. 2016. [.pdf] [.bib] (Ranked 3rd out of 9 submissions at the DCASE 2016 Challenge Task 2) John R. Hershey, Zhuo Chen, Jonathan Le Roux, Shinji Watanabe, "Deep Clustering: Discriminative Embeddings for Segmentation and Separation," in Proc. IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP 2016), Mar. 2016. [.pdf] [.bib] Scott Wisdom, John R. Hershey, Jonathan Le Roux, Shinji Watanabe, "Deep Unfolding for Multichannel Source Separation," in Proc. IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP 2016), Mar. 2016. [.pdf] [.bib] Takaaki Hori, Zhuo Chen, Hakan Erdogan, John R. Hershey, Jonathan Le Roux, Vikramjit Mitra, Shinji Watanabe, "The MERL/SRI system for the 3rd CHiME challenge using beamforming, robust feature extraction, and advanced speech recognition," in Proc. IEEE Automatic Speech Recognition and Understanding Workshop (ASRU 2015), Dec. 2015. [.pdf] [.bib] (Ranked 2nd out of 25 submissions at the 3rd CHiME Speech Separation and Recognition Challenge) Bret Harsham, Shinji Watanabe, Alan Esenther, John R. Hershey, Jonathan Le Roux, Yi Luan, Daniel Nikovski, Vamsi Potluru, "Driver prediction to improve interaction with in-vehicle HMI," in Proc. Workshop on Digital Signal Processing for In-Vehicle Systems (DSP 2015), Oct. 2015. [.pdf] [.bib] Felix Weninger, Hakan Erdogan, Shinji Watanabe, Emmanuel Vincent, Jonathan Le Roux, John R. Hershey, Björn Schuller, "Speech Enhancement with LSTM Recurrent Neural Networks and its Application to Noise-Robust ASR," in Proc. International Conference on Latent Variable Analysis and Signal Separation (LVA/ICA 2015), Aug. 2015. [.pdf] [.bib] Jonathan Le Roux, John R. Hershey, Felix Weninger, "Deep NMF for Speech Separation," in Proc. IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP 2015), Apr. 2015. [.pdf] [.bib] Jonathan Le Roux, Emmanuel Vincent, John R. Hershey, Daniel P. W. Ellis, "MICbots: collecting large realistic datasets for speech and audio research using mobile robots," in Proc. IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP 2015), Apr. 2015. [.pdf] [.bib] [Slides] [Project page] Hakan Erdogan, John R. Hershey, Shinji Watanabe, Jonathan Le Roux, "Phase-sensitive and recognition-boosted speech separation using deep recurrent neural networks," in Proc. IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP 2015), Apr. 2015. [.pdf] [.bib] Felix Weninger, Jonathan Le Roux, John R. Hershey, Björn Schuller, "Discriminatively Trained Recurrent Neural Networks for Single-Channel Speech Separation," in Proc. IEEE GlobalSIP Symposium on Machine Learning Applications in Speech Processing (GlobalSIP MLASP 2014), Dec. 2014. [.pdf] [.bib] Yuuki Tachioka, Shinji Watanabe, Jonathan Le Roux, John R. Hershey, "Sequence Discriminative Training for Low-Rank Deep Neural Networks," in Proc. IEEE GlobalSIP Symposium on Machine Learning Applications in Speech Processing (GlobalSIP MLASP 2014), Dec. 2014. [.pdf] [.bib] Felix Weninger, Jonathan Le Roux, John R. Hershey, Shinji Watanabe, "Discriminative NMF and its application to single-channel source separation," Proc. ISCA Interspeech (Interspeech 2014), Sep. 2014. [.pdf] [.bib] Yuuki Tachioka, Shinji Watanabe, Jonathan Le Roux, John R. Hershey, "Sequential Maximum Mutual Information Linear Discriminant Analysis for Speech Recognition," in Proc. ISCA Interspeech (Interspeech 2014), Sep. 2014. [.pdf] [.bib] Yuuki Tachioka, Tomohiro Narita, Shinji Watanabe, Jonathan Le Roux, "Ensemble integration of calibrated speaker localization and statistical speech detection in domestic environments," in Proc. IEEE Joint Workshop on Hands-free Speech Communication and Microphone Arrays (HSCMA 2014), May 2014. [.pdf] [.bib] Felix Weninger, Shinji Watanabe, Jonathan Le Roux, John R. Hershey, Yuuki Tachioka, Jürgen Geiger, Björn Schuller, Gerhard Rigoll, "The MERL/MELCO/TUM system for the REVERB Challenge using Deep Recurrent Neural Network Feature Enhancement," Proc. REVERB workshop (REVERB 2014), May 2014. [.pdf] [.bib] Shinji Watanabe, Jonathan Le Roux, "A Study on Black Box Optimization for Automatic Speech Recognition," in Proc. IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP 2014), May 2014. [.pdf] [.bib] Umut Şimşekli, Jonathan Le Roux, John R. Hershey, "Non-Negative Source-Filter Dynamical System for Speech Enhancement," in Proc. IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP 2014), May 2014. [.pdf] [.bib] (Student travel grant awarded to Umut) Vamsi K. Potluru, Jonathan Le Roux, Barak A. Pearlmutter, John R. Hershey, Matthew E. Brand, "Pairwise Coordinate Descent Algorithm for NMF," in Proc. NIPS Workshop on Greedy Algorithms, Frank-Wolfe and Friends - A modern perspective, Dec. 2013. [Website], [.pdf], [.bib] Emmanuel Vincent, Jon Barker, Shinji Watanabe, Jonathan Le Roux, Francesco Nesta, Marco Matassoni, "The Second 'CHiME' Speech Separation and Recognition Challenge: An Overview of Challenge Systems and Outcomes," in Proc. IEEE Automatic Speech Recognition and Understanding Workshop (ASRU 2013), Dec. 2013. [.pdf], [.bib] Yuuki Tachioka, Shinji Watanabe, Jonathan Le Roux, John R. Hershey, "A Generalized Discriminative Training Framework for System Combination," in Proc. IEEE Automatic Speech Recognition and Understanding Workshop (ASRU 2013), Dec. 2013. [.pdf], [.bib] Jonathan Le Roux, Shinji Watanabe, John R. Hershey, "Ensemble Learning for Speech Enhancement," in Proc. IEEE Workshop on Applications of Signal Processing to Audio and Acoustics (WASPAA 2013), Oct. 2013. [.pdf], [.bib] Umut Şimşekli, Jonathan Le Roux, John R. Hershey, "Hierarchical and Coupled Non-Negative Dynamical Systems with Application to Audio Modeling," in Proc. IEEE Workshop on Applications of Signal Processing to Audio and Acoustics (WASPAA 2013), Oct. 2013. [.pdf], [.bib] (Student travel grant awarded to Umut) Koichiro Yoshino, Shinji Watanabe, Jonathan Le Roux, John R. Hershey, "Statistical Dialogue Management using Intention Dependency Graph," in Proc. International Joint Conference on Natural Language Processing (IJCNLP 2013), Oct. 2013. [.pdf], [.bib] Yuuki Tachioka, Shinji Watanabe, Jonathan Le Roux, John R. Hershey, "Discriminative methods for noise robust speech recognition: A CHiME Challenge benchmark," in Proc. International Workshop on Machine Listening in Multisource Environments (CHiME 2013), Jun. 2013. [.pdf], [.bib] Jonathan Le Roux, Petros T. Boufounos, Kang Kang, John R. Hershey, "Source Localization in Reverberant Environments Using Sparse Optimization," in Proc. IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP 2013), May 2013. [.pdf], [.bib] Cédric Févotte, Jonathan Le Roux, John R. Hershey, "Non-Negative Dynamical System With Application to Speech and Audio," in Proc. IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP 2013), May 2013. [.pdf], [.bib] Emmanuel Vincent, Jon Barker, Shinji Watanabe, Jonathan Le Roux, Francesco Nesta, Marco Matassoni, "The Second CHiME Speech Separation and Recognition Challenge: Datasets, Tasks and Baselines," in Proc. IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP 2013), May 2013. [.pdf], [.bib] Vamsi K. Potluru, Sergey M. Plis, Jonathan Le Roux, Barak A. Pearlmutter, Vince D. Calhoun, Thomas P. Hayes, "Block Coordinaate Descent for Sparse NMF," in Proc. International Conference on Learning Representations (ICLR 2013), May 2013. [arXiv], [.bib] Creighton K. Heaukulani, Jonathan Le Roux and John R. Hershey, "Latent Dirichlet Reallocation for Term Swapping," in Proc. IEEE International Workshop on Statistical Machine Learning for Speech Processing (IWSML 2012), Mar. 2012. [.pdf], [.bib] Jonathan Le Roux and John R. Hershey, "Indirect Model-Based Speech Enhancement," in Proc. IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP 2012), pp. 4045–4048, Mar. 2012. [.pdf], [.bib] Masahiro Nakano, Jonathan Le Roux, Hirokazu Kameoka, Tomohiro Nakamura, Nobutaka Ono and Shigeki Sagayama, "Bayesian Nonparametric Spectrogram Modeling Based on Infinite Factorial Infinite Hidden Markov Model," in Proc. IEEE Workshop on Applications of Signal Processing to Audio and Acoustics (WASPAA 2011), Oct. 2011. [.pdf], [.bib] Masahiro Nakano, Jonathan Le Roux, Hirokazu Kameoka, Nobutaka Ono and Shigeki Sagayama, "Infinite-State Spectrum Model for Music Signal Analysis," in Proc. IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP 2011), pp. 1972–1975, May 2011. [.pdf], [.bib] Jonathan Le Roux, Emmanuel Vincent, Yuu Mizuno, Hirokazu Kameoka, Nobutaka Ono and Shigeki Sagayama, "Consistent Wiener Filtering: Generalized Time-Frequency Masking Respecting Spectrogram Consistency," in Proc. 9th International Conference on Latent Variable Analysis and Signal Separation (LVA/ICA 2010), Lecture Notes in Computer Science, Vol. 6365/2010, pp. 89–96, Springer, Sep. 2010. [.pdf], [.bib] Hirokazu Kameoka, Takuya Yoshioka, Mariko Hamamura, Jonathan Le Roux and Kunio Kashino, "Statistical Model of Speech Signals Based on Composite Autoregressive System with Application to Blind Source Separation," in Proc. 9th International Conference on Latent Variable Analysis and Signal Separation (LVA/ICA 2010), pp. 245–253, Sep. 2010. [.pdf], [.bib] Masahiro Nakano, Jonathan Le Roux, Hirokazu Kameoka, Yu Kitano, Nobutaka Ono and Shigeki Sagayama, "Nonnegative Matrix Factorization with Markov-chained Bases for Modeling Time-varying patterns in Music Spectrograms," in Proc. 9th International Conference on Latent Variable Analysis and Signal Separation (LVA/ICA 2010), pp. 149–156, Sep. 2010. [.pdf], [.bib] Hirokazu Kameoka, Jonathan Le Roux and Yasunori Ohishi, "A Statistical Model of Speech F0 Contours," in Proc. ISCA Tutorial and Research Workshop on Statistical And Perceptual Audition (SAPA 2010), pp. 43–48, Sep. 2010. [.pdf], [.bib] Jonathan Le Roux, Hirokazu Kameoka, Nobutaka Ono and Shigeki Sagayama, "Fast Signal Reconstruction from Magnitude STFT Spectrogram Based on Spectrogram Consistency," in Proc. 13th International Conference on Digital Audio Effects (DAFx-10), pp. 397–403, Sep. 2010. [.pdf], [.bib] Masahiro Nakano, Hirokazu Kameoka, Jonathan Le Roux, Yu Kitano, Nobutaka Ono, Shigeki Sagayama, "Convergence-Guaranteed Multiplicative Algorithms for Non-Negative Matrix Factorization with Beta-Divergence," in Proc. IEEE International Workshop on Machine Learning for Signal Processing (MLSP 2010), pp. 283–288, Aug. 2010. [.pdf], [.bib] Jonathan Le Roux, Alain de Cheveigné and Lucas C. Parra, "Adaptive Template Matching with Shift-Invariant Semi-NMF," in Advances in Neural Information Processing Systems 21 (Proc. NIPS 2008), D. Koller, Y. Bengio, D. Schuurmans, and L. Bottou, Eds. Cambridge, MA: The MIT Press, 2009. (Presented in Dec. 2008) [.pdf], [.bib] [source code] Jonathan Le Roux, Nobutaka Ono and Shigeki Sagayama, "Explicit Consistency Constraints for STFT Spectrograms and Their Application to Phase Reconstruction," in Proc. Workshop on Statistical and Perceptual Audition (SAPA 2008), pp. 23–28, Sep. 2008. [.pdf], [.bib] Jonathan Le Roux, Hirokazu Kameoka, Nobutaka Ono, Alain de Cheveigné and Shigeki Sagayama, "Computational Auditory Induction by Missing-Data Non-Negative Matrix Factorization," in Proc. Workshop on Statistical and Perceptual Audition (SAPA 2008), pp. 1–6, Sep. 2008. [.pdf], [.bib] Nobutaka Ono, Ken-ichi Miyamoto, Jonathan Le Roux, Hirokazu Kameoka and Shigeki Sagayama, "Separation of a Monaural Audio Signal into Harmonic/Percussive Components by Complementary Diffusion on Spectrogram," in Proc. European Signal Processing Conference (EUSIPCO), Aug. 2008. [.pdf], [.bib] Jonathan Le Roux, Hirokazu Kameoka, Nobutaka Ono, Shigeki Sagayama and Alain de Cheveigné, "Modulation Analysis of Speech Through Orthogonal FIR Filterbank Optimization," in Proc. IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP 2008), pp. 4189–4192, Apr. 2008. [.pdf], [.bib] Jonathan Le Roux, Hirokazu Kameoka, Nobutaka Ono, Alain de Cheveigné and Shigeki Sagayama, "Single Channel Speech and Background Segregation through Harmonic-Temporal Clustering," in Proc. IEEE Workshop on Applications of Signal Processing to Audio and Acoustics, pp. 279–282, Oct. 2007. [.pdf] [.bib] Jonathan Le Roux, Hirokazu Kameoka, Nobutaka Ono, Alain de Cheveigné and Shigeki Sagayama, "Harmonic-Temporal Clustering of Speech for Single and Multiple F0 Contour Estimation in Noisy Environments," In Proc. IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP 2007), Vol. IV, pp. 1053–1056, Apr. 2007. [.pdf] [.bib] (電気通信普及財団からの渡航旅費援助で参加) Alain de Cheveigné, Jonathan Le Roux and Jonathan Z. Simon, "MEG Signal Denoising based on Time-Shift PCA," In Proc. IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP 2007), Vol. I, pp. 317–320, Apr. 2007. [.pdf] [.bib] Hirokazu Kameoka, Jonathan Le Roux, Nobutaka Ono and Shigeki Sagayama, "Speech Analyzer Using a Joint Estimation Model of Spectral Envelope and Fine Structure," In Proc. Interspeech International Conference on Spoken Language Processing (ICSLP2006), pp. 2502–2505, Sep. 2006. [.pdf] [.bib] Jonathan Le Roux and Erik McDermott, "Optimization Methods for Discriminative Training," in Proc. Eurospeech 2005, pp. 3341–3344, Sep. 2005. [.pdf] [.bib]

• 国際会議発表(アブストラクト)

  Jonathan Le Roux, Hirokazu Kameoka, Nobutaka Ono, Alain de Cheveigné and Shigeki Sagayama, "Music and Speech Signal Processing using Harmonic-Temporal Clustering," Invited talk at Acoustics'08 Paris (Acoustics'08), July 2008. [.bib] Jonathan Le Roux, Hirokazu Kameoka, Nobutaka Ono and Shigeki Sagayama, "Parametric Spectrogram Modeling of Single and Concurrent Speech with Spline Pitch Contour," in Proc. 4th Joint Meeting of the Acoustical Society of America and the Acoustical Society of Japan, Nov. 2006. [.bib]

• 国内大会論文・研究会論文

  樋口陽祐, Niko Moritz, ルルー・ジョナトン, 堀貴明, "Momentum Pseudo-Labelingによる半教師ありEnd-to-End音声認識," in 日本音響学会2016年春季研究発表会講演論文集, Mar. 2022. 太刀岡勇気, 成田知宏, 渡部晋治, ルルー・ジョナトン, "音声認識のための線形判別分析の系列相互情報量最大化識別学習," 日本音響学会2016年春季研究発表会講演論文集, Mar. 2016. 太刀岡勇気, 成田知宏, 渡部晋治, ルルー・ジョナトン, "家庭環境における補正音源定位と統計的音声区間検出の統合 －DIRHA コーパスの利用－," 日本音響学会2015年春季研究発表会講演論文集, Mar. 2015. [.bib] 太刀岡勇気, 渡部晋治, ルルー・ジョナトン, ハーシー・ジョン, "音声認識システムの統合を目的とした識別学習の枠組み," 日本音響学会2014年秋季研究発表会講演論文集, Sep. 2014. [.bib] 太刀岡勇気, 渡部晋治, ルルー・ジョナトン, ハーシー・ジョン, "システム統合のための音響モデルの相互情報量最大化識別学習," 日本音響学会2014年春季研究発表会講演論文集, Mar. 2014. [.bib] 太刀岡勇気, 渡部晋治, ルルー・ジョナトン, ハーシー・ジョン, "騒音環境に対する識別的アプローチの有効性: 第2回CHiMEチャレンジ," 日本音響学会2013年秋季研究発表会講演論文集, Sep. 2013. [.bib] (太刀岡勇気が第35回粟屋潔学術奨励賞受賞) 太刀岡勇気, 渡部晋治, ルルー・ジョナトン, ハーシー・ジョン, "騒音環境に対する識別的アプローチの有効性: 第2回CHiMEチャレンジ," 電子情報通信学会技術研究報告, Jul. 2013. ルルー・ジョナトン, フェヴォット・セドリック, ハーシー・ジョン, "音声・音響モデリングのための非負値力学系," 日本音響学会2013年春季研究発表会講演論文集, 3-10-20, Mar. 2013. [.bib] (第34回粟屋潔学術奨励賞受賞) ルルー・ジョナトン, ハーシー・ジョン, "間接VTSによる音声強調," 日本音響学会2012年春季研究発表会講演論文集, 1-Q-13, Mar. 2012. [.bib] 中野允裕, ルルー・ジョナトン, 亀岡弘和, 中村友彦, 小野順貴, 嵯峨山茂樹, "スペクトログラムのベイジアンノンパラメトリックモデリングに基づく音 楽信号の解析," 情報処理学会研究報告, 2011-MUS-89, Jul. 2011. [.bib] （中野允裕がベストプレゼンテーション賞受賞） ルルー・ジョナトン, "スペクトログラム矛盾性最大化と位相制御による音の転写," 日本音響学会2011年春季研究発表会講演論文集, 1-Q-51, Mar. 2011. [.pdf], [.bib], [Poster], [Demo page] ルルー・ジョナトン, 亀岡弘和, 小野順貴, 嵯峨山茂樹, "スペクトログラム無矛盾性に基づく位相付加アルゴリズムにおける位相初期値選択による高速化の検討," 日本音響学会2010年秋季研究発表会講演論文集, 3-10-3, Sep. 2010. [.bib] 亀岡弘和, ルルー・ジョナトン, 大石康智, "音声F0パターン生成過程の確率モデル," 日本音響学会2010年秋季研究発表会講演論文集, 1-1-3, Sep. 2010. [.bib] 濱村真理子, 亀岡弘和, 吉岡拓也, ルルー・ジョナトン, 柏野邦夫, "複合自己回帰系による音声パワースペクトル密度モデルを用いたブラインド音源分離と残響除去," 日本音響学会2010年秋季研究発表会講演論文集, 2-P-22, Sep. 2010. [.bib] 中野允裕, ルルー・ジョナトン, 亀岡弘和, 小野順貴, 嵯峨山茂樹, "無限状態スペクトルモデルによる音楽音響信号の解析," 情報処理学会研究報告, 2010-MUS-86, Jul. 2010. [.bib] ルルー・ジョナトン, ヴァンサン・エマヌエル, 水野優, 亀岡弘和, 小野順貴, 嵯峨山茂樹, "Consistent Wiener filtering：スペクトログラム無矛盾性を保証する一般化時間周波数マスクの設計法," 日本音響学会2010年春季研究発表会講演論文集, 3-5-3, Mar. 2010. [.bib] ルルー・ジョナトン, 亀岡弘和, 小野順貴, 嵯峨山茂樹, "スペクトログラム無矛盾性に基づく位相推定アルゴリズムの統一的解釈及び高速化の検討," 日本音響学会2010年春季研究発表会講演論文集, 3-5-2, Mar. 2010. [.bib] 亀岡弘和, 大石康智, 持橋大地, ルルー・ジョナトン, "マルチカーネル線形予測モデルによる音声分析," 日本音響学会2010年春季研究発表会講演論文集, 2-Q-24, Mar. 2010. [.bib] 中野允裕, 北野佑, ルルー・ジョナトン, 亀岡弘和, 小野順貴, 嵯峨山茂樹, "可変基底NMFに基づく音楽音響信号の解析," 情報処理学会研究報告, 2010-MUS-84, Feb. 2010. [.bib] 亀岡弘和, ルルー ジョナトン, "Frobeniusノルム規準の非負値行列因子分解における乗法更新式に関する一考察," 日本音響学会2009年秋季研究発表会講演論文集, 1-P-8, 2009. [.bib] Jonathan Le Roux, Hirokazu Kameoka, Emmanuel Vincent, Nobutaka Ono, Kunio Kashino and Shigeki Sagayama, "Complex NMF under spectrogram consistency constraints," in Proc. of ASJ Autumn Meeting, 2-4-5, Sep. 2009. [.bib] 亀岡弘和, ルルー ジョナトン, 大石康智, 柏野邦夫, "Music Factorizer: 音楽音響信号をノート単位で編集できるインタフェース," 情報処理学会研究報告, 2009-MUS-81-9, Jul. 2009. [.bib] Jonathan Le Roux, Hirokazu Kameoka, Nobutaka Ono and Shigeki Sagayama, "Spectrogram consistency and its application to phase reconstruction," in Proc. of IPSJ SIGMUS Summer Workshop, 2009-MUS-81-8, Jul. 2009. [.bib] (情報処理学会 平成22年度 山下記念研究賞 受賞) 伊藤彰則, 安藤大地, ルルー ジョナトン, 中野 倫靖, 吉井 和佳, "新博士によるパネルディスカッションIII 「私のための研究・価値を生み出す研究」," (パネルディスカッション), 情報処理学会研究報告, 2009-MUS-81-7, Jul. 2009. [.bib] 水野 優, ルルー ジョナトン, 小野 順貴, 嵯峨山 茂樹, "パワースペクトログラムの伸縮と無矛盾位相付加に基づく音楽音響信号の実時間テンポ／ピッチ変換," 日本音響学会春季研究発表会講演集, pp. 843–844, Mar. 2009. [.bib] Jonathan Le Roux, Hirokazu Kameoka, Nobutaka Ono, Shigeki Sagayama and Alain de Cheveigné, "Filterbank Optimization for Amplitude Modulation Analysis of Audio Signals," in Proc. of ASJ Autumn Meeting, 1-2-1, Sep. 2007. [.bib] Jonathan Le Roux, Hirokazu Kameoka, Nobutaka Ono, Alain de Cheveigné and Shigeki Sagayama, "Monaural Speech Separation Through Harmonic-Temporal Clustering of the Power Spectrum," in Proc. of ASJ Autumn Meeting, 3-4-3, Sep. 2007. [.bib] 宮本賢一, 立薗真理, ルルー ジョナトン, 亀岡弘和, 小野順貴, 嵯峨山茂樹, "スペクトログラム2次元フィルタによる調波音・打楽器音の分離," 日本音響学会秋季研究発表会講演集, 1-1-7, pp. 825–826, Sep., 2007. [.bib] 亀岡弘和, ルルー ジョナトン, 小野順貴, 嵯峨山茂樹, "調波時間構造化クラスタリングによるCASAへのアプローチ," 日本音響学会聴覚研究会, Vol. 36, No. 7, H-2006-103, pp. 575–580, 2006. [.pdf] [.bib] Jonathan Le Roux, Hirokazu Kameoka, Nobutaka Ono and Shigeki Sagayama, "Harmonic Temporal Clustering of Speech Spectrum," in Proc. ASJ Spring Meeting, 2-11-3, in CD-ROM, Mar. 2006. [.bib]

• チュートリアル、技術研究報告

  Zhong-Qiu Wang, Gordon Wichern, Jonathan Le Roux, "Leveraging Low-Distortion Target Estimates for Improved Speech Enhancement," arXiv preprint, arXiv:2110.00570, Oct. 2021. [arXiv]. Peng Gao, Chiori Hori, Shijie Geng, Takaaki Hori, Jonathan Le Roux, "Multi-Pass Transformer for Machine Translation," arXiv preprint, arXiv:2009.11382, Sep. 2020. [arXiv] Jonathan Le Roux, Emmanuel Vincent, Hakan Erdogan, "Learning-Based Approaches to Speech Enhancement and Separation," Tutorial given at Interspeech, Sep. 2016. [Slides] [.bib] John R. Hershey, Zhuo Chen, Jonathan Le Roux, Shinji Watanabe, "Deep clustering: Discriminative embeddings for segmentation and separation," arXiv:1508.04306, Aug. 2015. [arXiv (latest version)] [.bib] Jonathan Le Roux, Felix Weninger, John R. Hershey, "Sparse NMF – half-baked or well done?," Mitsubishi Electric Research Laboratories Technical Report, TR2015-023, Mar. 2015. [.pdf] [.bib] [source code] John R. Hershey, Jonathan Le Roux, Felix Weninger, "Deep Unfolding: Model-Based Inspiration of Novel Deep Architectures," arXiv:1409.2574, Mitsubishi Electric Research Laboratories Technical Report, TR2014-117, Aug. 2014. [TR], [arXiv (latest version)] [.bib] Jonathan Le Roux, Emmanuel Vincent, "A categorization of robust speech processing datasets", Mitsubishi Electric Research Laboratories Technical Report, TR2014-116, Aug. 2014.[.pdf] [.bib] [wiki page] (The table can be printed over 4 pages from the PDF by using the "Poster" option in Acrobat, and rescaling so that it fits in 1 x 4 Letter size pages) Jonathan Le Roux, Hirokazu Kameoka, Nobutaka Ono and Shigeki Sagayama, "On the Interpretation of I-Divergence-Based Distribution Fitting as a Maximum-Likelihood Estimation Problem," Technical Report of the University of Tokyo, METR 2008-11, Mar. 2008. [.pdf] [.bib]

• Datasets, Softwares

  Hyper-Unmix, source code for training models and using the hyperbolic interface proposed in our ICASSP 2023 paper, "Hyperbolic Audio Source Separation." Please refer to: Darius Petermann, Gordon Wichern, Aswin Subramanian, Jonathan Le Roux, "Hyperbolic Audio Source Separation," in Proc. IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP), Jun. 2023. [arXiv] Cocktail-Fork-Separation and Divide and Remaster (DnR), a baseline system to separate a monaural audio signal into speech, music, and sound effects/background stems, i.e., solving the cocktail fork problem, and a source separation dataset for training and testing such algorithms. Please refer to: Darius Petermann, Gordon Wichern, Zhong-Qiu Wang, Jonathan Le Roux, "The Cocktail Fork Problem: Three-Stem Audio Separation for Real-World Soundtracks," in Proc. IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP), May 2022. [arXiv] [Demo]. WHAM!48kHz, a high-fidelity version of the ambient background noise recordings originally used for the WSJ0 Hipster Ambient Mixtures (WHAM!) dataset. 78 hours of raw binaural recordings (48 kHz/24-bit), collected by our definitely not Careless Whisper.ai collaborators at various urban locations (restaurants, cafes, bars, parks) throughout the Bay Area. As a Last Christmas present in the WHAM! series, we have decided to Make It Big. WHAMR!, a spatialized (stereo, reverberant) version of the WHAM! dataset, for noisy and reverberant single- and multi-channel speech separation. Please refer to: Matthew Maciejewski, Gordon Wichern, Emmett McQuinn, Jonathan Le Roux, "WHAMR!: Noisy and Reverberant Single-Channel Speech Separation," in Proc. IEEE ICASSP, May 2020. Slakh: the Synthesized Lakh Dataset, a dataset for music source separation synthesized from MIDI data using professional-grade sample-based virtual instruments. Please refer to: Ethan Manilow, Gordon Wichern, Prem Seetharaman, Jonathan Le Roux, "Cutting Music Source Separation Some Slakh: A Dataset to Study the Impact of Training Data Quality and Quantity," in Proc. IEEE Workshop on Applications of Signal Processing to Audio and Acoustics (WASPAA), Oct. 2019. WHAM!: The WSJ0 Hipster Ambient Mixtures dataset, a dataset for noisy speech separation. Please refer to: Gordon Wichern, Emmett McQuinn, Joe Antognini, Michael Flynn, Richard Zhu, Dwight Crow, Ethan Manilow, Jonathan Le Roux, "WHAM!: Extending Speech Separation to Noisy Environments," in Proc. ISCA Interspeech, Sep. 2019. Table listing the months in which major SP/ML conferences took place. (Python script to make your own) Script to generate the spatialized version of the WSJ0-based multi-speaker speech separation dataset used in multi-channel Deep Clustering experiments. Please refer to: Zhong-Qiu Wang, Jonathan Le Roux, John R. Hershey, "Multi-Channel Deep Clustering: Discriminative Spectral and Spatial Embeddings for Speaker-Independent Speech Separation," in Proc. IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP), Apr. 2018. Script to generate the WSJ0-based multi-speaker speech separation dataset used in Deep Clustering experiments. Please refer to: John R. Hershey, Zhuo Chen, Jonathan Le Roux, Shinji Watanabe, "Deep Clustering: Discriminative Embeddings for Segmentation and Separation," in Proc. International Conference on Acoustics, Speech, and Signal Processing (ICASSP), Mar. 2016. Sparse NMF with beta-divergence (Matlab; Apache 2.0 license). Please refer to: Jonathan Le Roux, Felix Weninger, John R. Hershey, "Sparse NMF – half-baked or well done?," Mitsubishi Electric Research Laboratories Technical Report, TR2015-023, Mar. 2015. [Python version by Maxime Woringer] NDS: Non-negative dynamical system (Matlab; MERL research-only license). Please refer to: Cédric Févotte, Jonathan Le Roux, John R. Hershey, "Non-Negative Dynamical System With Application to Speech and Audio," in Proc. International Conference on Acoustics, Speech, and Signal Processing (ICASSP), May 2013. Consistent Wiener Filtering code (Matlab; Research-only license). Please refer to: Jonathan Le Roux and Emmanuel Vincent, "Consistent Wiener Filtering for Audio Source Separation," IEEE Signal Processing Letters, Vol.20, No. 3, Mar. 2013. Francesco Nesta, Marco Matassoni, Jonathan Le Roux, Shinji Watanabe, Jon P. Barker and Emmanuel Vincent, ``The 2nd CHiME Speech Separation and Recognition Challenge WSJ0 dataset,'' URL: http://spandh.dcs.shef.ac.uk/chime_challenge/chime2013/track2_results.html, 2012. LWS: Fast spectrogram phase recovery using Local Weighted Sums (C/C++, Matlab, Python; Apache 2.0 license). Please refer to: Jonathan Le Roux, Hirokazu Kameoka, Nobutaka Ono, Shigeki Sagayama, ``Fast Signal Reconstruction from Magnitude STFT Spectrogram Based on Spectrogram Consistency,'' in Proc. International Conference on Digital Audio Effects (DAFx), pp. 397--403, Sep. 2010. Shift-invariant Semi-NMF (Matlab). Please refer to: Jonathan Le Roux, Alain de Cheveigné and Lucas C. Parra, "Adaptive Template Matching with Shift-Invariant Semi-NMF," in Advances in Neural Information Processing Systems 21 (Proc. NIPS 2008), D. Koller, Y. Bengio, D. Schuurmans, and L. Bottou, Eds. Cambridge, MA: The MIT Press, 2009. I put some general purpose software on this page. The most useful piece of software listed there is probably IguanaTex, a free PowerPoint add-in to include LaTeX displays, whose development I have taken over from its original author. IguanaTex is a very good alternative to TexPoint, which unfortunately seems to have fallen into abandonware.

• 学位論文

  Jonathan Le Roux, "Exploiting Regularities in Natural Acoustical Scenes for Monaural Audio Signal Estimation, Decomposition, Restoration and Modification," Ph.D. dissertation, The University of Tokyo & Université Paris 6, Mar. 2009. [.pdf] [.bib]

• 数学関連 (前世)

  Eric A. Carlen, Maria C. Carvalho, Jonathan Le Roux, Michael Loss and Cédric Villani, "Entropy and Chaos in the Kac Model," in Kinetic and Related Models, Vol. 3, No. 1, pp. 85–122, Mar. 2010. [.pdf] [.bib] Jonathan Le Roux, "On Kac's Model in Kinetic Theory," Master's Thesis, 2003. (in French) [.pdf] [.bib] Jonathan Le Roux, "Introduction to Boltzmann Equation," Part of my Magistere's Thesis (Graduation of the ENS Maths Department), 2003. (in French) [.pdf] Jonathan Le Roux, "Spectral Properties of Elliptic Operators on Compact Manifolds," Master's Thesis, July 2001. (in French) [.pdf] [.bib] Jonathan Le Roux, "The Berlekamp Switching Game," TIPE (2nd year personal research project, part of France's "Grandes Ecoles" competitive entrance examinations), June 1999. (in French) [.pdf]

• 表彰等

  Best Student Paper Award for "Hyperbolic Audio Source Separation," ICASSP 2023, Jun. 2023. Recognized as Outstanding Reviewer by the Organizing Committee of ICASSP 2023, Jun. 2023. Best Team out of 11 at the DCASE 2023 Task 6a Automatic Audio Captioning Challenge, May 2023. Recognized as #17 for default "Citation Only" metric and #13 for "Credit" metric in the 2023 AI 2000 list of Most Influential Scholars in Speech Recognition, Aminer, Feb. 2023. 5th Best Team out of 32 at the DCASE 2022 Task 2 Unsupervised Anomalous Sound Detection Challenge, Jul. 2022. Best Poster Award, Best Video Award for "Hierarchical Musical Source Separation," ISMIR 2020, Oct. 2020. Recognized as #26 in the list of 100 Most Influential Scholars in Speech Recognition for 2009-2019, Aminer, Feb. 2020. Best Paper Award for "MIMO-SPEECH: End-to-End Multi-Channel Multi-Speaker Speech Recognition," ASRU 2019, Dec. 2019. Recognized as #100 in the list of 100 Most Influential Scholars in Speech Recognition for 2007-2017, Aminer, Mar. 2019. Best Student Paper Award for "Multi-Channel Deep Clustering: Discriminative Spectral and Spatial Embeddings for Speaker-Independent Speech Separation," ICASSP 2018, Apr. 2018. 2nd Best Performance out of 9 submissions at the DSTC5 Dialog State Tracking Challenge, Dec. 2016. 3rd Best Performance out of 15 submissions at the 4th CHiME Speech Separation and Recognition Challenge, 6-channel track, Dec. 2016. Best Performance out of 5 teams at MIREX 2016 Singing Voice Separation Task, Aug. 2016. 2nd Best Performance out of 25 submissions at the 3rd CHiME Speech Separation and Recognition Challenge, Dec. 2015. 日本音響学会 第34回粟屋潔学術奨励賞 受賞 (2013年9月) 2nd CHiME challenge Track 2 (雑音・残響環境下中語彙連続音声認識) 優勝 (結果) (2013年6月) 情報処理学会 平成22年度 山下記念研究賞 受賞 (2011年3月) 平成20年度 東京大学大学院 情報理工学系研究科 研究科長賞 受賞 電気通信普及財団 海外渡航旅費援助 採択 （ICASSP 2007での発表に対して） 日本政府（文部科学省）奨学金、2005年4月～2009年3月 日本国際協力協会（AIEJ）奨学金、2003年9月～2004年8月 Ecole Normale Supérieure (ENS) 4年間フルフェローシップ、1999年9月～2004年8月（中国での1年間は休学） National Rank 13 at the Competitive Entrance Examination for the École Normale Supérieure (ENS) of Paris (Maths -- C/S), 1999 National Rank 1 at the Competitive Entrance Examination for the École Polytechnique (Maths/Physics -- MP), 1999 "Mention Régionale" (National Rank 9-16), Concours Général de Mathématiques, 1997

• プレス

  MERLの音源分離技術についてのTWIML AI Podcastインタビュー Seamless Speech Recognition (2019): NHK, News (Japanese); NHK World, News (English), video report (starting at 4'38"); TV Asahi, ANN news (Japanese); Nippon TV, News24 (Japanese); Fuji TV, Prime News Alpha (Japanese); TV Tokyo, World Business Satellite (Japanese); TV Tokyo, Morning Satellite (Japanese); TBS, News, N Studio (Japanese); The Asahi Shimbun (Japanese); The Nikkei Shimbun (Japanese); Nikkei xTech (Japanese); Response (Japanese) Single-channel multi-speaker separation using deep clustering (2017): NPR, All Tech Considered (English); TBS, N Studio (Japanese); TV Tokyo, World Business Satellite (Japanese); Fuji TV, News, "Minna no Mirai" (Japanese); IEEE Spectrum (English); The Nikkei (Japanese); Nikkei Technology Online (Japanese); Sankei Biz (Japanese); EE Times Japan (Japanese); ITpro (Japanese); Nikkan Sports (Japanese); Nikkan Kogyo Shimbun (Japanese); Dempa Shimbun (Japanese); Il Sole 24 Ore (Italian) Noise-suppression technology for high-quality voice communication (2015): IEEE Spectrum (English); Asahi Shimbun (Japanese)

対外活動等

委員・座長

• Co-Organizer of the SANE 2023 workshop, October 26, 2023, New-York, NY
• Co-Organizer of the Special Session on Multi-talker methods in Speech Processing at Interspeech 2023
• Session Chair for ICASSP 2023
• Town Hall Panelist for DCASE 2022
• Co-Organizer of the SANE 2022 workshop, October 6, 2022, Cambridge, MA
• Technical Program Co-Chair for WASPAA 2021
• Session Chair for Interspeech 2021
• Session Chair for ICASSP 2021
• Session Chair for DCASE 2020
• Session Chair for Interspeech 2020 ("Targeted Source Separation", "Speech Enhancement")
• Session Chair for ICASSP 2020 (AUD-P8)
• Session Chair for DCASE 2019
• Co-Organizer of the SANE 2019 workshop, October 24, 2019, Columbia University, New York, NY
• Session Chair for ICASSP 2019 (AASP-L4)
• Co-Organizer of the SANE 2018 workshop, October 18, 2018, Google, Cambridge, MA
• Session Chair for ICASSP 2018 (AASP-L2)
• Organizer and Chair of the first-ever on-stage live demo session at ASRU 2017
• Co-Organizer of the SANE 2017 workshop, October 19, 2017, Google, New York, NY
• Session Chair for WASPAA 2017 (P1)
• Session Chair for ICASSP 2017 (AASP-P1)
• Co-Organizer of the SANE 2016 workshop, October 21, 2016, MIT, Cambridge, MA
• Session Chair for ICASSP 2016 (AASP-P7)
• Co-Organizer of the SANE 2015 workshop, October 22, 2015, Google, New York, NY
• Co-Organizer and Co-Chair of the Special Session on "Robots for Audio, Audio for Robots" (SS-L3) at ICASSP 2015
• Session Co-Chair for ICASSP 2015 (AASP-P10)
• Co-Organizer of the SANE 2014 workshop, October 23, 2014, MIT, Cambridge, MA
• Oral Session Co-Chair for ICASSP 2014 (AASP-L2)
• Manager of the sane-news mailing list on speech and audio research in the Northeast of the American continent
• Co-Organizer of the SANE 2013 workshop, October 24, 2013, Columbia University, New York, NY
• Program Co-Chair for the 2nd International Workshop on Machine Listening in Multisource Environments (CHiME 2013), June 1, 2013, Vancouver, Canada
• Organizing Committee Member for the 2nd ``CHiME'' Speech Separation and Recognition Challenge, 2012, supported by the IEEE Technical Committees AASP-TC, MMSP-TC and SL-TC
• Co-Organizer of the SANE 2012 workshop, October 24, 2012, MERL, Cambridge, MA
• Session Co-Chair for ICASSP 2012 (MLSP-P5)
• Organizer of the ``Audio and Music Signal Processing Mini-Symposium,'' October 20, 2011, MERL, Cambridge, MA

査読者

• 論文誌
  • IEEE Transactions on Audio, Speech, and Language Processing
  • IEEE Transactions on Signal Processing
  • IEEE Journal of Selected Topics in Signal Processing
  • IEEE Signal Processing Letters
  • IEEE Geoscience and Remote Sensing Letters
  • Signal Processing (Elsevier)
  • Speech Communication (Elsevier)
  • Pattern Recognition (Elsevier)
  • Computer Speech and Language (Elsevier)
  • Journal of Computational and Applied Mathematics (Elsevier)
  • EURASIP Journal on Audio, Speech, and Music Processing
  • 電子情報通信学会論文誌（和文論文誌・英文論文誌）
  • 情報処理学会 IPSJ Journal of Information Processing
  • Acta Acustica
• 国際会議
  • IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP)
  • IEEE Workshop on Applications of Signal Processing to Audio and Acoustics (WASPAA)
  • IEEE Global Conference on Signal and Information Processing (GlobalSIP)
  • IEEE Hands-free Speech Communication and Microphone Arrays (HSCMA)
  • IEEE European Signal Processing Conference (EUSIPCO)
  • IEEE International Workshop on Acoustic Signal Enhancement (IWAENC)
  • IEEE International Symposium on Circuits and Systems (ISCAS)
  • ISCA Interspeech
  • ISCA Workshop on Statistical And Perceptual Audition (SAPA)
  • International Conference on Latent Variable Analysis and Signal Separation (LVA/ICA)
  • International Conference on Digital Audio Effects (DAFx)
  • NIPS
  • NIPS End-to-end Learning for Speech and Audio Processing Workshop
  • REVERB Workshop
  • Workshop on Detection and Classification of Acoustic Scenes and Events (DCASE)
  • ACM International Conference on Multimodal Interaction (ICMI)
  • ACM Multimedia Conference (ACM-MM)
  • ACM SIGGRAPH
  • Asia-Pacific Signal and Information Processing Association Annual Summit and Conference (APSIPA)

所属学会

• Institute of Electrical and Electronic Engineers, IEEE: Senior member
• IEEE Signal Processing Society Audio and Acoustic Signal Processing Technical Committee (IEEE AASP TC) (2014.1 - 2019.12)

経歴

2023.04-Present	Distinguished Research Scientist, Mitsubishi Electric Research Labs (MERL), Cambridge, MA, USA.
2020.04-Present	Speech & Audio Senior Team Leader, Mitsubishi Electric Research Labs (MERL), Cambridge, MA, USA.
2018.01-2020.03	Speech & Audio Team Leader, Mitsubishi Electric Research Labs (MERL), Cambridge, MA (USA).
2017.10-2023.03	Senior Principal Research Scientist, Mitsubishi Electric Research Labs (MERL), Cambridge, MA (USA).
2014.04-2017.09	Principal Research Scientist, Mitsubishi Electric Research Labs (MERL), Cambridge, MA (USA).
2011.04-2014.03	Research Scientist, Mitsubishi Electric Research Labs (MERL), Cambridge, MA (USA).
2009.04-2011.03	NTTコミュニケーション科学基礎研究所 メディア情報研究部 メディア認識研究グループ リサーチアソシエイト
2009.03	東京大学大学院 情報理工学系研究科システム情報学専攻 博士課程終了。指導教員：嵯峨山茂樹教授
2009.03	パリ第6大学大学院 電気通信情報理工学研究科 (EDITE) 博士課程終了。指導教員：Dr. Alain de Cheveigné
2006.08-2006.11	中国北京 Microsoft Research Asia 研究所音声グループにて学外実習(3ヵ月)。指導教員：Dr. Frank Soong
2005.04-2009.03	国費留学生(文部科学省奨学生)
2004.11-2005.03	NTTコミュニケーション科学基礎研究所(京阪奈地区)にて学外実習(4ヵ月)。指導教員：Dr. Erik McDermott
2003.08-2004.08	東京大学大学院数理科学研究科交換留学生。指導教員：俣野博教授
2003.07	パリ第6大学大学院数学研究科確率過程専攻修士課程終了。指導教員：Prof. C. Villani
2001.08-2002.08	中国科学院自動化研究所中仏研究室(LIAMA)にてインターンシップ (中国、北京)。指導教員：Dr. Philippe de Reffye
	中国語能力試験（漢語水平考試、HSK）8級（中級 A、最高11級）
2001.07	パリ第11大学大学院数学研究科偏微分方程式専攻修士課程終了 (1位)。指導教員：Prof. P. Gérard
1999 夏	École Polytechniqueに首席合格
	パリのÉcole Normale Supérieure (エコール・ノルマル - ENS)に合格 (13位)
	パリのENSの数理科学研究科に進学
1997.09-1999.06	フランスの"Grandes Écoles"への予備校クラス(数学、物理学専攻)、Lycée Henri IV、パリ
1997.06	高校卒業, Summa Cum Laude

リンク/個人ホームページ

• Chokotto - ちょこっと, たまあにちょこっと書いているブログ
• De l'origine du monde - 手酌,日本語とフランス語で書いてるブログ
• ボーカルを担当しているバンド The Empty Bed のMyspaceページ(試聴可)とオフィシャルHP
• École Normale Supérieureでの旧ホームページ (フランス語)
• 東京大学大学院情報理工学系研究科 システム情報学専攻 嵯峨山・小野研究室
• 博士論文のためにまとめたいくつかの Latex の Tips (English version)
• GNU EmacsのBibTex-ModeのManual（注意：私の書いたマニュアルではありません）