Multi-Source Simultaneous Speech Translation

Zveřejněno: 26. 2. 2024

We investigate the opportunity to use multiple parallel speech signals — the original and simultaneous interpreting — as sources for translation to achieve higher quality of the simultaneous speech translation. We create an evaluation set ESIC (Europarl Simultaneous Interpreting Corpus). We analyze the challenges of simultaneous interpreting when used as an additional parallel source. Then, we investigate the robustness of multi-sourcing to transcription errors and assess the reliability of machine translation metrics when evaluating simultaneous speech translation. Last but not least, we demonstrate Whisper-Streaming, our tool that enables real-time processing of large offline speech-to-text models.

Beseda začne ve 14 hodin. Pro sledování pondělních přednášek online použijte prosím následující odkaz: https://cesnet.zoom.us/j/99354954426?pwd=NlBnMERZeW1uUGRCRmRUOEIrUTFhQT09

Termín: Pondělí, 4.března 2024 - 14:00

Místo konání: MFF UK, Malostranské nám. 25, 4.patro, místnost S1

Více informací: https://ufal.mff.cuni.cz/events/multi-source-simultaneous-speech-translation