Next up Jean Maillard, who works on Meta’s Fundamental AI Research team, is talking about some of the projects he’s worked on in the language technologies space.
The technologies:
- No Language Left Behind (NLLB) - a machine text-to-text translation.
- UNESCO Language Translator - uses NLLB
- Open Language Data Initiative - a “shared task” to extend the language support of models
- a “shared task” is a partnership in the research community where many researchers collaborate to solve a single problem.
- Seamless Communication - speech-to-text, text-to-speech, and speech-to-speech
- Interestingly, you can change languages in real time, and the model can handle that.
- Massively Multilingual Speech Model - Automatic Speech Recognition (auto captioning) and Text-to-Speech (additional languages)
Challenges in the Multilingual Language Model Space:
- Resource Efficiency
- Data Efficiency
- Data Quality