Senior Scientist, Foundation Models For Speech

OverviewTranslated is on a mission to allow everyone to understand and be understood, in their own language.We are a technology-powered professional translation provider.We partner with over 200,000 professional translators worldwide, in 200 languages.Our 310,000 clients range from the private person who needs their CV translated to the very big, like Uber and Airbnb.Our progress is largely powered by our ability to leverage scientific progress and realize the best synergy between humans and machines.We invest heavily in R&D, such as LLMs applied to translation, expressive speech synthesis, and privacy-preserving training for translation.We operate as a science-driven startup, so that our scientific innovations quickly make it to production and make a measurable impact on our operations.Project Overview – MeetweenTranslated has just been awarded a grant on Meetween, a €7 M, 4-year collaborative research project started in January ****, which Translated leads.Meetween uses LLMs and multimodal foundation models to enhance human communication.The project covers Deep Learning, Large Language and Multimodal models, Machine Translation, Automatic Speech Recognition and Translation, Summarization, and AI Digital Assistants.The goal is to build foundation models that model all three modalities of speech (text, audio, video including lip movement, facial expression and gestures) in a single architecture, enabling downstream tasks such as ASR, zero-shot TTS and voice cloning, speech-to-speech translation, lip reading, and audio/video mutual reconstruction/enhancement.We have secured an ambitious computing budget on the Polish HPC infrastructure with hundreds of thousands of A100-hours, in addition to our in-house compute infrastructure of several hundred GPUs.All research outcomes will be open-sourced on HuggingFace.ResponsibilitiesWork with data, compute, and algorithms.Design deep learning multimodal neural architectures.Design experiments, implement them in code, run them on large GPU-HPC compute, and run evaluations.Monitor and benchmark the state of the art.Provide guidance to junior team members such as PhD students and interns.Coordinate with partners on the research roadmap.Adapt the project's pace to rapid scientific development.Organize publications and open-source efforts.RequirementsCompleted PhD or 4 years of industry research experience in a relevant field of deep learning, typically language modeling or speech recognition.Excellent programming skills in PyTorch.Familiarity with Docker and Unix OS, including running GPU experiments.Interest in carrying out experimental research.Relevant scientific publications, teaching and research experience.Experience in the speech and language technology industry.Experience coordinating a team of researchers.Excellent command of English.Bonus PointsStrong in multi-GPU training and GPU training optimization.Polyglot.Open-source contributions.Publications at tier-1 ML/AI conferences such as NeurIPS, ICML, ICASSP, Interspeech, ACL, EMNLP.Seniority LevelMid-Senior levelEmployment TypeFull-timeJob FunctionResearch, Analyst, and Information TechnologyIndustriesTranslation and LocalizationHeadquartersTranslated is hosted at Pi Campus, a working environment immersed in nature where six luxury villas in Rome (Italy) have been converted into functional offices to foster talent growth.Pi Campus is also a venture firm created by Translated to reinvest part of its profits into promising AI startups.Benefits and PerksAt Translated, we see our people as athletes, and Pi Campus as the place where they can reach their full potential.This vibrant environment fosters talent aggregation and continuous growth of mind, body, and spirit.We nurture and support the team's personal and professional development every day through growth-oriented initiatives like personalized learning paths and networking events with industry leaders, health-oriented initiatives such as massages, sauna, and workouts in our gym and swimming pool, as well as relaxation rooms, open meeting rooms, a cafeteria, and fully equipped kitchens in every villa.In case of need, every team member has access to psychological, legal, and financial support.Diversity StatementAt Translated, we proudly embrace and celebrate each individual's unique qualities regardless of race, sexual orientation, gender identity, or any other differences.We recognize that these diverse perspectives empower us to overcome challenges, foster innovation, and drive excellence.As an inclusive and equal-opportunity employer, we are committed to cultivating an environment where everyone feels welcome, valued, and supported to achieve their full potential.#J-*****-Ljbffr