Research Scientist Intern - Audio to Mouth Synthesis
Flawless, an innovative AI company highly recognized in the entertainment industry, is revolutionizing traditional filmmaking through its cutting-edge Gen AI film editing tools. Our goal is to equip filmmakers with advanced technology that fosters limitless creativity, broadens storytelling horizons, and delivers unmatched visual and emotional experiences.
Job Requirements: We are in search of an intern for a 4-6 month program with a focus on audio-visual synthesis, specifically concentrated on lip motion synthesis and head movement using diffusion-based techniques. The ideal candidate should be a Ph.D. student, preferably with experience in virtual talking heads or emotion-based talking synthesis models. The critical responsibilities include conducting independent research and developing algorithms adept at translating input audio into synchronized visual outputs. Candidates should possess expertise in training diffusion models, particularly in image synthesis, and a familiarity with technologies that animate emotions in videos. While prior publications are not mandatory, practical experience in these areas is highly valued.
Necessary Qualifications:
- Synthesize lip motion and head movement from audio input through diffusion-based methods.
- Conduct independent research to create algorithms incorporating advancements in audio-visual synthesis.
- Collaborate in a progressive research environment to contribute to pioneering advancements in the field.
- Proficiency in training diffusion models, particularly in image synthesis.
- Knowledge of emotion animation technologies utilized in projects like 'emote video alive'.
- Preferably Ph.D. candidates, though applicants with relevant experience and qualifications are encouraged.
- Research background with demonstrated publication history in top-tier conferences on computer vision/graphics and deep learning like ECCV, ICCV, CVPR, and SIGGRAPH.
Salary Range: $6,000 - $7,000 per month
Flawless is dedicated to fostering an equal opportunity, safe workspace where individuals can excel. We are committed to providing fair employment opportunities irrespective of characteristics such as race, color, ancestry, religion, gender, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity, or Veteran status. Furthermore, qualified candidates will be considered based on merit, regardless of any past criminal records, in accordance with legal provisions.