Description:
- Entertainment industry
- Facial tracking
Abstract
USC researchers have developed a software that inputs 3D depth maps and RGB video with a generic 3D facial model to track a subject. This is able to handle occlusions such as a hand or hair occluding the face, and automatically adjusts the generic face model to the shape and appearance specific to a person.
Benefit
- Real-time facial performance capture
- Superior tracking accuracy
- Scalable
Market Application
The 3D animation market is expected to be worth $21 billion by 2020. Advancements in real-time 3D facial capture systems have created highly scalable animation and affordable production tools. In addition to this, mobile social media apps with facial manipulation have been popularized. Although there have been large advancements in these technologies, pure RGB solutions are still susceptible to occlusions which result in unpleasant visual artifacts or the inability to correct initialize facial tracking.
Publications
Real-time facial segmentation and performance capture from RGB input, ECCV 2016
Other
- Experimentally validated
- Available for non-exclusive license
Status: Software available