Facial Motion Capture with Blender
Why Blender Stack Exchange recommends it
Blender Stack Exchange answerers point people to it as an example of tracking dots on a face to drive a 3D character when asked how to map real facial motion into Blender.
Recommended by 1 people across 1 different months, 2014 to 2016.
What it is
A short 2013 screen-recorded demo by the channel blazraidr showing facial motion capture done in Blender. The description just says everything is explained in the video, so it is a walkthrough with no written notes.
What people said
Recommends sambler · 2016-06 · Blender Stack Exchange · on “How do I use live motion, and paste a model onto it, like Gollum?”
There are two approaches you could take - Use motion capture [LINK] . This involves using an actor that normally has markers attached to various parts of their body which can then be tracked from several camera angles and then used to control an armature that moves your 3D character. Use motion tracking or match moving [LINK] . This is often broken into two parts, camera tracking and object tracking. Camera tracking allows you to recreate the camera motion in 3D so that objects you add will follow the environment in front of the camera as if they was in front of the real camera during filming. Object tracking then follows an object that moves within the video, this could be a prop that an ac
Cites 3DFIX · 2014-04 · Blender Stack Exchange · on “Facial Motion Capture in Blender with Depth Sensors and/or Multiple Camera setups”
hypothetical question here. I've been playing a lot with various animation methods over the past few days here, and have had a lot of successful results with clean full body motion capture ( here [LINK] ) So I have four playstation eyes and 2 kinects at my disposal. Is there a way to do a multi camera, depth based facial track, a multi video track, or just depth inside of blender's existing tools, or is there a scriptable workaround? I realize there are some problems inherent in a multi camera setup, such as: 1: assuring the cameras are properly aligned within the software to the real world setup, and I'm aware Blender probably doesn't solve that for you. I'm okay with creating a precise mea
Cites Rob781 · 2016-05 · Blender Stack Exchange · on “Map motions from real into 3D”
you can check out OpenKinect I don't know if it does what you are looking for ti will capture body movements but I don't know about the face capture... but there are pay alternatives like [LINK] that does it... or you can check out something like this [this video] with putting dots on your face like they did in movie Dawn of the Planet of the Apes ... just an FYI if you didn't know the Kinect method doesn't work well in sunlight that's why they had to use the dots but with the dots you should use it at high fps capture rate like 60+ the higher the batter and try not to drop the resolution to much... FYI a lot of action camera's like the gopro's have high fps... I don't know if that will help you.