Trying to create a simple motion tracking patch using PD_extended and Gem, I came across this project by Elektro Moon Vision http://elektromoon.co.nr/ the mini App provides OSC data from movements such as eyebrows, nose, mouth, orientation scale etc. This is massively useful for an experiment I have in mind related to the “strange face in the mirror illusion” The data can be captured and used to control a 3D model in virtual space for example. Matching rotation, scale and orientation to the model and the movement of my head…

This is a simple motion detection patch that tracks the difference between two frames creating ghostly outlines of momentarily disembodied features. It’s sensitive enough to pick up facial expressions such as the movement of muscles and eyeballs. A combination of these two systems should be enough to develop a system of projecting on to a face and follow its movements.

See here for the experiments with the strange face in the mirror illusion so far…