CEDEC 09: Sony Demonstrates Photo and Facial Recognition Technology
http://gamasutra.com/php-bin/news_index.php?story=25108
...explains photo recognition and facial recognition.
Photo matching:
Facial recognition:
SPU implementation:
For gaming:
http://gamasutra.com/php-bin/news_index.php?story=25108
...explains photo recognition and facial recognition.
Photo matching:
In the demonstration, they showed a close-up photo of a red flower in an open field. Using a convolution filter, they showed how an image can be softened (low-pass), sharpened (high-pass) or detect edges (sobel/laplacian) and a pyramid filter was also shown to demonstrate noise reduction.
Next, they showed three images and ran a comparison match to see which two photos were identical. If they match, the screen would essentially all turn black giving a value of 0. Now this is all just talking about still images. All of the above are utilized in tracking movement, a girl stood in front of the Playstation Eye moving her hands.
...
Facial recognition:
As for facial recognition, the technology may be familiar to many as it has now become a feature in most digital cameras. The process of facial recognition can be divided into four steps. The first, which also takes the most amount of processing time, is face detection. A detection box of at least 20x20 pixel would sweep across the entire space.
... [More about the 4 steps in the article]...
SPU implementation:
With libface, one or more SPU can be used in face processing. For example, setting the parameter to 47 pixels would take 58 milliseconds with one SPU. With multiple SPUs, the process can be sped up and reduced to 15 milliseconds.
For gaming:
Some applications such as avatar-linked facial recognition and pattern recognition were briefly shown. With the former, it would find the alignment of each user's face, so if the user smiles, the avatar on screen will also smile likewise.
The latter is used in mini-games such as "Smile Competition". Users would smile in front of the camera and whoever scores higher wins the match. Although the application focuses on facial recognition, this can also be used in detecting specific objects through higher level detection algorithms.