Tesis doctoral de Francisco Javier Orozco Cano
Psychological evidence has emphasized the importance of affective behaviour understanding due to its high impact in nowadays interaction humans and computers. All type of affective and behavioural patterns such as gestures, emotions and mental states are highly displayed through the face, head and body. Therefore, this thesis is focused to analyse affective behaviours on head and face. To this end, head and facial movements are encoded by using appearance based tracking methods. Specifically, a wise combination of deformable models captures rigid and non-rigid movements of different kinematics; 3d head pose, eyebrows, mouth, eyelids and irises are taken into account as basis for extracting features from databases of video sequences. This approach combines the strengths of adaptive appearance models, optimization methods and backtracking techniques. for about thirty years, computer sciences have addressed the investigation on human emotions to the automatic recognition of six prototypic emotions suggested by darwin and systematized by paul ekman in the seventies. The facial action coding system (facs) which uses discrete movements of the face (called action units or aus) to code the six facial emotions named anger, disgust, fear, happy-joy, sadness and surprise. However, human emotions are much complex patterns that have not received the same attention from computer scientists. simon baron-cohen proposed a new taxonomy of emotions and mental states without a system coding of the facial actions. These 426 affective behaviours are more challenging for the understanding of human emotions. Beyond of classically classifying the six basic facial expressions, more subtle gestures, facial actions and spontaneous emotions are considered here. By assessing confidence on the recognition results, exploring spatial and temporal relationships of the features, some methods are combined and enhanced for developing new taxonomy of expressions and emotions. the objective of this dissertation is to develop a computer vision system, including both facial feature extraction, expression recognition and emotion understanding by building a bottom-up reasoning process. Building a detailed taxonomy of human affective behaviours is an interesting challenge for head-face-based image analysis methods. In this paper, we exploit the strengths of canonical correlation analysis (cca) to enhance an on-line head-face tracker. A relationship between head pose and local facial movements is studied according to their cognitive interpretation on affective expressions and emotions. Active shape models are synthesized for aams based on cca-regression. Head pose and facial actions are fused into a maximally correlated space in order to assess expressiveness, confidence and classification in a cbr system. The cbr solutions are also correlated to the cognitive features, which allow avoiding exhaustive search when recognizing new head-face features. Subsequently, support vector machines (svms) and bayesian networks are applied for learning the spatial relationships of facial expressions. Similarly, the temporal evolution of facial expressions, emotion and mental states are analysed based on factorized dynamic bayesian networks (fadbn). as results, the bottom-up system recognizes six facial expressions, six basic emotions and six mental states, plus enhancing this categorization with confidence assessment at each level, intensity of expressions and a complete taxonomy.
Datos académicos de la tesis doctoral «Human emotion understanding on facial image sequences«
- Título de la tesis: Human emotion understanding on facial image sequences
- Autor: Francisco Javier Orozco Cano
- Universidad: Autónoma de barcelona
- Fecha de lectura de la tesis: 28/07/2009
Dirección y tribunal
- Director de la tesis
- Jordi González Sabaté
- Tribunal
- Presidente del tribunal: manuel Graña romay
- beat Fasel (vocal)
- (vocal)
- (vocal)