Actor-by-Actor Face Emotion Recognition
Our Actor-by-Actor Face Emotion Analysis feature delivers detailed emotional insights for every individual detected within a video. Leveraging advanced face recognition and detection technology, the AI system processes the uploaded video to identify each unique face present. Each detected face is then assigned a distinct face ID (e.g., Face ID 1, Face ID 2) to ensure easy tracking and reference throughout the analysis.
This feature focuses on analyzing facial emotions in video content, providing precise emotion data linked to each detected face. Built on top of our core face emotion analysis engine, it enables you to interpret emotion dynamics at the individual face level—what we refer to as "actors" or "faces"—in multi-person video content.
Using our facial expression recognition technology, you can capture subtle emotional cues for each actor (such as happiness, surprise, sadness, or neutrality) and get a clear view of how emotions vary across participants in the video.
After processing, our AI system displays emotion data associated with each face ID, allowing users to examine individual emotional journeys or observe aggregated emotional trends across all faces.
Real Example: Actor-by-Actor Face Emotion Recognition in a 30-Second Ad
In this 30-second video ad, our system automatically detected 5 unique faces and assigned them Face IDs.
Using face detection and recognition technology, each person’s emotional response was analyzed individually across the full video duration.
Here’s the dominant emotion detected for each face :
Face ID 1 → Dominant Emotion: Surprise (88.06%)
Face ID 2 → Dominant Emotion: Surprise (80.14%)
Face ID 3 → Dominant Emotion: Surprise (68.81%)
Face ID 4 → Dominant Emotion: Surprise (47.37%)
Face ID 5 → Dominant Emotion: Surprise (56.24%)
The overall dominant emotion across all faces was also Surprise , but this example highlights how each actor displayed different levels of emotional intensity , even when expressing the same emotion.
With actor-by-actor face emotion tracking , you can pinpoint exactly how each individual contributes to the emotional tone of the content—making it easier to assess the emotional performance of every face in the video.
Actor-by-actor Face Emotion Recognition is particularly valuable in complex scenes such as interviews, panel discussions, customer testing sessions, or team interactions—where understanding individual reactions is just as important as the group dynamic.
Whether you want to focus on a single actor’s emotions or compare emotional responses across several individuals, our Actor-by-Actor Face Emotion Analysis feature gives you complete control to understand the emotional dynamics in any video.
NB: This capability is made possible through the use of advanced emotion recognition AI , which interprets facial movements and expressions over time to deliver high-accuracy, actor-specific emotional insights. This actor-level tracking is a key capability of our video emotion recognition and image emotion recognition technology. This feature is part of Imentiv's broader multimodal emotion recognition technology. For audio content, our AI performs speaker-by-speaker emotion analysis , assigning unique speaker IDs and tracking emotional changes across time segments. Just like faces in videos, speakers in audio clips are isolated and analyzed for clearer emotional interpretation.
We are also developing a powerful enhancement: the ability to match faces with speakers , allowing users to rename both face and speaker IDs to reflect real participants. This cross-modality matching will bring even more clarity and personalization to your emotional data, enabling streamlined insights across audio-visual content.