Researchers developed a model that enables a drone to shoot a video based on a desired emotion or viewer reaction. The drone uses camera angles, speeds and flight paths to generate a video that could be exciting, calm, enjoyable or nerve-wracking, depending on what the filmmaker tells it. They needed hundreds of videos and thousands of viewers to capture data on what makes a video evoke a certain emotion or feeling. They collected a few hundred diverse videos and then a few thousand viewers watched 12 pairs of videos and gave them scores based on how the videos made them feel.
The researchers then used the data to train a model that directed the drone to mimic the cinematography corresponding to a particular emotion. If fast moving, tight shots created excitement, the drone would use those elements to make an exciting video when the user requested it. The drone could also create videos that were calm, revealing, interesting, nervous and enjoyable, among other emotions and their combinations. The team tested their model by creating sample videos, like a chase scene or someone dribbling a soccer ball and asked viewers for feedback on how the videos felt.
More information:
https://www.sciencedaily.com/releases/2021/06/210603171213.htm