Exploring the Use of Collaborative Robots in Cinematography

In recent years, the use of robotic and automation technology has grown in various industries, including the film industry, as a way to improve efficiency, lower costs, and increase quality in tasks such as camera operation, lighting, and set design. Different types of robotic systems have been employed for these purposes, such as robotic camera systems that utilize pre-programmed motion trajectories to achieve special filming effects��[3] and camera robots that specialize in high-speed and precision moves [4]. Drones are also becoming increasingly popular for media production due to their maneuverability and the unique perspectives they offer. The potential uses of robotic technology in media production depend greatly on the specific form factor and capabilities of the robot. In this study, we focus on the potential of collaborative robot arms (also known as cobots) for cinematography.

Cobots are designed to work safely alongside human workers in shared, collaborative workspaces. Cobots have been rarely used for production of media, but they offer reasonable precision and repeatability while also being safe to interact with, which opens up new design opportunities. To gain a better understanding of how such emerging technology could be used in media production, we conducted exploratory interviews with three cinematography practitioners. We interviewed them about their prior experience in cinematography, demonstrated a prototype robotic system that showcased some unique capabilities enabled by a cobot, and asked them to create a storyboard incorporating the cobot in their filming process. In this paper, we report the thematic findings from our interviews, which provide insights into how practitioners envision the use of cobot technology in media production. Our main research question is: “How do cinematography practitioners perceive the use and application of collaborative robots in media production?”

The use of robots for cinematography in the media production industry has been increasing in recent years. Industrial robots have traditionally been used for high-speed and precise camera control and to create special effects [3, 4, 5]. Drones are used for aerial shots [1, 2], enabling creative shots that would otherwise be impossible due to cost, difficulty, or safety concerns for cinematographers. Additionally, research in robotics has explored various ways to support cinematographers. Hajjaj and Karim [11] found that camera operators’ attitudes towards robots in the film industry improved significantly when robotic cameras and dollies are perceived as social robots by their users. Yamamoto et al. [19] used collaborative robots to assist photographers in setting up their lighting configurations. To facilitate the ability to take cinematic shots, Pueyo et al. [14] simulated a cinema camera within a drone simulator, allowing the simulator’s parameters to be adjusted with the quality of the camera. Galvane et al. [8] and Gschwindt et al. [10] developed techniques to support automated cinematography with drones. These autonomous drones leveraged cinematographic principles to automatically select viewpoints during moving shots (e.g., following a moving actor) and made intelligent decisions for viewpoints to support the cinematographer in real-time. Hösl [12] and Galvane et al. [9] have explored the design of user-friendly camera control interfaces to support the cinematographer’s experience, including designing for gimbals, robots, and drone interfaces. These designed interfaces can support creativity, quality, and a sense of control for cinematographers. Finally, robot applications for filming are not reserved for professional settings but can also be designed for amateurs for entertainment and to support creativity. Sugimoto et al. [17] used handheld projectors augmented with a robotic character to support children’s creativity and storytelling skills and Zeglin et al. [20] used a robot in a live theatrical performance. Overall, previous research suggests that robots can support the creative processes of cinematographers in various roles and use cases.

Existing robotic camera systems tend to use industrial robots that are more precise, faster, and able to handle heavier payloads compared to collaborative robots. However, for some reduction in precision, speed, and payload capacity, cobots offer benefits such as safety, a smaller footprint, user-friendly interfaces, and lower costs. These unique capabilities present an exciting but under-explored design space for developing tools that support cinematography.

We report our findings in three categories: (1) Ability to meet cinematographers’ needs; (2) Compatibility with existing processes; and (3) Potential to open up new capabilities.

We found that from the perspective of cinematography practitioners, the adoption and utilization of technology could be impacted by various factors, such as: (1) the ability to meet cost, quality, mobility, creativity, and reliability requirements; (2) the compatibility and integration of tools with existing workflows, equipment, and software; and (3) the potential for new creative opportunities that the technology can open up. While the first two factors are essential practical considerations for researchers to keep in mind, research often centers around the third aspect—the potential for new creative opportunities. In light of this, we propose four key takeaways.

We thank Yeping Wang for his assistance in setting up the study. This work was supported by a NASA University Leadership Initiative (ULI) grant awarded to the UW-Madison and The Boeing Company (Cooperative Agreement #80NSSC19M0124) and an NSF award 1830242.