How to reduce input lag in a Virtual Production Studio

October 7, 2022
Authors:

Abstract

The goal of this paper is to have a closer look into the problems with a Virtual Production (VP) Studio technology and review potential solutions for reducing the input lag in a VP Studio, especially for the benefit of small enterprises willing to use VP systems. A number of VP Studios have tried to address the industry-wide problems with in-house solutions, however, due to the lack of sufficient processing power, communication difficulties between proprietary systems, and the need to produce real time content that would play back at sufficient speed and with sufficient precision, VP Studio concept has remained challenging for a long period of time. Eventually, Epic Games led the development of the nDisplay system, using Unreal Engine to render 3D content simultaneously to multiple displays in real time. This paper focuses on the display technology as well as the limitations of existing hardware and display paradigms. There are three major problems for real-time processing in film making: input lag, latency and response time. There is a need to investigate how to optimise input lag and response time and determine if the benefits will outweigh the costs of VP Studios. Reviewing and discussing findings of previous research studies, and industry practitioners’ reports, the paper provides a list of potential solutions for reducing the input lag in a VP Studio. To reduce input lag our recommendation is to conduct testing on a wide range of display systems, display modulation techniques such as PWM, and LightBoost and strobe-backlights.

Cited by

  1. Blasonato, M., Cremona, C., Kavakli, M., & Staines, D. (2022). Immersive sims: A new paradigm or a new game genre? In: M. Kurosu (ed), Human-computer interaction: Theoretical approaches and design methods: HCII 2022: Lecture notes in computer science: Vol. 13302 (pp. 18–39). Springer. https://doi.org/10.1007/978-3-031-05311-5_2.

Keywords

/ / /

References

  1. N. Kadner, “The Virtual Production Field Guide. Volume 1,” Epic Games, (2019) https://cdn2.unrealengine.com/Unreal+Engine%2Fvpfieldguide%2FVP-Field-GuideV1.2.02-5d28ccec9909ff626e42c619bcbe8ed2bf83138d.pdf. Accessed on 2 Feb 2022
  2. Weta Digital, Virtual Production, (2021) https://www.wetafx.co.nz/research-and-tech/technology/virtual-production.. Accessed on 2 Feb 2022
  3. S. Dalkian, “nDisplay Technology Whitepaper,” Epic Games, (2019). https://cdn2.unrealengine.com/Unreal+Engine%2Fndisplay-whitepaper-final-updates%2FnDisplay_Whitepaper_FINAL-f87f7ae569861e42d965e4bffd1ee412ab49b238.pdf. Accessed on 2 Feb 2022
  4. World-first film and virtual production course announced by the Academy of Interactive Entertainment, 6 May 2021, (2021)last accessed on 25 Jan 2022, https://aie.edu.au/articles/world-first-film-and-virtual-production-course-announced/
  5. Kavakli, M, Cremona, C., An Overview of The Virtual Production Studio Concept – An Emerging Game Changer in Filmmaking, IEEE VR 2022: the 29th IEEE Conference on Virtual Reality and 3D User Interfaces, 12-16 March, 2022, Virtual, p.1-9, (2022)
  6. Technicolor, Technicolor Genesis –Real Time Virtual Production, last accessed on 25 Jan 2022, https://www.youtube.com/watch?v=x5O2E-jvUbE&t=48s&ab_channel=technicolor. (2019).
  7. Teambeyond.net, Feb (2016), last accessed on 25 Jan 2022, https://teambeyond.net/forum/topic/12751-quick-and-hidden-tips-to-decrease-input-lag-in-your-display,
  8. Lincoln, P.C., LOW LATENCY DISPLAYS FOR AUGMENTED REALITY, PhD Dissertation, University of North Carolina, (2017), last accessed on 25 Jan 2022, https://sreal.ucf.edu/wp-content/uploads/2018/02/dissertation_lincoln-op.pdf
  9. Wilson, D., Exploring Input Lag Inside Out, 16 July (2009), last accessed on 25 Jan 2022, https://www.anandtech.com/show/2803
  10. Simmons, A., Factors Affecting PC Monitor Responsiveness, (2020), last accessed on 25 Jan 2022, https://pcmonitors.info/articles/factors-affecting-pc-monitor-responsiveness/ 11. Baker, S., Pulse Width Modulation (PWM), TFT Central, March 17, (2015), last accessed on 2 Feb 2022, https://tftcentral.co.uk/articles/pulse_width_modulation
  11. OLED Info (2022a), An introduction to OLED displays, last accessed on 2 Feb 2022, https://www.oled-info.com/oled-introduction
  12. OLED Info (2022b), Pulse-width modulation (PWM) in OLED displays, last accessed on 2 Feb 2022, https://www.oled-info.com/pulse-width-modulation-pwm-oled-displays
  13. Rejhon M., Motion Blur Reduction (ULMB, LightBoost, etc), Apr 29, (2018), last accessed on 2 Feb 2022, https://blurbusters.com/faq/motion-blur-reduction/ 15. Rejhon M., List of Best Gaming Monitors – 120Hz, 144Hz, 240Hz, FreeSync, G-SYNC, Feb 12, (2018), last accessed on 2 Feb 2022, https://blurbusters.com/faq/120hz-monitors/