The latest edition of the most powerful and versatile live graphics platform in the world includes Reality Connect™ talent immersion, extended Adaptive Graphics™ workflows for video walls, and an enhanced Unreal® Engine 5.1 integration.
Vizrt, the leader in real-time graphics and live production solutions for content creators, today announces the release of Viz Engine 5.1 which includes several leading-edge advances to live graphics workflows.
Introducing Reality Connect™
Building on the groundbreaking debut of Viz Engine 5, this version introduces Reality Connect – powered by Viz AI, marking a new era of AI-driven 3D talent immersion. Among its many anticipated uses, Reality Connect uses advanced AI algorithms to enable hyper-realistic talent immersion, including shadow casting and reflections within virtual studios and XR sets.
“Reality Connect solves the problem of people appearing to float in a virtual studio by enabling realistic shadow casting and reflections,” says Gerhard Lang, CTO at Vizrt. “Reality Connect anchors the talent within the virtual studio by utilizing virtual 3D models of the talent, which are continuously updated using Vizrt’s AI pose estimation. Our AI pose estimation operates on the same GPU and utilizes the live video feed used for keying.”
Saving on cost, Reality Connect does not require additional hardware. Presently, Reality Connect is exclusively compatible with the Viz Engine 5 native render pipeline and works in conjunction with the Precision Keyer. Reality Connect also offers the flexibility to seamlessly integrate data from any Mocap (motion capture) system, as an alternative option.
A new take on the Virtual Window for virtual studios
Vizrt’s invention of the Virtual Window™ transformed the utilization of video walls as far back as 2011, marking a significant industry shift and expanding their capabilities. This innovation serves as a fundamental component of Vizrt’s virtual studio offering.
Viz Engine 5.1 evolves the way Virtual Windows are created when using Viz Engine’s native render pipeline or Unreal’s render blade. The resulting solution takes advantage of the increased sensitivity of both new renderers to screen resolutions, and supports Vizrt’s mandate to enhance usability, particularly when working with intricate video wall configurations, such as curved surfaces and floors.
“With the updated version of the Virtual Window effect, no compromises in scene complexity and effects must be made. All shapes and forms of video walls, floors, and ceiling are covered by our new method,” adds Lang.
The combined output resolution of Vizrt’s new Virtual Window effect, video walls, ceilings, and floors can be up to four times UHD, allowing for large setups to be managed by a single Viz Engine.
Enabling previews when working with XR sets
Previously, one of the challenges users faced when using an XR sets was the lack of a proper preview. Vizrt works with ROE Visual to combine Viz Engine 5 and GhostFrame™ to introduce a better experience that is more comfortable and natural for talent.
GhostFrame enables up to four content feeds into an LED screen – which can be individually captured by a camera. You can select which feeds are visible for the presenter and production crew and which will be your live broadcast feed. The talent can truly interact with an AR object for example, without the hazard for virtual collisions, or look directly at the video wall for markers, teleprompting cues, or when conducting a remote interview; all of which are not visible in the live broadcast feed.
GhostFrame can also incorporate four different brandings or implement multiple video wall layouts using Viz Multiplay. Vizrt and GhostFrame partner ROE Visual will continue collaborating on the numerous creative workflows and possibilities achievable by uniting these innovative technologies.
Adaptive Graphics™ extend and adapt to video walls
Another Viz Engine 5.1 advancement is an extension of Adaptive Graphics – which now includes user-defined aspect-ratio support for video walls. Now, Adaptive Graphics can be intelligently adjusted to fit any video wall size, shape, and resolution.
By extending Adaptive Graphics’ faster and more efficient graphics production line to studio video walls, customers ensure a consistent look and unified brand identity across all platforms and displays, protecting the most vital asset of any media provider – its brand.
Viz Engine 5.1 and Unreal® Engine 5.1: The best graphics workflow in the industry
Viz Engine 5 introduced a completely new integration with Unreal Engine 5, one that addressed performance, workflow, controllability, and asset management. Viz Engine 5.1 supports both Unreal Engine 5.0 and 5.1 releases and includes nearly a dozen new advancements and features.
“Customer feedback regarding Unreal Engine 5 was a significant contributor to the development of Viz Engine 5.1. It stands as a signal to the industry that Vizrt continues to invest in this important partnership,” concludes Lang.
Beyond the features described here, Viz Engine 5.1 includes numerous improvements to the Viz Engine Renderer, the addition of Clip Player Pro as a value-added item available to Flexible Access customers, support for nearly 100 Data Connectors, and multiple Video I/O and security improvements.
Enjoying the news? Sign up for the Creative COW Newsletter!
Sign up for the Creative COW newsletter and get weekly updates on industry news, forum highlights, jobs, inspirational tutorials, tips, burning questions, and more! Receive bulletins from the largest, longest-running community dedicated to supporting professionals working in film, video, and audio.
Enter your email address, and your first and last name below!