VR experience a world first for New Zealand Symphony Orchestra patrons

New immersive VR technology is used to enhance orchestra performance

The New Zealand Symphony Orchestra has released a fully immersive Virtual Reality experience of the 90-member orchestra, which was produced by New Zealand content creation company Wrestler.

The VR experience is one of the first in the world that captures the orchestra in 360-degree video and sound from five different camera positions.

NZSO Marketing Manager Thomas Drent says it will revolutionise how New Zealanders can experience their national orchestra and expects that the VR experience will entice more people to see the Orchestra live.

During the performance, the viewer can move freely around the Orchestra; from the conductor’s podium beside NZSO associate conductor Hamish McKeich to the different sections as the musicians play.

“The NZSO is always exploring new ways to expand its audience and bring the Orchestra to all New Zealanders,” says Drent. “This new VR experience allows people to immerse themselves in the Orchestra in a way that would normally only be possible if they were a player or conductor. It looks and sounds amazing and is incredibly realistic. You will believe you are actually standing amongst the musicians as they play.”

According to Drent, the potential uses of VR for the NZSO are limitless, and developments in VR could mean that one day a viewer could conduct a virtual orchestra or play a virtual instrument in a VR performance.

A Holophone microphone was used to record the audio in 360 degrees so that the sound of the performance changes as the viewer moves around the Orchestra

Wrestler used an Omni camera array to film the Orchestra in 360 degrees. “It’s made up of six cameras that all shoot simultaneously and through specialised software we can stitch those six shots together and create a piece of footage mapped to the sphere,” say Wrestler VR Developer Jeff Jones. This means that the VR video precisely follows the viewers head movements, so even if they turn away from the Orchestra, or look up or down, they will always see the interior of the Michael Fowler Centre.

“It’s a fantastic opportunity to actually get on stage and go ‘I can sit next to the timpani or next to the trumpet or next to the harp’. It’s one more way to share our music-making experience. I think it’s fabulous,” says Section Principle Percussionist Laurence Reese.


To support the 360-degree visuals, a Holophone microphone was used to record the audio in 360 degrees so that the sound of the performance changes as the viewer moves around the Orchestra, like it would in a live setting. A Holophone H2-PRO7.1 was embedded with eight microphones to achieve the desired effect, and the NZSO is one of the first Orchestra’s in the world to include surround sound in a VR video.

“The sound recording for the project was a really interesting challenge and also a little bit daunting,” says Wrestler sound engineer Chris Ward. “We had to come up with something that had a very small profile that was discreet, that was easy to move between set ups.”

Wrestler Head of VR/AR Kat Lintott says the company was stoked that the NZSO wanted to experiment with VR. “To be able to walk around the stage while many musicians play around you is just breathtaking”

McKeich and the NZSO players viewed the VR video and were blown away by what Wrestler captured.

“The whole project was a great success and it was fantastic for me just to be able to see the orchestra in a new way and in a contemporary way as well” McKeich says.

The NZSO in VR experience can be downloaded from Google’s Play Store for Android phones and Apple’s App Store for iPhone and can be watched with smartphone-friendly VR headsets, including inexpensive cardboard models.

For those without a smartphone or VR headset, a version of the video will be available on the NZSO’s Facebook and YouTube, which will allow the viewer to use their mouse to pan 360 degrees while the NZSO performs. 

Join the newsletter!

Or

Sign up to gain exclusive access to email subscriptions, event invitations, competitions, giveaways, and much more.

Membership is free, and your security and privacy remain protected. View our privacy policy before signing up.

Error: Please check your email address.

Tags virtual realityHolophoneOmni camera

Keep up with the latest tech news, reviews and previews by subscribing to the Good Gear Guide newsletter.
Show Comments

Father’s Day Gift Guide

Brand Post

Bitdefender 2019

Bitdefender solutions stop attacks before they even begin! Get cybersecurity that 500 MILLION users already have and trust.

Most Popular Reviews

Latest Articles

Resources

PCW Evaluation Team

Luke Hill

MSI GT75 TITAN

I need power and lots of it. As a Front End Web developer anything less just won’t cut it which is why the MSI GT75 is an outstanding laptop for me. It’s a sleek and futuristic looking, high quality, beast that has a touch of sci-fi flare about it.

Emily Tyson

MSI GE63 Raider

If you’re looking to invest in your next work horse laptop for work or home use, you can’t go wrong with the MSI GE63.

Laura Johnston

MSI GS65 Stealth Thin

If you can afford the price tag, it is well worth the money. It out performs any other laptop I have tried for gaming, and the transportable design and incredible display also make it ideal for work.

Andrew Teoh

Brother MFC-L9570CDW Multifunction Printer

Touch screen visibility and operation was great and easy to navigate. Each menu and sub-menu was in an understandable order and category

Louise Coady

Brother MFC-L9570CDW Multifunction Printer

The printer was convenient, produced clear and vibrant images and was very easy to use

Edwina Hargreaves

WD My Cloud Home

I would recommend this device for families and small businesses who want one safe place to store all their important digital content and a way to easily share it with friends, family, business partners, or customers.

Featured Content

Don’t have an account? Sign up here

Don't have an account? Sign up now

Forgot password?