Step Into a Shipping Container and Emerge in Southern Italy

By Lori Cameron
Published 01/11/2018
Share this on:

Apulia, Italy

Virtual reality tourism now tries to sell you a trip to Apulia

Imagine stepping into the back of a shipping container and being transported to the southern coast of Italy, replete with frescos, ocean spray, and the smell of wild gooseberry and fennel.

It’s a virtual reality experience called MATE, and it’s coming to a travel and tourism event near you.

Once the domain of only the super wealthy, recent advances in virtual reality now make it possible for anyone to travel to exotic places around the world—with simulated waterfront mist to feel on your face and countryside fragrances to smell.

How?

Researchers in Italy’s bootheel have leveraged a piece of old “virtual environment” technology that failed in the 1960s, and have resurrected it by applying the latest VR and human-machine interface.

That old tech was a motorbike simulator that allowed users to sit in a real saddle and experience a virtual ride with sound, vibrations, winds, and even smells. The Sensorama simulator failed, however, because of financial issues and “technical immaturity,” said researchers at Polytechnic University of Bari, located in the capital of southern Italy’s Apulia region.

Sensorama by Morton Heilig
Sensorama: (a) illustration from the patent (US 3050870) by Morton Heilig and (b) the product advertisement from the 1960s. (Courtesy of Scott Fisher’s Telepresence)

Now, that old motorbike simulator tech is being redesigned and reconfigured to fit inside a 20-foot shipping container, transporting visitors to Apulia.

Called the Multisensory Apulia Touristic Experience (MATE), the VR inside the container could help the beleaguered economy in a region of Italy that’s referred as the heel of Italy’s boot. Apulia is a charming town but has one of the country’s weaker economies, researchers say, with “17.70K Euros gross domestic product per inhabitant versus 32.20K Euros in northwest Italy in 2014.”

See the art, history, culture, and natural wonders of Apulia, Italy (aka “Puglia”)

Even with the success of recent travel promotions, local authorities from the little-known town of Apulia, Italy wanted to explore new ways to promote the beauty and culture of their area by partnering with researchers from Polytechnic University of Bari and investing in virtual reality research.

“Regional authorities have recently promoted tourist activities and obtained positive results—a 4.5 percent increase in Italian tourists and a 13 percent increase in international visitors in 2016. Despite this success, the region is still far less known than other Italian destinations,” write Vito M. Manghisi, Michele Fiorentino, Michele Gattullo, Antonio Boccaccio, Vitoantonio Bevilacqua, Giuseppe L. Cascella, Michele Dassisti, and Antonio E. Uva, authors of the article “Experiencing the Sights, Smells, Sounds, and Climate of Southern Italy in VR,” (login may be required for full text) which appears in the November/December 2017 issue of IEEE Computer Graphics & Applications.

“The local authorities are exploring new ways to promote it and have agreed to invest in application-oriented virtual reality research,” the authors say.

Their hope is that a virtual reality experience will help boost tourism in their part of the country.

“Apulia offers a range of attractions, from the unique and remarkable trulli in Alberobello and the magnificent Castel del Monte in Andria to the crystal-clear waters surrounding the Tremiti Islands and the outdoor adventures that await in the Murgia National Park. The region is soaked in tradition and folklore, and its food and wine specialties are known all over the world,” say the authors.

Drawing inspiration from the Sensorama simulator that was invented in the 1960s by Mort Heilig, the Italian researchers designed MATE to bring the sights, smells, sounds, and climate of Apulia to potential travelers in their respective home towns — with the tourism goal of luring them to visit Italy’s bootheel.

So, what is it like to enter this immersive environment?

MATE: It feels like climbing into the back of a truck with your friends

“We installed the system inside a 20-foot container that is divided into two main areas: the control room and the user experience zone. The control room hosts the main PC, the ambient control unit, and the power management. The user experience area is about 12 square meters and can host four to six visitors simultaneously,” the authors describe.

Multisensory Apulia Touristic Experience (MATE)
Multisensory Apulia Touristic Experience (MATE) mobile container configuration: (a) installed systems in the user experience zone and the control room and (b) a photo of the control room.

For event staff, the environment is portable and easy to use

“We designed MATE as a virtual tour in collaboration with industrial partners and local tourism authorities, who played an active part in defining the system’s requirements and features. One of the main design requests was to build a mobile platform that could be relocated to various promotional events all over Europe, such as public exhibitions and fairs. Also, to minimize the operating costs, the system needed to be simple enough that it could be run by a small number of unqualified staff,” say the authors.

Multisensory Apulia Touristic Experience (MATE) gesture-based interface controls
MATE gesture-based interface controls. The user closest to the sensor can navigate the virtual tour with five possible commands: gaze direction control, zoom in, zoom out, select hotspot/item, and move to the point of interest.

Features appeal to touch and smell as well as sight and sound

“MATE enhances the user experience by providing olfactory and climatic stimuli. As users take the tour and enter a new scene, the humidity, lighting, and ambient scents change accordingly. To convey the olfactory stimuli, we used an array of odor diffusers using the Solid Fragrance Release system from Oikos Fragrances. Odors are delivered using a ventilation fan in the mobile container,” they write.

The breath-taking view won’t make you sick

In selecting visual tech, the team had to take into consideration that awful, queasy feeling users get when playing 3D games.

“For the visual stimuli, we chose 2D rather than 3D footage for the virtual tour. There were many reasons for this choice, but the most important was to avoid the cyber-sickness effect. Cyber-sickness can cause discomfort and even vertigo when the users are standing in a restricted environment, which could cause visitors to fall or cause other potentially dangerous situations. In our tests, we encountered a high rate of cyber-sickness among casual users with short or no training time and when the point of view could not be controlled individually. As a second consideration, the added value enabled by 3D depth perception is limited in virtual tours consisting of mostly landscapes and confined places,” they added.

Nonetheless, the panoramic view promises to be a lot of fun.

“Currently, the MATE system is being integrated into a full-scale prototype demonstrator that will be carried all around Europe. Based on our experience and feedback, we think that the use of 360-degree videos can further increase the wow effect and fun factor. Another suggestion from our case study participants was to use source images for the 360-degree panoramas, with as high a resolution as possible, so users can enjoy the zoom-in function to discover new details,” say the authors.

After testing, what were the results?

The researchers developed a VR experience using the Murgia countryside, showcasing its hidden treasures: the countryside’s native vegetation—thyme, wild gooseberry, and wild fennel, Monte Caccia, Cretacic limestone, doline fields and sinkholes and caves, the ancient Appian Way crossing the area, the Masseria Jesce—an ancient manor farm dating back to the 16th century, a 14th century frescoed crypt dedicated to the Archangel St. Michael, and even a local bakery with the accompanying smell of fresh-baked bread.

Laboratory gesture-interaction tests. The Murgia Experience case study
Laboratory gesture-interaction tests. The Murgia Experience case study indicated that the users’ enjoyment was significantly higher in the MATE.

After surveying the test group, the research team found that the immersive, multisensory experience beat browsing internet pictures, hands down.

“Our participants indicated that their enjoyment was significantly higher in the MATE as opposed to using the PC with mouse interface,” the authors said.

The research team hopes the MATE system will be used to promote tourism in many other regions of the world.

“In the future, we plan to evaluate MATE in further tests to measure its usability, enjoyment and engagement, and user satisfaction. We believe that the versatility of MATE’s authoring system will make reusable it so other regions can use it for promotions as well,” said the team.

 

Research related to tourism and virtual reality in the Computer Society Digital Library

Login may be required for full text.

 


 

About Lori Cameron

Lori Cameron is a Senior Writer for the IEEE Computer Society and currently writes regular features for Computer magazine, Computing Edge, and the Computing Now and Magazine Roundup websites. Contact her at l.cameron@computer.org. Follow her on LinkedIn.