comment on this article

Replicate physical objects for VR/AR

A global team of computer scientists have developed a method that replicates physical objects for the virtual and augmented reality (VR/AR) space just using a point-and-shoot camera with a flash. Without any need for additional, and oftentimes expensive, supporting hardware.

"To faithfully reproduce a real-world object in the VR/AR environment, we need to replicate the 3D geometry and appearance of the object," explains Associate Professor Min H. Kim of KAIST in South Korea and lead author of the research.

"Traditionally, this has been either done manually by 3D artists, which is a labour-intensive task, or by using specialised, expensive hardware. Our method is straightforward, cheaper and efficient, and reproduces realistic 3D objects by just taking photos from a single camera with a built-in flash."

Existing approaches for the acquisition of physical objects require specialised hardware setups to achieve geometry and appearance modelling of the desired objects. Those setups might include a 3D laser scanner or multiple cameras, or a lighting dome with more than a hundred light sources. In contrast, this new technique only needs a single camera, to produce high-quality outputs.

"Many traditional methods using a single camera can capture only the 3D geometry of objects, but not the complex reflectance of real-world objects, given by the SVBRDF," notes Assoc Prof. Kim.

SVBRDF, which stands for spatially-varying bidirectional reflectance distribution functions, is key in obtaining an object's real-world shape and appearance. "Using only 3D geometry cannot reproduce the realistic appearance of the object in the AR/VR environment. Our technique can capture high-quality 3D geometry as well as its material appearance so that the objects can be realistically rendered in any virtual environment."

The group demonstrated their framework using a digital camera, the Nikon D7000 and the built-in camera of an Android mobile phone, in a series of examples in their paper: Practical SVBRDF Acquisition of 3D Objects with Unstructured Flash Photography.

The algorithm, which does not require any input geometry of the target object, successfully captured the geometry and appearance of 3D objects with basic, flash photography and reproduced consistent results.

Examples that were showcased in the work included a diverse set of objects that spanned a range of geometries and materials, including metal, wood, plastic, ceramic, resin and paper, and comprised of complex shapes like a finely detailed mini-statute of Nefertiti.

In future work, the researchers hope to further simplify the capture process or extending the method to include dynamic geometry or larger scenes.

Author
Bethan Grylls

Comment on this article


This material is protected by MA Business copyright See Terms and Conditions. One-off usage is permitted but bulk copying is not. For multiple copies contact the sales team.

What you think about this article:


Add your comments

Name
 
Email
 
Comments
 

Your comments/feedback may be edited prior to publishing. Not all entries will be published.
Please view our Terms and Conditions before leaving a comment.

Related Articles

Fault detector

A tool that is able to spot defects or unwanted features much earlier in the ...

On-chip optical link

For the first time, researchers of the University of Twente (UT) succeeded in ...

Managing your IPR

It’s essential that companies consider managing their intellectual property ...

Where next in 2019?

From the first autonomous vehicles to 5G and the realisation of mobile AR ...

Real world problems

Capacitive touchscreens are constructed using an orthogonal grid of transmitter ...

Dual-Radio dev kit

By supporting concurrent communication over Bluetooth Low Energy (BLE) and ...

Smart Home Expo

The Smart Home Expo, which focuses on the future of smart technologies, ...

Get to market faster

A quick look at using Vicor's PFM and AIM in VIA packaging for your AC to Point ...

Storm clouds gather

The latest quarterly report from the EEF, the manufacturers’ organisation, ...

Piezoelectric haptics

Boréas Technologies’ CEO, Simon Chaput, talks to Neil Tyler about the company’s ...

Teach them to fish

Last year was dubbed the “worst ever” by the Online Trust Alliance for data ...