Networked, real time translation of 3D mesh data to immersive virtual reality environments

Kevin Lesniak, Janis Terpenny, Conrad S. Tucker, Chimay Anumba, Sven Bilen

Research output: Chapter in Book/Report/Conference proceedingConference contribution

1 Scopus citations

Abstract

Immersive virtual reality systems have the potential to transform the manner in which designers create prototypes and collaborate in teams. Using technologies such as the Oculus Rift or the HTC Vive, a designer can attain a sense of "presence" and "immersion" typically not experienced by traditional CAD-based platforms. However, one of the fundamental challenges of creating a high quality immersive virtual reality experience is actually creating the immersive virtual reality environment itself. Typically, designers spend a considerable amount of time manually designing virtual models that replicate physical, real world artifacts. While there exists the ability to import standard 3D models into these immersive virtual reality environments, these models are typically generic in nature and do not represent the designer's intent. To mitigate these challenges, the authors of this work propose the real time translation of physical objects into an immersive virtual reality environment using readily available RGB-D sensing systems and standard networking connections. The emergence of commercial, off-the shelf RGB-D sensing systems such as the Microsoft Kinect, have enabled the rapid 3D reconstruction of physical environments. The authors present a methodology that employs 3D mesh reconstruction algorithms and real time rendering techniques to capture physical objects in the real world and represent their 3D reconstruction in an immersive virtual reali1ty environment with which the user can then interact. A case study involving a commodity RGB-D sensor and multiple computers connected through standard TCP internet connections is presented to demonstrate the viability of the proposed methodology.

Original languageEnglish (US)
Title of host publication36th Computers and Information in Engineering Conference
PublisherAmerican Society of Mechanical Engineers (ASME)
ISBN (Electronic)9780791850084
DOIs
StatePublished - Jan 1 2016
EventASME 2016 International Design Engineering Technical Conferences and Computers and Information in Engineering Conference, IDETC/CIE 2016 - Charlotte, United States
Duration: Aug 21 2016Aug 24 2016

Publication series

NameProceedings of the ASME Design Engineering Technical Conference
Volume1B-2016

Other

OtherASME 2016 International Design Engineering Technical Conferences and Computers and Information in Engineering Conference, IDETC/CIE 2016
CountryUnited States
CityCharlotte
Period8/21/168/24/16

All Science Journal Classification (ASJC) codes

  • Mechanical Engineering
  • Computer Graphics and Computer-Aided Design
  • Computer Science Applications
  • Modeling and Simulation

Fingerprint Dive into the research topics of 'Networked, real time translation of 3D mesh data to immersive virtual reality environments'. Together they form a unique fingerprint.

  • Cite this

    Lesniak, K., Terpenny, J., Tucker, C. S., Anumba, C., & Bilen, S. (2016). Networked, real time translation of 3D mesh data to immersive virtual reality environments. In 36th Computers and Information in Engineering Conference (Proceedings of the ASME Design Engineering Technical Conference; Vol. 1B-2016). American Society of Mechanical Engineers (ASME). https://doi.org/10.1115/DETC2016-59762