1 / 12

Real Object Integration for Engineering Design Evaluation in Mixed Reality Environment

This research explores incorporating physical objects into virtual environments for engineering design evaluation in mixed reality. The study focuses on verifying assembly plans earlier to save time and money, enhancing interaction through team-based collaboration, and overcoming challenges such as tracking, latency, and occlusion.

lin
Download Presentation

Real Object Integration for Engineering Design Evaluation in Mixed Reality Environment

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Rapidly Incorporating Real Objects for Evaluation of Engineering Designs in a Mixed Reality Environment Xiyong Wang, Aaron Kotranza, John Quarles, Benjamin Lok Computer and Information Sciences and Engineering DepartmentUniversity of Florida [xw3, akotranz, jpq, lok@cise.ufl.edu] B. Danette Allen NASA Langley Research Center Danette.Allen@nasa.gov

  2. At assembly design stage: Several constructed parts Many CAD models for parts yet to be constructed Unverified assembly plans How can we verify the assembly plan? Driving Application: Engineering Design Evaluation Motivation: • Finding design flaws earlier will save time and money • Virtual environments have difficulty simulating hands-on assembly • Support team based interaction To be built in 2008 We only have this in 2005

  3. Previous Work • Engineering Design • Zachmann--Virtual Assembly Simulation: Pure VE technique used in Assembly [GMD IMK, Oct 2000] • Jack – commercial software to do ergonomics (www.ugs.com) EDS • Interfaces in VR • LaViola, Bowman (Siggraph 2001 course notes) – comprehensive list of VR interaction • Collaboration • Mortensen 2002, Collaboration in tele-immersive environments. [Eurographics] • Pinho 2002 Cooperative Object Manipulation [VRST2002] Image from Zachmann’s website, only the gloves (or hands) were tracked [http://web.informatik.uni-bonn.de/II/ag-klein/people/zach/projects/fhg/ems.html]

  4. Mixed Environment Solution • Mixed Environments (ME): • Components • Physical objects • CAD models • Physical correlates • Effective Interaction • Haptic feedback • Visualization of Articulated models • Challenges • Capturing physical models • Tracking real objects • Supporting teamwork

  5. Capturing the Physical Model Reconstruction from multiple scans Scanning Define color markers Interaction in ME

  6. Tracking Solution • Object tracking • STRAPS - color tracking • Web cams • Attributes • Low cost • Moderate latency • Moderate accuracy • Many sensors • Limited marker space • Solution: Multi-blob tracking • Head tracking • Worldviz PPT • Intersense Interiacube2 • Attributes • Expensive • Low latency, • High accuracy • Few sensors

  7. Experiment • Assembly task • Abstracted task • CAD models and parts from NASA • Components: • Real circuit board • Fuel tank physical correlate • Virtual fuselage CAD model

  8. Assembly Task Video

  9. Team Based Visualization • HMD • For primary technician • Desktop • For remote observers • Tracked Tablet PC • For local team members • Engineers • Supervisors

  10. Magic Lens Video

  11. Conclusion • Future work: • Improve tracking • Robustness • Additional cameras • Formal study with NASA engineers • Avatars • Automate pipeline --Reduce incorporating time to 15 minutes!! • Results • The user: • Found the design flaw • Reordered the assembly plan dynamically • Completed the assembly task successfully • Takes two hours to incorporate a real object into the ME • Problems • Tracking • Occlusion • Latency More tracking camera from different location make more complicate tasks possible. But complicated mechanism is needed to combine the information from multi channel

  12. Acknowledgements • Funding • University of Florida • People • NASA Langley Research Center • UNCC • Dr. Shin • Jonathan Jackson • Dr. Hodges • CISE, UF • Robert Dickerson • Art Homs

More Related