Mixed reality guidance system for motherboard assembly using tangible augmented reality

Date of Publication

9-2-2019

Document Type

Master's Thesis

Degree Name

Master of Science in Computer Science

Subject Categories

Computer Sciences

College

College of Computer Studies

Department/Unit

Software Technology

Thesis Adviser

Neil Patrick Del Gallego

Defense Panel Chair

Conrado R. Ruiz, Jr.

Defense Panel Member

Neil Patrick Del Gallego
Jordan Aiko Deja

Abstract/Summary

A mixed reality guidance system (MRGS) for guiding users in the partial as- sembly of a motherboard was developed to explore the viability of using mixed

reality (MR) with tangible augmented reality (TAR) in the domain of manual

assembly. MR is used to overlay virtual objects on top of the real-world moth- erboard. The virtual objects include arrow indicators, placement holders, spatial

instructional and feedback texts, as well as the virtual equivalent of the moth- erboard parts. TAR, on the other hand, is implemented through the use of il- lustration board cutouts (physical AR targets) overlaid with virtual motherboard

parts. The virtual motherboard components are mapped onto the real-world phys- ical AR targets (i.e. when the physical object is moved, the virtual object moves

with it), allowing the user to manipulate the virtual objects in the same way as manipulating any other physical objects. The virtual objects are displayed using a

see-through head-mounted device (HMD) and served as visual guidance and feed- back to the user. The chosen task domain (motherboard assembly) was complex

enough that naive users were not able to perform it without guidance, thus the performance of the participants can be directly attributed to the MRGS. Although the system is not currently generalized, the current system serves as a proof of

concept and provides insights on both virtual cues in MR and natural user inter- action using TAR which similar works can be built in the future. Two usability

studies involving 25 participants, 10 experienced users and 15 naive users, were performed and are presented in this study. In the first study that involved rating the proposed interaction technique only, both the experienced and naive users rated it as acceptable. Transference from physical object manipulation to virtual object manipulation were also observed among participants. For the second study which involved the use of the MRGS for partial assembly of the motherboard, the groups that utilized the MRGS were able to properly determine the correct orientation and location of the motherboard parts. This was in contrasts to the control group, that used only a physical assembly manual, which demonstrated errors such as misplacing parts and inserting a part in reverse, suggesting that the MRGS was able to properly guide users in the assembly task. User comments and observations regarding the virtual guide cues, such as perception, and text instructions, such as use of language and word placement, are also discussed in this study.

Abstract Format

html

Language

English

Format

Electronic

Accession Number

CDTG008272

Keywords

Mixed reality; Augmented reality

Upload Full Text

wf_no

Embargo Period

4-30-2025

This document is currently not available here.

Share

COinS