A mobile augmented reality-based assembly guidance application for LEGO

College

College of Computer Studies

Department/Unit

Software Technology

Document Type

Conference Proceeding

Source Title

MCCSIS 2018 - Multi Conference on Computer Science and Information Systems; Proceedings of the International Conferences on Interfaces and Human Computer Interaction 2018, Game and Entertainment Technologies 2018 and Computer Graphics, Visualization, Computer Vision and Image Processing 2018

Volume

2018-July

First Page

237

Last Page

244

Publication Date

1-1-2018

Abstract

Usually LEGO structures are created by following an instruction manual in paper or digital form that depicts the LEGO model at different stages of assembly. Some instructions can be very complex and difficult to represent using plain illustrations. Consequently, this makes it difficult to follow and assemble a LEGO structure. Augmented reality (AR) is a technology that adds perceptual information into the physical world and it has recently been gaining popularity. This study explores the use of AR for assembly through ARGO, a mobile application for Android smartphones that serves as an assembly guide for LEGO structures. It can enhance instructions and provide more details that assist users during the construction process. The system can recognize the current step of the LEGO assembly using data captured via Microsoft Kinect while providing visual feedback through the mobile application. To identify the current step, the system obtains the color and depth data from the Kinect camera and converts the data into a point cloud. The point cloud undergoes segmentation to isolate the physical LEGO model and compares it to the point clouds of a preloaded model to check if the brick is placed correctly. The system was evaluated using 3 models and can recognize when to advance to the next step during assembly and estimate the orientation of the step differing an average angle of 48.27 degrees. For each step, it takes an average of a few seconds to decide on the recognition, leading to a short delay for the feedback to appear on the phone. © 2018.

html

Disciplines

Computer Sciences | Software Engineering

Keywords

Augmented reality; LEGO toys

Upload File

wf_no

This document is currently not available here.

Share

COinS