We present an AI-assisted Augmented Reality assembly workflow that uses deep learning-based object recognition to identify different assembly components and display step-by-step instructions. For each assembly step, the system displays a bounding box around the corresponding components in the physical space, and where the component should be placed. By connecting assembly instructions with the real-time location of relevant components, the system eliminates the need for manual searching, sorting, or labeling of different components before each assembly. To demonstrate the feasibility of using object recognition for AR-assisted assembly, we highlight a case study involving the assembly of LEGO sculptures.
翻译:我们提出了一种人工智能辅助的增强现实装配工作流程,该流程利用基于深度学习的物体识别技术来识别不同的装配部件,并显示分步指导说明。针对每个装配步骤,系统会在物理空间中对应部件周围显示边界框,并指示部件应放置的位置。通过将装配指令与相关部件的实时位置信息相结合,该系统消除了在每次装配前手动搜索、分类或标记不同部件的需求。为论证利用物体识别技术实现增强现实辅助装配的可行性,我们重点介绍了一项涉及乐高雕塑装配的案例研究。