Augmented Reality system for space station maintenance support - VTT Technical ...
←
→
Page content transcription
If your browser does not render page correctly, please read the page content below
VTT TECHNICAL RESEARCH CENTRE OF FINLAND LTD
Augmented Reality system for
space station maintenance support
Augmented reality – Industrial Reality?
22.3.2018 VTT/Ota
Kaj Helin
Principal Scientist, Certified Project Manager IPMA
Human factors, Virtual and Augmented reality
VTT Technical Research Centre of Finland Ltd
25 years history of VR and 10 years of AR
More than 100 cases with end-users
The first VR Several VR/MR/AR
First digital The first The design Augmented
environment industrial Drone control
human model kinetics DHM simulator for assembly Kemppi continuum
in projects cases, e.g. via MR
in CAD- (SIMTU, cabins (AugAsse) AR-welding (TellMe, UIW,
e.g. Tele-safe, Rauta-ruukki (ROBORDER)
system TÄRSKY) (HumanICT) WEKIT)
ELINA
The first 1st vehicular VR in manual Manual work VR & MR to
Maintenance ESA –
kinematics machine task design Easy-to-use System increase
work design AR for AIT,
DHM e.g. simulator (VIRVA, EU- DHMs (Osku, lifecycle & human
and training AIV and Orbit
Workplace (VIRSU, VIRTUE) Kone-Masina) VR&AR comfort
in VR (VIRVO) Operations
design TERMA) (ManuVAR) (VRHyperSpace)
1980 1991 1994 1996 1997 1998 2000 2003 2004 2006 2007 2009 2010 2012 2014 2016 2018
2
22/03/2018
Space related VR/MR/AR research > 12 years
https://www.youtube.com/watc
h?v=djUdsQ5pY0s
https://www.youtube.com/watc
h?v=fNEqOBMKhGg
3
22/03/2018
The first version Updated version
4
22/03/2018
VTT TECHNICAL RESEARCH CENTRE OF FINLAND LTD
ESA – EdcAR
Augmented Reality for AIT, AIV and
Operations
Main objective
Objective of this activity is to verify if Augmented Reality
could be eligible technologies and productive tools in
aerospace industry.
Sub objectives:
Identification of critical technology areas in building
effective AR systems (e.g. tracking, registration),
Architecture and Design of EdcAR solution,
Implementation of a Proof-Of-Concept demonstrator
6
22/03/2018
Use cases
AR supported Telecom Payload Coax Cables Assembly,
AR based On-board Training and Remote Support of Centralized
Cabin Filter Replacement in ISS,
AR based Remote Support during the and Remote Support
7
22/03/2018
The first version of the EdcAR sytem
ALVAR 2D/3D tracking
AR-runtime
Unity3D
AR-runtime
Authoring
Remote support
the IEEE Draft Standard for an Augmented
Reality Learning Experience Mode (ARLEM)
Relevant part of ARLEM
Workplace and activity JSON
ROS (an open-source Robot Operating System)
Communication between components
Stage manager
Streaming
Sensor interfaces
Logs
8
22/03/2018
The second version of the EdcAR sytem
Phone, tablet, AR-glasses =>
Microsoft Hololens
ROS => MQTT IoT interface
ARLEM standard supported
Work task split for several
simultaneous users
User interface in 3D environment
Voice and gesture commands
Remote support wasn’t
implemented
9
22/03/2018
The second version design based on ARLEM
Content repository
ARLEM files
Activity Manager Actions EdcAR triggers
Activity ML Object Factory EdcAR content
Workplace Manager Holotoolkit
Workplace ML Prefabs Vuforia
ARLEM parsing & Runtime configuration AR visualization
activity flow
External content
Sensor data EdcAR Player
Photos
Videos
Audio clips
Models
Etc.
10
22/03/2018AR verbs in symbol form
11
22/03/2018(AR) safety symbols ISO 7010:2012
12
22/03/2018The second version testing in
European Astronaut Centre
13
22/03/2018Conclusion
The main show-stopper of the first version was the poor performance
of the AR-glasses
The second version was developed for the Microsoft Hololens in a
short time frame of about three months.
This was possible as the EdcAR system supports the ARLEM and the
system is designed using a modular architecture
The usability of the second version reached a reasonable level
Based on the evaluation feedback, the system was already exploitable
level
The 3D space user interface and annotations were working properly
without any delay and the image quality was high enough for see-
through glasses
The main downside of the system is the narrow field of view
search for the information in some cases
14
22/03/2018VTT TECHNICAL RESEARCH CENTRE OF FINLAND LTD
WEKIT
Wearable Experience for Knowledge Intensive Training
Case Installation of Temporary
Stowage Rack to ATV module in
ISS mock-upUpdates from ESA-EdcAR
Video and audio annotations
ARLEM standard fully supported
Large area supported
Automatic initialization from image
marker
The System was tested with 39 subjects
and the resulting System Usability Scale (SUS) score
was ~69 which indicating that
the system usability is already at an acceptable level.
16
22/03/2018Versio 1 - video
17
22/03/2018Updated UI @EuroVR conference
New UI layout
UI follows
Back function
Guides to annotations
Progress bar
Media annotations
replay
All functions are
multimodal
Voice
Gesture
Button
18
22/03/2018Conclusion and next steps
Augmented Reality has reach
maturity and usability level that it
could start exploiting in the missions
EdcAR continuum to implementing
it to ISS procedure viewer
WEKIT system will be used
AR based iPV for astronaut procedure support
Moon/Mars mission test
EAC (European Astronaut Center)
19
22/03/2018VTT TECHNICAL RESEARCH CENTRE OF FINLAND LTD
Kaj Helin
Kaj.helin@vtt.fi
Principal Scientist, Certified Project Manager IPMA
Human factors, Virtual and Augmented reality
VTT Technical Research Centre of Finland LtdYou can also read
