TY - GEN
T1 - Panoramic view reconstruction for stereoscopic teleoperation of a humanoid robot
AU - Theofilis, Konstantinos
AU - Orlosky, Jason
AU - Nagai, Yukie
AU - Kiyokawa, Kiyoshi
N1 - Publisher Copyright:
© 2016 IEEE.
PY - 2016/12/30
Y1 - 2016/12/30
N2 - In recent years, robots have become more commonplace as a method for humans to remotely conduct observations or interactions, with commercial applications ranging from customer service to assembly line work. Virtual and augmented reality have shown much promise as methods to visualize and assist with teleoperation of these robots. However, a number of problems still exist with such bidirectional teleoperator relationships, including the intersensory conflict induced by delay of images received on the teleoperator side of a remote session. This can result in nausea, simulation sickness, and unnatural interaction, especially when stereoscopic cameras are present. As a step towards addressing this problem, we introduce the use of stereo panoramic reconstruction in conjunction with an augmented reality interface to improve both the interaction and the sense of embodiment of a teleoperator working through a robot's perspective. Unlike current methods that send latent streams of the robot's eye-cameras to the user, we view reconstruction that also incorporates direct control of the robot's head. This algorithm uses queued time and angle stamped images to reconstruct the robot's stereoscopic view for the teleoperator, which allows for low-latency viewing and field of view expansion. We then conduct experiments comparing our method against a direct camera feed from the robot's eyes. In addition to measuring latency at every point of the data pipeline, we show that this panoramic representation reduces perceived visual delay and elicits positive user feedback.3
AB - In recent years, robots have become more commonplace as a method for humans to remotely conduct observations or interactions, with commercial applications ranging from customer service to assembly line work. Virtual and augmented reality have shown much promise as methods to visualize and assist with teleoperation of these robots. However, a number of problems still exist with such bidirectional teleoperator relationships, including the intersensory conflict induced by delay of images received on the teleoperator side of a remote session. This can result in nausea, simulation sickness, and unnatural interaction, especially when stereoscopic cameras are present. As a step towards addressing this problem, we introduce the use of stereo panoramic reconstruction in conjunction with an augmented reality interface to improve both the interaction and the sense of embodiment of a teleoperator working through a robot's perspective. Unlike current methods that send latent streams of the robot's eye-cameras to the user, we view reconstruction that also incorporates direct control of the robot's head. This algorithm uses queued time and angle stamped images to reconstruct the robot's stereoscopic view for the teleoperator, which allows for low-latency viewing and field of view expansion. We then conduct experiments comparing our method against a direct camera feed from the robot's eyes. In addition to measuring latency at every point of the data pipeline, we show that this panoramic representation reduces perceived visual delay and elicits positive user feedback.3
UR - http://www.scopus.com/inward/record.url?scp=85010224352&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85010224352&partnerID=8YFLogxK
U2 - 10.1109/HUMANOIDS.2016.7803284
DO - 10.1109/HUMANOIDS.2016.7803284
M3 - Conference contribution
AN - SCOPUS:85010224352
T3 - IEEE-RAS International Conference on Humanoid Robots
SP - 242
EP - 248
BT - Humanoids 2016 - IEEE-RAS International Conference on Humanoid Robots
PB - IEEE Computer Society
T2 - 16th IEEE-RAS International Conference on Humanoid Robots, Humanoids 2016
Y2 - 15 November 2016 through 17 November 2016
ER -