Sharing hand gesture and sketch cues in remote collaboration

Huang, W; Kim, S; Billinghurst, M; Alem, L

Sharing hand gesture and sketch cues in remote collaboration

Huang, W

Kim, S Billinghurst, M Alem, L

Permalink

Publication Type:: Journal Article
Citation:: Journal of Visual Communication and Image Representation, 2019, 58 pp. 428 - 438
Issue Date:: 2019-01-01

Closed Access

	Filename	Description	Size
	1-s2.0-S1047320318303365-main.pdf	Published Version	1.84 MB	Adobe PDF	View/Open

Copyright Clearance Process

Recently Added
In Progress
Closed Access

This item is closed access and not available.

Full metadata record

Field	Value	Language
dc.contributor.author	Huang, W https://orcid.org/0000-0002-5190-7839	en_US
dc.contributor.author	Kim, S	en_US
dc.contributor.author	Billinghurst, M	en_US
dc.contributor.author	Alem, L https://orcid.org/0000-0002-7802-3590	en_US
dc.date.issued	2019-01-01	en_US
dc.identifier.citation	Journal of Visual Communication and Image Representation, 2019, 58 pp. 428 - 438	en_US
dc.identifier.issn	1047-3203	en_US
dc.identifier.uri	http://hdl.handle.net/10453/137028
dc.description.abstract	© 2018 Elsevier Inc. Many systems have been developed to support remote guidance, where a local worker manipulates objects under guidance of a remote expert helper. These systems typically use speech and visual cues between the local worker and the remote helper, where the visual cues could be pointers, hand gestures, or sketches. However, the effects of combining visual cues together in remote collaboration has not been fully explored. We conducted a user study comparing remote collaboration with an interface that combined hand gestures and sketching (the HandsInTouch interface) to one that only used hand gestures, when solving two tasks; Lego assembly and repairing a laptop. In the user study, we found that (1) adding sketch cues improved the task completion time, only with the repairing task as this had complex object manipulation but (2) using gesture and sketching together created a higher task load for the user.	en_US
dc.relation.ispartof	Journal of Visual Communication and Image Representation	en_US
dc.relation.isbasedon	10.1016/j.jvcir.2018.12.010	en_US
dc.rights	info:eu-repo/semantics/closedAccess
dc.subject.classification	Artificial Intelligence & Image Processing	en_US
dc.title	Sharing hand gesture and sketch cues in remote collaboration	en_US
dc.type	Journal Article
utslib.citation.volume	58	en_US
utslib.for	2001 Communication and Media Studies	en_US
utslib.for	0801 Artificial Intelligence and Image Processing	en_US
utslib.for	1203 Design Practice and Management	en_US
utslib.for	1905 Visual Arts and Crafts	en_US
pubs.embargo.period	Not known	en_US
pubs.organisational-group	/University of Technology Sydney
pubs.organisational-group	/University of Technology Sydney/Faculty of Transdisciplinary Innovation
utslib.copyright.status	closed_access	*
pubs.publication-status	Published	en_US
pubs.volume	58	en_US

Abstract:

© 2018 Elsevier Inc. Many systems have been developed to support remote guidance, where a local worker manipulates objects under guidance of a remote expert helper. These systems typically use speech and visual cues between the local worker and the remote helper, where the visual cues could be pointers, hand gestures, or sketches. However, the effects of combining visual cues together in remote collaboration has not been fully explored. We conducted a user study comparing remote collaboration with an interface that combined hand gestures and sketching (the HandsInTouch interface) to one that only used hand gestures, when solving two tasks; Lego assembly and repairing a laptop. In the user study, we found that (1) adding sketch cues improved the task completion time, only with the repairing task as this had complex object manipulation but (2) using gesture and sketching together created a higher task load for the user.

Please use this identifier to cite or link to this item:

http://hdl.handle.net/10453/137028