Human-Robot Interactive Creation of Artistic Portrait Drawings

Publisher:
IEEE
Publication Type:
Conference Proceeding
Citation:
2024 IEEE International Conference on Robotics and Automation (ICRA), 2024, 00, pp. 11297-11304
Issue Date:
2024-01-01
Filename Description Size
1743964.pdfPublished version5.79 MB
Adobe PDF
Full metadata record
In this paper we present a novel system for Human Robot Interactive Creation of Artworks HRICA Different from previous robot painters HRICA allows a human user and a robot to alternately draw strokes on a canvas to collaboratively create a portrait drawing through frequent interactions The key is to enable the robot to understand human intentions during the interactive creation process We here formulate this as a mask free image inpainting problem and propose a novel method to estimate the complete version of a portrait drawing after the human user has drawn some initial strokes In this way the robot can select some complementary strokes and draw them on the canvas To train and evaluate our inpainting method we construct a novel large scale portrait drawing dataset CelebLine which composes of high quality portrait line drawings with dense labels of both 2D semantic parsing masks and 3D depth maps Finally we develop a human robot interactive drawing system with low cost hardware user friendly interface and interesting creation experience Experiments show that our robot can stably cooperate with human users to create diverse styles of portrait drawings In addition our portrait drawing inpainting method significantly outperforms previous advanced methods The code and dataset have been released at https github com fei aiart HRICA
Please use this identifier to cite or link to this item: