Workshop on Representing and Manipulating Deformable Objects @ ICRA2021 was held on 31.05.2021:

Full workshop

Information

Schedule

Time Zone: GMT+00

Time Activity
09:00 - 09:15 Opening [Video]
09:15 - 09:45 David Navarro-Alarcon: On Latent Space Representations for Controlling Shapes of Deformable Objects [Video]
09:45 - 10:15 Xiang Li: Adaptive Control for Robotic Manipulation of Deformable Linear Objects with Offline and Online Learning of Unknown Models [Video]
10:15 - 11:00 Spotlight talks #1 [Video]:
  • S. Funabashi, T. Isobe, F. Hongyi, T. Ogata, A. Schmitz, S. Sugano - In-Hand Manipulation of Multi-Fingered Hand with Daily Objects Based on Graph Convolutional Network and 3-Axis Tactile Sensing [PDF] [Video]
  • S. Marullo, G. Salvietti, D. Prattichizzo - The Mag-Gripper: A Soft-Rigid Gripper Augmented with an Electromagnet to Precisely Handle Clothes [PDF] [Video]
  • M. Lee, J. Lee, J. Yoon, D. Lee - Interactive Real-Time Simulation of Robotic Snap Connection Process [PDF] [Video]
  • B. Maric, M. Polic, M. Orsag - Soft robotics approach to autonomous plastering [PDF] [Video]
  • X. Lin, Y. Wang, D. Held - Learning Visible Connectivity Dynamics for Cloth Smoothing [PDF] [Video]
  • P. Zhou, J. Zhu, S. Huo, D. Navarro-Alarcon - A Latent and Semantic Framework for Deformable Object Representation [PDF] [Video]
  • Z. Weng, F. Paus, A. Varava, H. Yin, T. Asfour, D. Kragic - Graph-based Task-specific Prediction Models for Interactions between Deformable and Rigid Objects [PDF] [Video]
11:00 - 11:15 Coffee break [Slides]
11:15 – 11:45 Zackory M. Erickson: Physics-based Cloth Simulation and Learning Towards Robotic Caregiving [Video]
11:45 – 12:15 Júlia Borràs Sol: On analyzing and representing cloth manipulation tasks [Video]
12:15 – 12:45 Open discussion round #1 [Video]
12:45 - 14:00 Lunch [Slides]
14:00 – 14:30 Dmitry Berenson: Learning Where to Trust Unreliable Models for Deformable Object Manipulation [Video]
14:30 – 15:00 Wenzhen Yuan: Estimating object hardness with high-resolution tactile sensing [Video]
15:00 – 15:45 Spotlight talks #2 [Video]:
  • R. A. Laezza, R. Gieselmann, F. T. Pokorny, Y. Karayiannidis - Presenting ReForm, a Robot Learning Sandbox for Deformable Linear Object Manipulation [PDF] [Video]
  • P. Perrusi, A. Cazzaniga, P. Baksic, E. Tagliabue, E. De Momi, H. Courtecuisse - Learning robotic needle steering from inverse finite element simulations [PDF] [Video]
  • X. Ma, D. Hsu, W. S. Lee - Learning Latent Graph Dynamics for Deformable Object Manipulation [PDF] [Video]
  • M. Dorostian, A. Moradmand, P. Chang, T. Padir - Deformable Objects Manipulation Using Model Adaptation Techniques [PDF] [Video]
  • A. Longhini, M. Moletta, M. C. Welle, I. Mitsioni, D. Kragic - Perceiving and handling textiles: a robotics perspective [PDF] [Video]
  • S. Dittus, B. Alt, A. Hermann, D. Katic, R. Jäkel, J. Fleischer - Localization and Tracking of User-Defined Points on Deformable Objects for Robotic Manipulation [PDF] [Video]

15:45- 16:00 Coffee break [Slides]
16:00 – 16:30 Dinesh Manocha: Learning based Methods for High-DOF Grasping [Video]
16:30 – 17:00 Jeannette Bohg: Bridging Topology and Geometry Using Reinforcement Learning [Video]
17:00 – 17:45 Open discussion round #2 [Video]
17:45 – 18:00 Closing remarks [Slides]

Abstract: Representing and Manipulating Deformable Objects

Deformable objects manipulation is a key component of a variety of everyday and specialized applications, ranging from domestic housework such as cloth folding or food handing, to medical scenarios such as surgery and suturing, up to industrial setups such as cable insertion. However, the large configuration space of deformable objects causes traditional modelling, planning and control approaches to fail when dealing with them. More specifically, unlike in the case of rigid objects, two main challenges arise: i) there is no clear and unified state representation and ii) the dynamics is complex and highly non-linear. This leads to the absence of current unified solutions and to highly domain-specific approaches emerging in the fields of perception, simulation, control and mechanics. In addition, the lack of scalable simulation environments limits possible developments in the above fields. We believe that robust progress can only be achieved by combining these complementary areas of robotics. Therefore, this workshop aims to start a discussion about the current state-of-the-art and possible research directions as well as connect people from different sub-fields to solve deformable objects challenges.

Content

Event description

The workshop is tailored towards researchers interested at deformable object manipulation and closely related problems such as modeling, perception, representation and mechanics. This workshop would give the community a chance to: identify open research challenges, find new applications for techniques that already exist in closely related areas, foster new collaborations, and get a good overview of the state -of-the-art from the invited talks. Speakers from the forefront of the research on deformable objects are invited to provide top-level insights. Furthermore, a review process from experienced researchers will be carried out giving young researchers the opportunity to receive valuable feedbacks. The scope of the workshop is intentionally broad as we think that different aspects need to be taken into account to effectively handle deformable objects and we want to enclose them in a single event, filling the lack of a dedicated session in the main robotics conferences.

Topic relevance

Despite the presence of deformable objects in a wide range of domains and tasks, endowing robots with the ability to manipulate them is still an open problem. This is motivated by the extreme complexity of representation and dynamics modeling of such objects. Although different methodologies exist in the recent state-of-the-art, tackling different aspects of deformable objects, no unified and comprehensive solution exists yet that can be easily generalized to non-specific objects. As possible approaches to state representation and modelling, topological coordinates and Finite Element Methods have been adopted for solving specific tasks. In contrast, data-driven approaches can be leveraged to circumvent explicit modelling at the cost of an expensive data collection. For this, although simulation environments would be most suited for collecting large amount of data, the current state-of-the-art does not enable it in an efficient and scalable manner. Moreover, even when a simulation setup is employed, the transfer of the acquired skills into real-world may be unsuccessful due to inaccurate simulation models of the involved dynamics. Alternatively, demonstrating specific interactions, and learning from them by imitation, can improve the efficiency of the system setup at the cost of its generality. In addition, further aspects need to be addressed to effectively manipulate deformable objects. Among those, employment and coordination of two or more arms can be necessary to properly manipulate highly deformable objects for both prehensile and non-prehensile manipulation. Finding efficient ways to combine planning and control is equally important in this regard. Finally, implementing the planned interaction can also be improved by specialized grippers or sensors, e.g., optical and haptic perception.

Specifically, this workshop will include (but is not limited to) the following topics:

  • Representation and state estimation
  • Simulation and modeling
  • Transfer from simulation to reality
  • Data-driven methods: end-to-end learning, learning from demonstration, etc.
  • Perception: state tracking, parameter identification, property detection (e.g. landmarks for garments) and classification, etc.
  • Control, visual servoing and planning
  • Multi-arm manipulation
  • Specialized tools, e.g. grippers, and sensors
  • Application-specific challenges: cloth folding, surgical tasks, etc.

Call for papers

We invite participants to submit extended abstracts 3+n pages, with n pages (no page-limit) for the bibliography, in the IEEE conference style.

Submissions will be reviewed by experts of their respective field. The accepted abstracts will be made available on the workshop website but will not appear in the official IEEE conference proceedings. Participants are encouraged to submit their recent work on the topics of interest mentioned above. Contributions are encouraged, but are not required, to be original.

The review process will be single-blind, meaning the submitted paper does not need to be anonymized.

Abstracts can be submitted through Microsoft CMT: https://cmt3.research.microsoft.com/WDOICRA2021.

Important dates:

  • Submission Deadline: 15.04.2021 AOE EXTENDED: 30.04.2021 AOE
  • Notification date: 17.05.2021 AOE
  • Final submission: 24.05.2021 AOE
  • Workshop date: 31.05.2021

Invited Speakers (alphabetical order)


Dmitry Berenson

Dmitry Berenson


Associate Professor Robotics Institute Electrical Engineering and Computer Science Dept.
University of Michigan, USA
Personal website

Talk title: Learning Where to Trust Unreliable Models for Deformable Object Manipulation


Jeannette Bohg

Jeannette Bohg


Assistant Professor for Robotics
Stanford University, USA
Personal website
Talk title: Bridging Topology and Geometry Using Reinforcement Learning

Julia Borras

Júlia Borràs Sol


Researcher and Vice-Director
Institut de Robotica i Informàtica Industrial, Spain
Personal website
Talk title: On analyzing and representing cloth manipulation tasks

Zackory Erickson

Zackory Erickson


PhD candidate
Georgia Institute of Technology, USA
Personal website
Talk title: Physics-based Cloth Simulation and Learning Towards Robotic Caregiving

LI, Xiang

Xiang Li


Associate Professor Department of Automation
Tsinghua University, China
Personal website
Talk title: Adaptive Control for Robotic Manipulation of Deformable Linear Objects
with Offline and Online Learning of Unknown Models

Dinesh Manocha

Dinesh Manocha


Paul Chrisman Iribe Professor of Computer Science,
Professor of Electrical and Computer Engineering
Department of Computer Science University of Maryland, USA
Personal website
Talk title: Learning based Methods for High-DOF Grasping

David Navarro-Alarcon

David Navarro-Alarcon


Assistant Professor in the Department of Mechanical Engineering
Hong Kong Polytechnic University, Hong Kong
Personal website
Talk title: On Latent Space Representations for Controlling Shapes of Deformable Objects

Wenzhen Yuan

Wenzhen Yuan


Assistant professor in the Robotics Insititute (RI)
Carnegie Mellon University, USA
Personal website
Talk title: Estimating object hardness with high-resolution tactile sensing

Main Organizers

  • Martina Lippi (primary contact), Roma Tre University, Italy
  • Michael C. Welle, KTH Royal Institute of Technology, Sweden
  • Anastasiia Varava , KTH Royal Institute of Technology, Sweden

Co-Organizers

  • Hang Yin, KTH Royal Institute of Technology, Sweden
  • Rika Antonova, Stanford University, USA
  • Florian T. Pokorny, KTH Royal Institute of Technology, Sweden
  • Danica Kragic, KTH Royal Institute of Technology, Sweden
  • Yiannis Karayiannidis, Chalmers University of Technology, Sweden
  • Ville Kyrki, Aalto University, Finland
  • Alessandro Marino, University of Cassino and Southern Lazio, Italy
  • Júlia Borràs Sol, Institut de Robotica i Informatica Industrial, Spain
  • Guillem Alenyà, Institut de Robotica i Informatica Industrial, Spain
  • Carme Torras, Institut de Robotica i Informatica Industrial, Spain

Contact

If you have any questions please contact Martina Lippi at the email: martina.lippi AT uniroma3 DOT it