Portfolio item number 1
Short description of portfolio item number 1
Short description of portfolio item number 1
Short description of portfolio item number 2 
Tl;dr: Proposes the first version of MetaGraspNet dataset for robotic picking. Best Paper Award Finalist.
M. Gilles, Y. Chen, T. Robin Winter, E. Zhixuan Zeng and A. Wong, "MetaGraspNet: A Large-Scale Benchmark Dataset for Scene-Aware Ambidextrous Bin Picking via Physics-based Metaverse Synthesis," 2022 IEEE 18th International Conference on Automation Science and Engineering (CASE), Mexico-City, Mexico, August 2022, pp. 220-227, doi: 10.1109/CASE49997.2022.9926427.
Download Paper
Tl;dr: Proposes a reliable object detection and segmentation system with Multi Modal Redundancy (MMRNet) for tackling object detection and segmentation.
Y. Chen, H. Gunraj, E. Z. Zeng, R. Meyer, M. Gilles, A. Wong, "MMRNet: Improving Reliability for Multimodal Object Detection and Segmentation for Bin Picking via Multimodal Redundancy ," IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) Workshops, June 2023, pp. 68-77.
Download Paper
Tl;dr: Contributes the second version of MetaGraspNet dataset for robotic picking by adding amodal panoptic segmentation masks and proposing an occlusion-aware fast picking method.
M. Gilles et al., "MetaGraspNetV2: All-in-One Dataset Enabling Fast and Reliable Robotic Bin Picking via Object Relationship Reasoning and Dexterous Grasping," IEEE Transactions on Automation Science and Engineering (T-ASE), 21(3), pp. 2302-2320, July 2024, doi: 10.1109/TASE.2023.3328964.
Download Paper
Tl;dr: Proposes an active learning framework using an uncertainty- and diversity-based query function for sample-efficient sim-to-real domain adaptation of picking robots.
M. Gilles, K. Furmans and R. Rayyes, "MetaMVUC: Active Learning for Sample-Efficient Sim-to-Real Domain Adaptation in Robotic Grasping," IEEE Robotics and Automation Letters, 10(4), pp.3644-3651, April 2025, doi: 10.1109/LRA.2025.3544083.
Download Paper
Tl;dr: Proposes an uncertainty-aware approach for 6-DoF grasp detection using evidential learning.
Y. Shi, E. Welte, M. Gilles and R. Rayyes, "vMF-Contact: Uncertainty-Aware Evidential Learning for Probabilistic Contact-Grasp in Noisy Clutter," 2025 IEEE International Conference on Robotics and Automation (ICRA), May 2025, pp. 11668-11674, doi: 10.1109/ICRA55743.2025.11127888.
Download Paper
Tl;dr: Proposes a real-world, multi-modal (3D LiDAR and multi-view camera images) panoptic dataset for mobile robots in warehouse environments.
P. Hao, M. Gilles, D. Schüthe, S. Dierfeld, K. Furmans, "MPLog: A Multimodal Panoptic Dataset for Intralogistics ," Under Review, 2026.
Funding Agency: BMWK (Germany)
Partners: voraus Robotik GmbH (Germany)
Duration: January 2025 - December 2026
Funding Agency: BMWK (Germany) and NRC (Canada)
Partners: STILL GmbH (Germany), KIT (Germany), LeddarTech (Canada), University of Toronto (Canada)
Duration: March 2021 - November 2023
Funding Agency: BMWK (Germany) and NRC (Canada)
Partners: Festo SE & Co. KG (Germany), KIT (Germany), DarwinAI (Canada), University of Waterloo (Canada)
Duration: Februar 2021 - July 2023
Graduate Course for Mechatronics and Information Technology Students, KIT, Germany, 1900