2189 2022 2022 eng 6 conferenceobject IEEE 1 -- 2023-01-03 -- For many years simulations are an important tool for researchers in many fields of application. With ongoing improvements in computing power and the rising requirements in the industry, simulation software has to shift the focus more towards industrial use cases. Especially in robotics and machine learning applications, the physical behavior has to be reproduced as realistic as possible to avoid unwanted collisions during runtime. In general, applications such as mounting or bin picking with an automated robot shall be evaluated. Therefore this paper investigates three in-use and one newly published software environment with included physics engine for realistic simulations that are commercially available. For comparison, a benchmark with collisions between two gears to imitate a mounting process is implemented and key features are defined. Only two of the simulation software manage to pass the benchmark. Despite that, both of them show restrictions revealing a lack of reliable software for realistic robot interaction simulation. 2022 10th International Conference on Systems and Control (ICSC) 10.1109/ICSC57768.2022.9993845 true {"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2024,2,2]],"date-time":"2024-02-02T00:29:34Z","timestamp":1706833774860},"reference-count":30,"publisher":"IEEE","license":[{"start":{"date-parts":[[2022,11,23]],"date-time":"2022-11-23T00:00:00Z","timestamp":1669161600000},"content-version":"stm-asf","delay-in-days":0,"URL":"https:\/\/doi.org\/10.15223\/policy-029"},{"start":{"date-parts":[[2022,11,23]],"date-time":"2022-11-23T00:00:00Z","timestamp":1669161600000},"content-version":"stm-asf","delay-in-days":0,"URL":"https:\/\/doi.org\/10.15223\/policy-037"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2022,11,23]]},"DOI":"10.1109\/icsc57768.2022.9993845","type":"proceedings-article","created":{"date-parts":[[2023,1,3]],"date-time":"2023-01-03T21:54:13Z","timestamp":1672782853000},"source":"Crossref","is-referenced-by-count":0,"title":["Comparison of Commercial Physics-Based Simulation Environments with a Collision-Rich Benchmark"],"prefix":"10.1109","author":[{"given":"Christian","family":"Holzer","sequence":"first","affiliation":[{"name":"Institute of Smart Production Nuremberg Campus of Technology,Nuremberg,Germany,90489"}]},{"given":"Ronald","family":"Schmidt-Vollus","sequence":"additional","affiliation":[{"name":"Institute of Smart Production Nuremberg Campus of Technology,Nuremberg,Germany,90489"}]},{"given":"Axel","family":"Godrich","sequence":"additional","affiliation":[{"name":"Institute of Smart Production Nuremberg Campus of Technology,Nuremberg,Germany,90489"}]},{"given":"Bastian","family":"Helldorfer","sequence":"additional","affiliation":[{"name":"Schaeffler Technologies AG & Co. KG,Herzogenaurach,Germany,91074"}]},{"given":"Georg","family":"Jehle","sequence":"additional","affiliation":[{"name":"Schaeffler Technologies AG & Co. KG,Herzogenaurach,Germany,91074"}]},{"given":"Daniel-Rouven","family":"Riedlbauer","sequence":"additional","affiliation":[{"name":"Schaeffler Technologies AG & Co. KG,Herzogenaurach,Germany,91074"}]}],"member":"263","reference":[{"key":"ref1","doi-asserted-by":"publisher","DOI":"10.1016\/j.ifacol.2015.06.141"},{"key":"ref2","article-title":"Virtual commissioning; Model types and glossary","volume-title":"VDI\/VDE 3693","year":"2016"},{"key":"ref3","doi-asserted-by":"publisher","DOI":"10.1109\/tii.2018.2873186"},{"key":"ref4","doi-asserted-by":"publisher","DOI":"10.1109\/icra.2018.8460875"},{"key":"ref5","doi-asserted-by":"publisher","DOI":"10.1109\/iros.2017.8202206"},{"key":"ref6","doi-asserted-by":"publisher","DOI":"10.1109\/iros.2017.8202133"},{"key":"ref7","doi-asserted-by":"publisher","DOI":"10.1109\/icst49551.2021.00036"},{"key":"ref8","doi-asserted-by":"publisher","DOI":"10.1016\/j.matcom.2008.02.017"},{"key":"ref9","doi-asserted-by":"publisher","DOI":"10.1097\/mou.0000000000000137"},{"key":"ref10","doi-asserted-by":"publisher","DOI":"10.3390\/educsci11010011"},{"key":"ref11","doi-asserted-by":"publisher","DOI":"10.1145\/2141622.2141689"},{"key":"ref12","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-96728-8_30"},{"key":"ref13","volume-title":"CoppeliaSim","year":"22"},{"key":"ref14","volume-title":"Gazebo","year":"2022"},{"key":"ref15","volume-title":"ARGoS","year":"2022"},{"key":"ref16","doi-asserted-by":"publisher","DOI":"10.1109\/svr.2019.00049"},{"key":"ref17","volume-title":"Unity","year":"2022"},{"key":"ref18","author":"K\u00f6rber","year":"2021","journal-title":"Comparing Popular Simulation Environments in the Scope of Robotics and Reinforcement Learning"},{"key":"ref19","volume-title":"MuJoCo","year":"2022"},{"key":"ref20","volume-title":"PyBullet","year":"2022"},{"key":"ref21","volume-title":"Webots","year":"2022"},{"key":"ref22","doi-asserted-by":"publisher","DOI":"10.23919\/ICCAS55662.2022.10003832"},{"key":"ref23","volume-title":"Siemens Digital Industries Software","year":"2022"},{"key":"ref24","volume-title":"Dassault Syst\u00e8ms 3DEXPERIENCE","year":"2022"},{"key":"ref25","volume-title":"NVIDIA Omniverse","year":"2022"},{"key":"ref26","volume-title":"NVIDIA PhysX","year":"2022"},{"key":"ref27","volume-title":"Algoryx","year":"2022"},{"key":"ref28","doi-asserted-by":"publisher","DOI":"10.1109\/cvpr42600.2020.00011"},{"key":"ref29","doi-asserted-by":"publisher","DOI":"10.1145\/3384538"},{"key":"ref30","volume-title":"Universal Scene Description","year":"2022"}],"event":{"name":"2022 10th International Conference on Systems and Control (ICSC)","location":"Marseille, France","start":{"date-parts":[[2022,11,23]]},"end":{"date-parts":[[2022,11,25]]}},"container-title":["2022 10th International Conference on Systems and Control (ICSC)"],"original-title":[],"link":[{"URL":"http:\/\/xplorestaging.ieee.org\/ielx7\/9993810\/9993811\/09993845.pdf?arnumber=9993845","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,2,1]],"date-time":"2024-02-01T12:03:03Z","timestamp":1706788983000},"score":1,"resource":{"primary":{"URL":"https:\/\/ieeexplore.ieee.org\/document\/9993845\/"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,11,23]]},"references-count":30,"URL":"http:\/\/dx.doi.org\/10.1109\/icsc57768.2022.9993845","relation":{},"subject":[],"published":{"date-parts":[[2022,11,23]]}}} proceedings-article https://doi.org/10.15223/policy-029 crossref PersonAuthorFirstName_1,PersonAuthorLastName_1,PersonAuthorFirstName_2,PersonAuthorLastName_2,PersonAuthorFirstName_3,PersonAuthorLastName_3,PersonAuthorFirstName_4,PersonAuthorLastName_4,PersonAuthorFirstName_5,PersonAuthorLastName_5,PersonAuthorFirstName_6,PersonAuthorLastName_6,Enrichmentconference_title,Enrichmentconference_place,PublisherName,TitleMain_1,TitleParent_1,CompletedYear,Enrichmentlocal_crossrefLicence 2022 10th International Conference on Systems and Control (ICSC) Marseille, France doi-import false false Christian Hölzer Ronald Schmidt-Vollus Axel Gödrich Bastian Helldorfer Georg Jehle Daniel-Rouven Riedlbauer deu uncontrolled Industries , Service robots , Computational modeling , Benchmark testing , Software , Digital twins , Behavioral sciences Fakultät für Elektrotechnik Feinwerktechnik Informationstechnik Fakultät Maschinenbau und Versorgungstechnik Materialien & Produktionstechnik