Towards gestured-based technologies for human-centred smart factories
- Despite the increasing degree of automation in industry, manual or semi-automated are commonly and inevitable for complex assembly tasks. The transformation to smart processes in manufacturing leads to a higher deployment of data-driven approaches to support the worker. Upcoming technologies in this context are oftentimes based on the gesture-recognition, − monitoring or – control. This contribution systematically reviews gesture or motion capturing technologies and the utilization of gesture data in the ergonomic assessment, gesture-based robot control strategies as well as the identification of COVID-19 symptoms. Subsequently, two applications are presented in detail. First, a holistic human-centric optimization method for line-balancing using a novel indicator – ErgoTakt – derived by motion capturing. ErgoTakt improves the legacy takt-time and helps to find an optimum between the ergonomic evaluation of an assembly station and the takt-time balancing. An optimization algorithm is developed to find the best-fitting solution by minimizing a function of the ergonomic RULA-score and the cycle time of each assembly workstation with respect to the workers’ ability. The second application is gesture-based robot-control. A cloud-based approach utilizing a generally accessible hand-tracking model embedded in a low-code IoT programming environment is shown.
Author: | Jan Schmitt, Bastian Engelmann, Vito Modesto Manghisi, Markus Wilhelm, Antonello Uva, Michele Fiorentino |
---|---|
Persistent identifier: | https://doi.org/10.1080/0951192X.2022.2121424 |
ISSN: | 1362-3052 |
Parent Title (English): | International Journal of Computer Integrated Manufacturing |
Document Type: | Article |
Language: | English |
Date of first Publication: | 2023/02/22 |
Publishing Institution: | Hochschule für Angewandte Wissenschaften Würzburg-Schweinfurt |
Release Date: | 2023/02/22 |
Tag: | gesture-based control; gesture-based monitoring; manufacturing |
Volume: | 36 |
Issue: | 1 |
Pages/Size: | 18 |
First Page: | 110 |
Last Page: | 127 |
Institutes and faculty: | Fakultäten / Fakultät Wirtschaftsingenieurwesen |
Dewey Decimal Classification: | 6 Technik, Medizin, angewandte Wissenschaften / 67 Industrielle Fertigung / 670 Industrielle Fertigung |
Regensburger Klassifikation: | Technik |
Open access colour: | Gold |
Licence (German): | Creative Commons - CC BY-ND - Namensnennung - Keine Bearbeitungen 4.0 International |