Human Work Activity Recognition for Working Cells in Industrial Production Contexts
- Collaboration between robots and humans requires communicative skills on both sides. The robot has to understand the conscious and unconscious activities of human workers. Many state-of-the-art activity recognition algorithms with high performance rates on existing benchmark datasets are available for this task. This paper re-evaluates appropriate architectures in light of human work activity recognition for working cells in industrial production contexts. The specific constraints of such a domain is elaborated and used as prior knowledge. We utilize state-of-the-art algorithms as spatiotemporal feature encoders and search for appropriate classification and fusion strategies. Furthermore, we combine keypoint-based with appearance-based approaches to a multi-stream recognition system. Due to data protection rules and the high effort of data annotation within industrial domains only small datasets are available that reflect production aspects. Therefore, we use transfer learning approaches to reduce the dependency on data volume and variance in the target domain. The resulting recognition system achieves high performance for both singular person action and human-object interaction.
Author: | Clemens Pohlt, Thomas SchleglORCiD, Sven Wachsmuth |
---|---|
DOI: | https://doi.org/10.1109/SMC.2019.8913873 |
Parent Title (English): | 2019 IEEE International Conference on Systems, Man and Cybernetics (SMC), 6-9 Oct. 2019, Bari, Italy |
Document Type: | conference proceeding (article) |
Language: | English |
Year of first Publication: | 2019 |
Release Date: | 2022/02/07 |
Tag: | Activity recognition; Pose estimation; Robots; Task analysis; Three-dimensional displays; Two dimensional displays |
First Page: | 4225 |
Last Page: | 4230 |
Institutes: | Fakultät Elektro- und Informationstechnik |
Fakultät Maschinenbau | |
Fakultät Elektro- und Informationstechnik / Mechatronics Research Unit (MRU) | |
Begutachtungsstatus: | peer-reviewed |
research focus: | Produktion und Systeme |
Licence (German): | Keine Lizenz - Es gilt das deutsche Urheberrecht: § 53 UrhG |