Title:

OS21-5 Development of a Real-Time Multi-Person 3D Keypoint Detection System Using Stereoscopic Cameras and RTMPose

Publication: ICAROB2025
Volume: 30
Pages: 593-596
ISSN: 2188-7829
DOI: 10.5954/ICAROB.2025.OS21-5
Author(s): Taufik Soesilo, Praveen Gunaratne, Hiroki Tamura
Publication Date: February 13, 2025
Keywords: RTMpose, real-time biomechanical analysis, computer vision, multi-person 3D keypoint detection
Abstract: The feature offers a way of tracking the movement patterns of many people at once, and is critical in occupational health, sports performance, and team-based work settings. The selected traditional biomechanical analysis systems, in turn, are largely considered in detecting single person movement, which weakens their applicability to movement analysis that involves interacting with multiple people. In this paper we consider a real time multi-person detection and analysis system using stereoscopic cameras and RTMPose, a novel high real-time pose estimation framework. RTMPose offers real time analysis of 2D key points for the individuals and this data is later augmented with depth data coming from stereoscopic imaging to give 3D skeletal data. The benefit of employing RTMPose is that the system is able to perform accurate and fast multiple persons tracking despite present occlusion scenarios. Consequently, the system overcomes the drawbacks of prior methods, including reliance on wearable devices and unsuitability for out-of-door environments, by employing stereoscopic cameras and RTMPose with low-latency and high-accurate inference. Experimental results demonstrate the system's ability to provide detailed real-time analysis of posture and movement for multiple individuals in diverse scenarios. This research highlights the potential of RTMPose-powered systems to advance multi-person biomechanical analysis for applications ranging from workplace monitoring to sports performance assessment.
PDF File: https://alife-robotics.co.jp/members2025/icarob/data/html/data/OS/OS21/OS21-5.pdf
Copyright: © The authors.
This article is distributed under the terms of the Creative Commons Attribution License 4.0, which permits non-commercial use, distribution and reproduction in any medium, provided the original work is properly cited.
See for details: https://creativecommons.org/licenses/by-nc/4.0/

ALife Robotics Corporation Ltd.

HOME

 

 

(c)2008 Copyright The Regents of ALife Robotics Corporation Ltd. All Rights Reserved.