Automated recognition of individual performers from de-identified video sequences

Chen, Z., Czarnuch, S., Dove, E. and Astell, A. ORCID: https://orcid.org/0000-0002-6822-9472 (2023) Automated recognition of individual performers from de-identified video sequences. Machine Learning with Applications, 11. 100450. ISSN 2666-8270 doi: 10.1016/j.mlwa.2023.100450

Abstract/Summary

dentification of individual humans from RGB image data is well-established. However, in many domains, such as in healthcare or applications involving children, ethical issues have been raised around using traditional RGB image data because individuals can be identified from these data. The widespread availability of reliable depth data, and the associated human skeleton data derived from these data, presents an opportunity to differentiate between individuals while potentially avoiding individually identifiable features. Using skeleton data only, we developed a unique 20-dimensional bone segment length feature vector for 1,761 trials (1,759,980 image frames) of data, captured from 14 participants who engaged in a one-hour group intervention playing Xbox One Kinect Bowling twice-weekly for 24 weeks. We then evaluated our novel feature using representative batch processing (k-nearest neighbour) and real-time (multi-layer perceptron) models, validated against manually-labelled ground-truth data. Our results suggest that our skeleton feature can differentiate between instances (i.e., individuals) with an accuracy over all participants of 100% for batch processing and 96.57% in real-time, and deals well with class imbalances. Our results suggest that we can reliably differentiate between individual persons using only skeleton data derived from depth image data in medical research.

Item Type	Article
URI	https://reading-clone.eprints-hosting.org/id/eprint/110287
Identification Number/DOI	10.1016/j.mlwa.2023.100450
Refereed	Yes
Divisions	Life Sciences > School of Psychology and Clinical Language Sciences > Ageing
Publisher	Elsevier
Download/View statistics	View download statistics for this item