Abstract
The rehabilitation process for hip replacement surgery relies on supervised exercises recommended by medical authorities. However, limitations in therapist availability, budget constraints, and evaluation inconsistencies have prompted the need for a more accessible and user-friendly solution. In this paper, we propose a scalable, user-friendly, and cost-effective vision-based human action recognition system utilizing machine learning (ML) and 2D cameras. By providing personalized monitoring, our solution aims to address the limitations of traditional rehabilitation methods and support productive home-based healthcare. A key component of our work involves the use of deep learning (DL) method to align time-series exercise data, which ensures accurate analysis and assessment. Additionally, we introduce the concept of a Golden Feature, which plays a critical role in the framework by providing valuable insights into exercise execution and contributing to overall system accuracy. Furthermore, our framework goes beyond predicting exercise scores and focuses on predicting comments for partially successful cases using a multi-label ML model. This allows for a deeper understanding of the clinical reasons behind partial success, such as the patient's physical condition and their execution of the exercise. By identifying and analyzing these factors, our framework provides meaningful feedback and guidance to support effective rehabilitation. When evaluated on multiple exercises, the system achieved an accuracy level of 80% or higher on predicting execution score, and 72% on predicting the execution feedback.
Original language | English |
---|---|
Title of host publication | Proceedings - 2023 IEEE/CVF International Conference on Computer Vision Workshops, ICCVW 2023 |
Publisher | Institute of Electrical and Electronics Engineers Inc. |
Pages | 1860-1869 |
Number of pages | 10 |
ISBN (Electronic) | 9798350307443 |
DOIs | |
State | Published - 2023 |
Event | 2023 IEEE/CVF International Conference on Computer Vision Workshops, ICCVW 2023 - Paris, France Duration: 2 Oct 2023 → 6 Oct 2023 |
Publication series
Name | Proceedings - 2023 IEEE/CVF International Conference on Computer Vision Workshops, ICCVW 2023 |
---|
Conference
Conference | 2023 IEEE/CVF International Conference on Computer Vision Workshops, ICCVW 2023 |
---|---|
Country/Territory | France |
City | Paris |
Period | 2/10/23 → 6/10/23 |
Bibliographical note
Publisher Copyright:© 2023 IEEE.
Keywords
- Assistive System
- Deep learning
- Home Healthcare
- Machine learning
- Personalized Monitoring
- Rehabilitation
- multi label ML
ASJC Scopus subject areas
- Artificial Intelligence
- Computer Science Applications
- Computer Vision and Pattern Recognition