Preliminary results with BERT for human activity recognition using skeleton sequences features

Heilym Ramirez, Sergio A. Velastin, Ernesto Fabregas, Gonzalo Farias

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

The use of artificial intelligence techniques for the recognition of human activity has been an important area of research. Several approaches have been proposed and a large part of them address this problem through vision with conventional RGB cameras. Some of the most significant problems in human activity recognition systems are privacy, the limitations of the operating devices and the comparison of machine learning and deep learning techniques for the prediction of said activity. The present document presents an activity recognition system by means of a recurrent neural network BERT, based on camera vision, using image sequences containing the information of the detection of the pose of the human skeleton for the extraction of characteristics. The proposed method is evaluated with the UP-Fall data-set, outperforming the results of other activity recognition systems that use deep learning techniques and the same data-set. This method achieves an accuracy of 99.14% and a F1-Score of 80.95%.

Original languageEnglish
Title of host publication2022 IEEE International Conference on Automation/25th Congress of the Chilean Association of Automatic Control
Subtitle of host publicationFor the Development of Sustainable Agricultural Systems, ICA-ACCA 2022
PublisherInstitute of Electrical and Electronics Engineers Inc.
ISBN (Electronic)9781665494083
DOIs
StatePublished - 2022
Event2022 IEEE International Conference on Automation/25th Congress of the Chilean Association of Automatic Control, ICA-ACCA 2022 - Virtual, Online, Chile
Duration: 24 Oct 202228 Oct 2022

Publication series

Name2022 IEEE International Conference on Automation/25th Congress of the Chilean Association of Automatic Control: For the Development of Sustainable Agricultural Systems, ICA-ACCA 2022

Conference

Conference2022 IEEE International Conference on Automation/25th Congress of the Chilean Association of Automatic Control, ICA-ACCA 2022
Country/TerritoryChile
CityVirtual, Online
Period24/10/2228/10/22

Keywords

  • Activity recognition
  • BERT
  • computer vision
  • human skeleton
  • pose estimation

Fingerprint

Dive into the research topics of 'Preliminary results with BERT for human activity recognition using skeleton sequences features'. Together they form a unique fingerprint.

Cite this