Human interaction recognition framework based on interacting body part attention
DC Field | Value | Language |
---|---|---|
dc.contributor.author | Lee, Dong-Gyu | - |
dc.contributor.author | Lee, Seong-Whan | - |
dc.date.accessioned | 2022-06-09T06:40:51Z | - |
dc.date.available | 2022-06-09T06:40:51Z | - |
dc.date.created | 2022-06-09 | - |
dc.date.issued | 2022-08 | - |
dc.identifier.issn | 0031-3203 | - |
dc.identifier.uri | https://scholar.korea.ac.kr/handle/2021.sw.korea/141703 | - |
dc.description.abstract | Human activity recognition in videos has been widely studied and has recently gained significant ad -vances with deep learning approaches; however, it remains a challenging task. In this paper, we propose a novel framework that simultaneously considers both implicit and explicit representations of human in-teractions by fusing information of local image where the interaction actively occurred, primitive motion with the posture of individual subject's body parts, and the co-occurrence of overall appearance change. Human interactions change, depending on how the body parts of each human interact with the other. The proposed method captures the subtle difference between different interactions using interacting body part attention. Semantically important body parts that interact with other objects are given more weight during feature representation. The combined feature of interacting body part attention-based individ-ual representation and the co-occurrence descriptor of the full-body appearance change is fed into long short-term memory to model the temporal dynamics over time in a single framework. The experimen-tal results on five widely used public datasets demonstrate the effectiveness of the proposed method to recognize human interactions from videos. (c) 2022 Elsevier Ltd. All rights reserved. | - |
dc.language | English | - |
dc.language.iso | en | - |
dc.publisher | ELSEVIER SCI LTD | - |
dc.title | Human interaction recognition framework based on interacting body part attention | - |
dc.type | Article | - |
dc.contributor.affiliatedAuthor | Lee, Seong-Whan | - |
dc.identifier.doi | 10.1016/j.patcog.2022.108645 | - |
dc.identifier.scopusid | 2-s2.0-85126974615 | - |
dc.identifier.wosid | 000790820100002 | - |
dc.identifier.bibliographicCitation | PATTERN RECOGNITION, v.128 | - |
dc.relation.isPartOf | PATTERN RECOGNITION | - |
dc.citation.title | PATTERN RECOGNITION | - |
dc.citation.volume | 128 | - |
dc.type.rims | ART | - |
dc.type.docType | Article | - |
dc.description.journalClass | 1 | - |
dc.description.journalRegisteredClass | scie | - |
dc.description.journalRegisteredClass | scopus | - |
dc.relation.journalResearchArea | Computer Science | - |
dc.relation.journalResearchArea | Engineering | - |
dc.relation.journalWebOfScienceCategory | Computer Science, Artificial Intelligence | - |
dc.relation.journalWebOfScienceCategory | Engineering, Electrical & Electronic | - |
dc.subject.keywordAuthor | Human activity recognition | - |
dc.subject.keywordAuthor | Human -human interaction | - |
dc.subject.keywordAuthor | Interacting body part attention | - |
Items in ScholarWorks are protected by copyright, with all rights reserved, unless otherwise indicated.
(02841) 서울특별시 성북구 안암로 14502-3290-1114
COPYRIGHT © 2021 Korea University. All Rights Reserved.
Certain data included herein are derived from the © Web of Science of Clarivate Analytics. All rights reserved.
You may not copy or re-distribute this material in whole or in part without the prior written consent of Clarivate Analytics.