On the efficacy of per-relation basis performance evaluation for PPI extraction and a high-precision rule-based approach
DC Field | Value | Language |
---|---|---|
dc.contributor.author | Lee, Junkyu | - |
dc.contributor.author | Kim, Seongsoon | - |
dc.contributor.author | Lee, Sunwon | - |
dc.contributor.author | Lee, Kyubum | - |
dc.contributor.author | Kang, Jaewoo | - |
dc.date.accessioned | 2021-09-06T02:40:58Z | - |
dc.date.available | 2021-09-06T02:40:58Z | - |
dc.date.created | 2021-06-14 | - |
dc.date.issued | 2013-04-05 | - |
dc.identifier.issn | 1472-6947 | - |
dc.identifier.uri | https://scholar.korea.ac.kr/handle/2021.sw.korea/103516 | - |
dc.description.abstract | Background: Most previous Protein Protein Interaction (PPI) studies evaluated their algorithms' performance based on "per-instance" precision and recall, in which the instances of an interaction relation were evaluated independently. However, we argue that this standard evaluation method should be revisited. In a large corpus, the same relation can be described in various different forms and, in practice, correctly identifying not all but a small subset of them would often suffice to detect the given interaction. Methods: In this regard, we propose a more pragmatic "per-relation" basis performance evaluation method instead of the conventional per-instance basis method. In the per-relation basis method, only a subset of a relation's instances needs to be correctly identified to make the relation positive. In this work, we also introduce a new high-precision rule-based PPI extraction algorithm. While virtually all current PPI extraction studies focus on improving F-score, aiming to balance the performance on both precision and recall, in many realistic scenarios involving large corpora, one can benefit more from a high-precision algorithm than a high-recall counterpart. Results: We show that our algorithm not only achieves better per-relation performance than previous solutions but also serves as a good complement to the existing PPI extraction tools. Our algorithm improves the performance of the existing tools through simple pipelining. Conclusion: The significance of this research can be found in that this research brought new perspective to the performance evaluation of PPI extraction studies, which we believe is more important in practice than existing evaluation criteria. Given the new evaluation perspective, we also showed the importance of a high-precision extraction tool and validated the efficacy of our rule-based system as the high-precision tool candidate. | - |
dc.language | English | - |
dc.language.iso | en | - |
dc.publisher | BMC | - |
dc.subject | PROTEIN-PROTEIN INTERACTIONS | - |
dc.subject | INFORMATION | - |
dc.subject | KERNEL | - |
dc.subject | CORPUS | - |
dc.title | On the efficacy of per-relation basis performance evaluation for PPI extraction and a high-precision rule-based approach | - |
dc.type | Article | - |
dc.contributor.affiliatedAuthor | Kang, Jaewoo | - |
dc.identifier.doi | 10.1186/1472-6947-13-S1-S7 | - |
dc.identifier.scopusid | 2-s2.0-84875921402 | - |
dc.identifier.wosid | 000317188100007 | - |
dc.identifier.bibliographicCitation | BMC MEDICAL INFORMATICS AND DECISION MAKING, v.13 | - |
dc.relation.isPartOf | BMC MEDICAL INFORMATICS AND DECISION MAKING | - |
dc.citation.title | BMC MEDICAL INFORMATICS AND DECISION MAKING | - |
dc.citation.volume | 13 | - |
dc.type.rims | ART | - |
dc.type.docType | Article; Proceedings Paper | - |
dc.description.journalClass | 1 | - |
dc.description.journalRegisteredClass | scie | - |
dc.description.journalRegisteredClass | scopus | - |
dc.relation.journalResearchArea | Medical Informatics | - |
dc.relation.journalWebOfScienceCategory | Medical Informatics | - |
dc.subject.keywordPlus | PROTEIN-PROTEIN INTERACTIONS | - |
dc.subject.keywordPlus | INFORMATION | - |
dc.subject.keywordPlus | KERNEL | - |
dc.subject.keywordPlus | CORPUS | - |
Items in ScholarWorks are protected by copyright, with all rights reserved, unless otherwise indicated.
(02841) 서울특별시 성북구 안암로 14502-3290-1114
COPYRIGHT © 2021 Korea University. All Rights Reserved.
Certain data included herein are derived from the © Web of Science of Clarivate Analytics. All rights reserved.
You may not copy or re-distribute this material in whole or in part without the prior written consent of Clarivate Analytics.