Can Machines Learn to Comprehend Scientific Literature?
DC Field | Value | Language |
---|---|---|
dc.contributor.author | Park, Donghyeon | - |
dc.contributor.author | Choi, Yonghwa | - |
dc.contributor.author | Kim, Daehan | - |
dc.contributor.author | Yu, Minhwan | - |
dc.contributor.author | Kim, Seongsoon | - |
dc.contributor.author | Kang, Jaewoo | - |
dc.date.accessioned | 2021-09-01T22:48:41Z | - |
dc.date.available | 2021-09-01T22:48:41Z | - |
dc.date.created | 2021-06-19 | - |
dc.date.issued | 2019 | - |
dc.identifier.issn | 2169-3536 | - |
dc.identifier.uri | https://scholar.korea.ac.kr/handle/2021.sw.korea/68960 | - |
dc.description.abstract | To measure the ability of a machine to understand professional-level scientific articles, we construct a scientific question answering task called PaperQA. The PaperQA task is based on more than 80 000 "fill-in-the-blank" type questions on articles from reputed scientific journals such as Nature and Science. We perform fine-grained linguistic analysis and evaluation to compare PaperQA and other conventional question and answering (QA) tasks on general literature (e.g., books, news articles, and Wikipedia texts). The results indicate that the PaperQA task is the most difficult QA task for both humans (lay people) and machines (deep-learning models). Moreover, humans generally outperform machines in conventional QA tasks, but we found that advanced deep-learning models outperform humans by 3%-13% on average in the PaperQA task. The PaperQA dataset used in this paper is publicly available at http://dmis.korea.ac.kr/downloads?id=PaperQA. | - |
dc.language | English | - |
dc.language.iso | en | - |
dc.publisher | IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC | - |
dc.title | Can Machines Learn to Comprehend Scientific Literature? | - |
dc.type | Article | - |
dc.contributor.affiliatedAuthor | Kang, Jaewoo | - |
dc.identifier.doi | 10.1109/ACCESS.2019.2891666 | - |
dc.identifier.scopusid | 2-s2.0-85061800643 | - |
dc.identifier.wosid | 000459116300004 | - |
dc.identifier.bibliographicCitation | IEEE ACCESS, v.7, pp.16246 - 16256 | - |
dc.relation.isPartOf | IEEE ACCESS | - |
dc.citation.title | IEEE ACCESS | - |
dc.citation.volume | 7 | - |
dc.citation.startPage | 16246 | - |
dc.citation.endPage | 16256 | - |
dc.type.rims | ART | - |
dc.type.docType | Article | - |
dc.description.journalClass | 1 | - |
dc.description.journalRegisteredClass | scie | - |
dc.description.journalRegisteredClass | scopus | - |
dc.relation.journalResearchArea | Computer Science | - |
dc.relation.journalResearchArea | Engineering | - |
dc.relation.journalResearchArea | Telecommunications | - |
dc.relation.journalWebOfScienceCategory | Computer Science, Information Systems | - |
dc.relation.journalWebOfScienceCategory | Engineering, Electrical & Electronic | - |
dc.relation.journalWebOfScienceCategory | Telecommunications | - |
dc.subject.keywordAuthor | Artificial intelligence | - |
dc.subject.keywordAuthor | crowdsourcing | - |
dc.subject.keywordAuthor | data acquisition | - |
dc.subject.keywordAuthor | data analysis | - |
dc.subject.keywordAuthor | data collection | - |
dc.subject.keywordAuthor | data mining | - |
dc.subject.keywordAuthor | data preprocessing | - |
dc.subject.keywordAuthor | knowledge discovery | - |
dc.subject.keywordAuthor | machine intelligence | - |
dc.subject.keywordAuthor | natural language processing | - |
dc.subject.keywordAuthor | social computing | - |
dc.subject.keywordAuthor | text analysis | - |
dc.subject.keywordAuthor | text mining | - |
Items in ScholarWorks are protected by copyright, with all rights reserved, unless otherwise indicated.
(02841) 서울특별시 성북구 안암로 14502-3290-1114
COPYRIGHT © 2021 Korea University. All Rights Reserved.
Certain data included herein are derived from the © Web of Science of Clarivate Analytics. All rights reserved.
You may not copy or re-distribute this material in whole or in part without the prior written consent of Clarivate Analytics.