Performance issues and error analysis in an open-domain Question Answering system

被引:119
作者
Moldovan, D
Pasca, M
Harabagiu, S
Surdeanu, M
机构
[1] Richardson, TX 75080
关键词
performance; experimentation; Question Answering; performance analysis; text retrieval; natural; language applications;
D O I
10.1145/763693.763694
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
This paper presents an in-depth analysis of a state-of-the- art Question Answering system. Several scenarios are examined: ( 1) the performance of each module in a serial baseline system, ( 2) the impact of feedbacks and the insertion of a logic prover, and ( 3) the impact of various retrieval strategies and lexical resources. The main conclusion is that the overall performance depends on the depth of natural language processing resources and the tools used for answer finding.
引用
收藏
页码:133 / 154
页数:22
相关论文
共 25 条
[1]  
Abney S, 2000, 6TH APPLIED NATURAL LANGUAGE PROCESSING CONFERENCE/1ST MEETING OF THE NORTH AMERICAN CHAPTER OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS, PROCEEDINGS OF THE CONFERENCE AND PROCEEDINGS OF THE ANLP-NAACL 2000 STUDENT RESEARCH WORKSHOP, P296
[2]  
[Anonymous], P NAACL WORKSH WORDN
[3]  
[Anonymous], P 24 ACM SIGIR C NEW
[4]  
[Anonymous], P HUM LANG TECHN C S
[5]  
BRECK E, 2001, P 39 ANN M ASS COMP, P1
[6]  
Breck E. J., 2000, P 2 INT C LANG RES E, P1495
[7]  
Cardie C, 2000, 6TH APPLIED NATURAL LANGUAGE PROCESSING CONFERENCE/1ST MEETING OF THE NORTH AMERICAN CHAPTER OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS, PROCEEDINGS OF THE CONFERENCE AND PROCEEDINGS OF THE ANLP-NAACL 2000 STUDENT RESEARCH WORKSHOP, P180
[8]  
CLARKE C, 2002, P 25 ACM C RES DEV I, P367
[9]  
HARABAGIU S, 2000, P 18 INT C COMP LING, P292
[10]  
Humphreys, 2000, P 6 CONT BAS MULT IN, P1288