TY - GEN
T1 - Towards a method for assessing summaries in spanish using LSA
AU - Venegas, René
PY - 2009
Y1 - 2009
N2 - One of the most important goals in Intelligent Tutoring is to create applications that can evaluate the quality of a text in a human-like manner. The aim of this study is to compare three methods of using Latent Semantic Analysis (LSA) to evaluate the quality of summaries written by students in Spanish. The sample is made up by 226 summaries written by Chilean students based on both expository and narrative texts. Each summary was first assessed by human judges in order to compare the results with the scoring provided by three different LSA methods: a) comparing the summaries with the original text divided in paragraphs, b) comparing the summaries with the text as one unit, and c) comparing the summaries with other summaries written by four human experts. Results show that comparison between each student's summary and the text as a one unit constitutes the method which most closely resembles human evaluation.
AB - One of the most important goals in Intelligent Tutoring is to create applications that can evaluate the quality of a text in a human-like manner. The aim of this study is to compare three methods of using Latent Semantic Analysis (LSA) to evaluate the quality of summaries written by students in Spanish. The sample is made up by 226 summaries written by Chilean students based on both expository and narrative texts. Each summary was first assessed by human judges in order to compare the results with the scoring provided by three different LSA methods: a) comparing the summaries with the original text divided in paragraphs, b) comparing the summaries with the text as one unit, and c) comparing the summaries with other summaries written by four human experts. Results show that comparison between each student's summary and the text as a one unit constitutes the method which most closely resembles human evaluation.
UR - http://www.scopus.com/inward/record.url?scp=70350511740&partnerID=8YFLogxK
M3 - Conference contribution
AN - SCOPUS:70350511740
SN - 9781577354192
T3 - Proceedings of the 22nd International Florida Artificial Intelligence Research Society Conference, FLAIRS-22
SP - 310
EP - 311
BT - Proceedings of the 22nd International Florida Artificial Intelligence Research Society Conference, FLAIRS-22
T2 - 22nd International Florida Artificial Intelligence Research Society Conference, FLAIRS-22
Y2 - 19 March 2009 through 21 March 2009
ER -