TY - JOUR
T1 - A discriminative sentence compression method as combinatorial optimization problem
AU - Hirao, Tsutomu
AU - Suzuki, Jun
AU - Isczaki, Hideki
PY - 2007
Y1 - 2007
N2 - In the study of automatic summarization, the main research topic was 'important sentence extraction' but nowadays 'sentence compression' is a hot research topic. Conventional sentence compression methods usually transform a given sentence into a parse tree or a dependency tree, and modify them to get a, shorter sentence. However, this method is sometimes too rigid. In this paper, we regard sentence compression as an combinatorial optimization problem that extracts an optimal subsequence of words. Hori et al. also proposed a similar method, but they used only a small number of features and their weights were tuned by hand. We introduce a large number of features such as part-of-speech bigrams and word position in the sentence. Furthermore, we train the system by discriminative learning. According to our experiments, our method obtained better score than other methods with statistical significance.
AB - In the study of automatic summarization, the main research topic was 'important sentence extraction' but nowadays 'sentence compression' is a hot research topic. Conventional sentence compression methods usually transform a given sentence into a parse tree or a dependency tree, and modify them to get a, shorter sentence. However, this method is sometimes too rigid. In this paper, we regard sentence compression as an combinatorial optimization problem that extracts an optimal subsequence of words. Hori et al. also proposed a similar method, but they used only a small number of features and their weights were tuned by hand. We introduce a large number of features such as part-of-speech bigrams and word position in the sentence. Furthermore, we train the system by discriminative learning. According to our experiments, our method obtained better score than other methods with statistical significance.
KW - Combinatorial optimization
KW - Discriminative learning
KW - Dynamic programming
KW - Sentence compression
KW - Text summarization
UR - http://www.scopus.com/inward/record.url?scp=41849097729&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=41849097729&partnerID=8YFLogxK
U2 - 10.1527/tjsai.22.574
DO - 10.1527/tjsai.22.574
M3 - Article
AN - SCOPUS:41849097729
SN - 1346-0714
VL - 22
SP - 574
EP - 583
JO - Transactions of the Japanese Society for Artificial Intelligence
JF - Transactions of the Japanese Society for Artificial Intelligence
IS - 6
ER -