LINA: Identifying Comparable Documents from Wikipedia

Emmanuel Morin (1) , Amir Hazem (1) , Florian Boudin (1) , Elizaveta Loginova Clouet (1)

1 LS2N - équipe TALN - Traitement Automatique du Langage Naturel

This paper describes the LINA system for the BUCC 2015 shared track. Following (Enright and Kondrak, 2007), our system identify comparable documents by collecting counts of hapax words. We extend this method by filtering out document pairs sharing target documents using pigeonhole reasoning and cross-lingual information .

Domains: Document and Text Processing

Emmanuel Morin, Amir Hazem, Florian Boudin, Elizaveta Loginova Clouet. LINA: Identifying Comparable Documents from Wikipedia. 8th Workshop on Building and Using Comparable Corpora (BUCC), Jul 2015, Pékin, China. ⟨hal-01185670⟩