A new three levels context based approach for web search engines evaluation

Abstract : Classical approaches for evaluating information retrieval tools have limitations and shortcomings, particularly regarding to the consideration of the user, the manner in which these approaches measure the adequacy between the user's query and the returned documents, and the consideration of the search tool characteristics. This critical finding prompted our reflections for the exploitation of contextual elements around the user, the query and the search tool during the evaluation process. This paper presents a new approach based on three complementary levels of context for evaluating information retrieval tools. The experiments gives at the end of this article has shown the applicability of the proposed approach to real research tools. The tests were performed with the most popular searching engine (i.e. Google, Bing and Yahoo) selected in particular for their high selectivity. The results have revealed that the evaluation of search engines at three different levels of context is a promising way to diagnose the performance, characteristics and behavior of these engines and the relevance of the results that they return.
Document type :
Conference papers
Complete list of metadatas

https://hal-supelec.archives-ouvertes.fr/hal-00658751
Contributor : Evelyne Faivre <>
Submitted on : Wednesday, January 11, 2012 - 10:49:16 AM
Last modification on : Thursday, September 13, 2018 - 5:12:18 PM

Links full text

Identifiers

Collections

Citation

Abdelkrim Bouramoul, Mohamed-Khireddine Kholladi, Bich-Liên Doan. A new three levels context based approach for web search engines evaluation. Sixth International Conference on Dependability and Computer Systems, DepCos'11, Jun 2011, Wroclaw, Poland. pp.31-45, ⟨10.1007/978-3-642-21393-9_3⟩. ⟨hal-00658751⟩

Share

Metrics

Record views

172