The greatest challenge for discovery systems is how to provide users with the most relevant search results, given the immense landscape of available content. In a manner that is similar to human interaction between two parties, in which each person adjusts to the other in tone, language, and subject matter, discovery systems would ideally be sophisticated and flexible enough to adjust their algorithms to individual users and each user’s information needs. When evaluating the relevance of an item to a specific user in a specific context, relevance-ranking algorithms need to take into account, in addition to the degree to which the item matches the query, information that is not embodied in the item itself.

Such information, which includes the item’s scholarly value, the type of search that the user is conducting (e.g., an exploratory search or a known-item search), and other factors, enables a discovery system to fulfill user expectations that have been shaped by experience with Web search engines. This session will focus on the challenges of developing and evaluating relevance-ranking algorithms for the scholarly domain. Examples will be drawn mainly from the relevance-ranking technology deployed by the Ex Libris Primo discovery solution.

 Presentation (PDF)

Discovery Services have emerged to become a key element of libraries’ efforts to allow their patrons to satisfy their research needs. Harvesting and indexing millions of scholarly journal articles, books, biographies, reviews, and a vast array of other content types from thousands of sources, allowing users to find the best matches for their needs and presenting this information in a clear and understandable way is a tall order. Challenges include determining relevance for search results, providing users with ways to understand the depth and breadth of the collection being searched, and overall site usability. EBSCO has taken a data driven approach to solving these problems by testing various aspects of its Discovery Service, and using other data mining techniques. This session will describe the various methodologies that have been used and describe ways in which the service has evolved based on these efforts.

 Handout (PDF)