The ProfileSkim has won a medal of the
British Computer Society's Technology Awards 2005!
The Gala Presentation Dinner was held at the Hilton Park Lane in London, 29th September, 2005.
A novel within document retrieval tool called ProfileSkim has been
designed, developed and evaluated in this internally funded project.
The main components of the skimmer are a Relevance Profile Meter that
displays the relevance profile across the document and a document browser
that supports highlighting of the query words.
The main function of ProfileSkim is to enable users to identify,
efficiently and effectively, relevant passages of text within long
documents. The tool integrates passage retrieval, content-based document
browsing and an interactive user interface. The key concept underpinning
the tool is relevance profiling, in which a profile of retrieval status
values is computed across a document in response to a query. Within the
user interface, an interactive bar graph provides an overview of this
profile, and through interaction with the graph the user can select and
browse in situ potentially relevant passages within the document.
A user-centred, task-oriented, comparative evaluation has been
conducted in the evaluation of ProfileSkim. FindSkim, which provides
similar functionality to the web browser's "Find" command, was developed
as a comparison system of ProfileSkim.
Analysis of the experiments confirmed that ProfileSkim was
significantly more efficient than Find-Skim, as measured by time for task.
The study also indicated that ProfileSkim was as least as effective as
FindSkim in identifying relevant pages, as measured by traditional
information retrieval measures. Based on qualitative data from
questionnaires, there are strong evidences showing that the participants
would be more satisfied when using ProfileSkim than FindSkim.
The experimental study confirmed the potential of relevance profiling
improving within-document retrieval, and the interactive user interface
attracting user's attention. Interactive Relevance Profiling should prove
highly beneficial for users trying to identify relevant information within
Harper, D. J., Koychev, I., Sun, Y. and Pirie, I. (2004). Within
Document Retrieval: A User-Centred Evaluation of Relevance Profiling.
Information Retrieval, 2004(7): p. 265-290.
Click here to view our PowerPoint presentation (1.5 MB - for best results, once opened please click F5 to view presentation as slide show).