Library portals are important vehicles by which to support the information needs and uses of library patrons. These systems provide users with convenient, personalized Web-based access to a comprehensive collection of information resources of relevance and authority. Moreover, library portals support a broad range of information seeking activity from browsing to search, provide mechanisms for communication and collaboration, and facilitate knowledge creation and sharing – all through a usable, intuitive interface.
This report proposes an evaluation framework for library portals that assesses the overall robustness of library portals on five dimensions:
- the usability of the system interface;
- the ability of the portal to support a wide spectrum of information seeking activity;
- the personalization of the interface in ways that match individual user needs;
- the extent to which the portal fosters knowledge work; and
- the degree to which intelligent agents are employed.
To test the viability of the framework, a real-life library portal, the McMaster University Library Gateway, is assessed. Overall, the system is found to exhibit some good characteristics, however recommendations are suggested to improve the overall robustness of this specific library portal’s design.
Immediate recommendations include the need:
- to improve the terminology used on the library portal interface to limit or reduce library jargon;
- to fix inconsistencies in the screen design; and
- to clean-up some navigation problems.
Short term recommendations include the need:
- to provide an integrated library portal site design that does not mimic the physical structure of individual libraries;
- to make the distinction between the library catalogue and other electronic resources transparent to users; and
- to provide better Web log tracking metrics.
Long term recommendations concentrate on:
- personalizing the site to individual user needs;
- offering communication and collaboration areas;
- providing a single browse/search function that is immediately accessible from the portal’s homepage and does comprehensive searching across the entire library’s resource collection; and
- leveraging the use of intelligent agents.
As such, the proposed evaluation framework proves to be an effective tool by which to assess the robustness of library portals and to elicit recommendations for enhancements and modifications.