CNI: Coalition for Networked Information

  • About CNI
    • Membership
    • CNI Collaborations
    • Staff
    • Steering Committee
    • CNI Awards
    • History
    • CNI News
  • Program Plan
    • Current Program Plan
    • Program Plan Archive
  • Topics
  • Events & Projects
    • Membership Meetings
    • Workshops & Projects
    • Other Events
    • Event Calendar
  • Resources
    • Publications by CNI Staff
    • Program Plan
    • Pre-Recorded Project Briefing Series
    • Videos & Podcasts
    • Follow CNI
    • Historical Resources
  • Contact Us

A Very Large Scale Library for the History of the Web

Home / Project Briefing Pages / CNI Spring 2006 Project Briefings / A Very Large Scale Library for the History of the Web

April 1, 2006

William Y. Arms
Professor of Computer Science
Cornell University

As digital libraries become ubiquitous, scholarship is changing. We can foresee a day when humanities and social science scholars carry out library research with computer programs that act as their agents. This briefing describes the implementation of the Cornell Web Library, which has been designed for this new style of social science research. The library is currently loading some 10 billion Web pages, about 240 Terabytes. They are drawn from the historical collections of the Internet Archive. The briefing will discuss the tools needed to carry out research on such a large corpus; it will also discuss the capabilities and limitations of today’s high performance computing for very large-scale digital libraries.

Web Site:
http://www.infosci.cornell.edu/SIN/WebLib/

Handout (MS Word)

PowerPoint Presentation

Share this:

  • Click to share on Facebook (Opens in new window)
  • Click to share on Twitter (Opens in new window)
  • Click to share on LinkedIn (Opens in new window)

Filed Under: CNI Spring 2006 Project Briefings, Digital Libraries
Tagged With: CNI2006spring, Project Briefings & Plenary Sessions

Last updated:  Wednesday, April 10th, 2013

 

Contact Us

21 Dupont Circle
Suite 800
Washington, DC, 20036
202.296.5098

Contact us
Copyright © 2023 CNI

  • Copyright Policy
  • Privacy Policy
  • Site map

Keeping up with CNI

CNI-ANNOUNCE is a low-volume electronic forum used for information about the activities and programs of CNI, and events and documents of interest to the CNI community.
Sign up

Follow CNI

  • View cni.org’s profile on Facebook
  • View cni_org’s profile on Twitter
  • LinkedIn
  • YouTube
  • Vimeo

A joint project