Test Bed Taxonomy for Crawler (open access)

Test Bed Taxonomy for Crawler

This report contains an annotated taxonomy of challenges that web crawler may encounter online.
Date: July 2004
Creator: Boyko, Andrew; Anderson, Martha & Jones, Gina
System: The UNT Digital Library
Web Harvesting Survey (open access)

Web Harvesting Survey

This report contains a survey of the conditions found on web sites that influence the harvesting of content and the quality of an archival crawl.
Date: July 2004
Creator: Marill, Jennifer; Boyko, Andrew; Ashenfelder, Michael & Jones, Gina
System: The UNT Digital Library