Defining Web pages, Web sites and Web capturesPosted on October 23, 2016 by Vinay Goel
The Internet Archive has been archiving the web for 20 years and has preserved billions of webpages from millions of websites. These webpages are often made up of, and link to, many images, videos, style sheets, scripts and other web objects. Over the years, the Archive has saved over 510 billion such time-stamped web objects, which we term web captures.
We define a webpage as a valid web capture that is an HTML document, a plain text document, or a PDF.
A domain on the web is an owned section of the internet namespace, such as google.com or archive.org or bbc.co.uk. A host on the web is identified by a fully qualified domain name or FQDN that specifies its exact location in the tree hierarchy of the Domain Name System. The FQDN consists of the following parts: hostname and domain name. As an example, in case of the host blog.archive.org, its hostname is blog and the host is located within the domain archive.org.
We define a website to be a host that has served webpages and has at least one incoming link from a webpage belonging to a different domain.
As of today, the Internet Archive officially holds 273 billion webpages from over 361 million websites, taking up 15 petabytes of storage.
About Vinay GoelWeb Search & Data Mining Lead, Senior Data Engineer View all posts by Vinay Goel → This entry was posted in Announcements, News, Wayback Machine - Web Archive. Bookmark the permalink. ← Authors Alliance and Internet Archive Team Up to Make Books Available SHOWCASE: the GIF Collider at Berkeley Art Museum →
4 Responses to Defining Web pages, Web sites and Web captures
- Mihai Pintilie says:
October 24, 2016 at 11:09 am
Good job guys! Interesting facts about archiving!
Comments are closed.
- آهنگ جدید on The Wayback Machine: Fighting Digital Extinction in New Ways
- Ealina Jackson on The Wayback Machine: Fighting Digital Extinction in New Ways
- SD on The Wayback Machine: Fighting Digital Extinction in New Ways
- موزیک on The Wayback Machine: Fighting Digital Extinction in New Ways
- Anonymous on The Wayback Machine: Fighting Digital Extinction in New Ways
- Archive Version 2
- Audio Archive
- Books Archive
- Cool items
- Education Archive
- Image Archive
- Lending Books
- Live Music Archive
- Movie Archive
- Open Library
- Past Event
- Software Archive
- Television Archive
- Upcoming Event
- Video Archive
- Wayback Machine – Web Archive
- Web & Data Services