Mapping the Web Archive Landscape: A Data-Driven Look at Market Share
The web is ephemeral by design. Pages vanish, domains expire, content shifts or gets rewritten. Yet for researchers, journalists, developers, and everyday users, the ability to access historical versions of the web is essential.
But one question has remained surprisingly underexplored: which web archives are actually being used at scale?
To answer that, we turned to one of the largest structured knowledge repositories on the internet—Wikipedia—and conducted a large-scale analysis of how it references archived content.
How We Built the Dataset
To get a meaningful picture of archive usage, we needed a dataset that was:
- Massive
- Diverse in subject matter
- Curated and moderated
- Rich in external references
Wikipedia checks all those boxes.
We analyzed 187,817,169 external links extracted from a full Wikipedia dump. This includes links across articles, references, citations, and templates—essentially every outbound URL that Wikipedia points to.
From there, we:
- Parsed all external URLs from the dump
- Identified archived links (links pointing to archive services rather than live pages)
- Classified archive providers by domain
- Deduplicated and normalized links
- Aggregated counts to estimate relative usage
This gives us a large-scale, real-world proxy for archive adoption.
The Raw Numbers
From our classification, we observed the following distribution of archived links:
[('archive.org', 18054220),('webcitation.org', 186156),('ghostarchive.org', 118830),('Other Archives', 51987),('megalodon.jp', 2597),('perma.cc', 393)]
To better understand relative dominance, we converted these into market share percentages:
- archive.org — 96.75%
- webcite — 1.00%
- ghostarchive.org — 0.64%
- Other archives — 0.28%
- megalodon.jp — 0.01%
- perma.cc — 0.00%
What Counts as “Market Share”?
Here, “market share” reflects:
The proportion of archived links pointing to each archive provider within Wikipedia.
This is not revenue or user count—it’s real usage embedded in citations.
Key Observations
1. Overwhelming Dominance by archive.org
At 96.75%, Internet Archive’s archive.org is not just the leader—it effectively is the archive layer of Wikipedia.
This dominance suggests:
- Deep integration into editorial workflows
- Strong trust in long-term availability
- Broad historical coverage
In practical terms, when a Wikipedia editor archives a link, it is almost always via archive.org.
2. A Small but Meaningful Secondary Tier
A handful of alternatives appear with much smaller—but still notable—shares:
- webcite (1.00%) — historically important, though now largely dormant
- ghostarchive.org (0.64%) — focused on preserving dynamic or media-heavy content
These services serve specific niches, rather than competing head-on.
3. The Long Tail Is Extremely Thin
Everything outside the major players—including regional tools like megalodon.jp (0.01%)—barely registers.
Even perma.cc, widely used in academic circles, rounds to 0.00% in this dataset.
This reinforces a striking reality:
The archive ecosystem may be diverse—but actual usage is highly concentrated.
4. “Other Archives” Are Fragmented
Although the raw count for “Other archives” appears large, its normalized share is only 0.28%.
This category represents a fragmented mix of minor or one-off services, none of which individually achieve meaningful scale.
Why Wikipedia Reflects the Real World
Wikipedia’s editorial culture prioritizes:
- Verifiability
- Stability
- Long-term access
When a source is at risk of disappearing, editors proactively archive it. Over time, this creates a high-signal dataset of preservation behavior.
In essence:
Wikipedia is where the web goes to defend itself against decay.
What This Tells Us About the Web
Centralization Has Won (For Now)
Despite the existence of many archive services, one provider dominates overwhelmingly. This creates efficiency—but also a single point of dependency.
Alternatives Still Matter
Even with small shares, secondary archives:
- Provide redundancy
- Handle edge cases (e.g., blocked sites, dynamic content)
- Act as fallback options when primary services fail
Link Rot Is Actively Managed
The presence of millions of archived links shows that:
- Editors are constantly fighting link decay
- Archiving is embedded in knowledge preservation workflows
- The web’s memory is actively maintained—not passively stored
Limitations
- Wikipedia editorial practices may bias archive selection
- Some archives are underrepresented outside this ecosystem
- This reflects citation usage—not total archive traffic
Still, with nearly 188 million links analyzed, the scale makes the conclusions hard to ignore.
Final Thought
The web feels permanent—but beneath the surface, it’s constantly eroding.
This analysis shows that preservation isn’t evenly distributed. Instead, it rests—overwhelmingly—on a single pillar, supported by a thin layer of alternatives.
Understanding that imbalance is the first step toward building a more resilient memory of the internet.