top hosts referenced in wikipedia (part 2)
Jodi Schneider pointed out to me in an email that my previous post about the top 100 hosts referenced in wikipedia may have been slightly off balance since it counted all pages on wikipedia (talk pages, files, etc), and was not limited to only links in articles. The indicator for her was the high ranking of www.google.com, which seemed odd to her in the article space.
So I downloaded the enwiki-latest-page.sql.gz, loaded it in, and then joined on it in my query to come up with a new list. Jodi was right, it’s a lot more interesting:
This removed a lot of the interwiki links between the English wikipedia and other language wikipedias (which would be interesting to look at in their own right). It also removed administrative links to things like www.dnsstuff.com. Also interesting is that it removed www.facebook.com from the list, which probably were linked to from user profile pages? The neat thing is it introduced new sites into the top 100 like the following:
adsabs.harvard.edu |
bioguide.congress.gov |
cfa-www.harvard.edu |
eclipse.gsfc.nasa.gov |
openjurist.org |
select.nytimes.com |
ssd.jpl.nasa.gov |
worldcat.org |
www1.arbitron.com |
www.animenewsnetwork.com |
www.cbc.ca |
www.cricinfo.com |
www.cricketarchive.com |
www.discogs.com |
www.expasy.org |
www.fifa.com |
www.gutenberg.org |
www.history.navy.mil |
www.hockeydb.com |
www.imagesofengland.org.uk |
www.independent.co.uk |
www.jstor.org |
www.leighrayment.com |
www.mtv.com |
www.nfl.com |
www.nhm.ac.uk |
www.nps.gov |
www.racingpost.com |
www.radio-locator.com |
www.reuters.com |
www.rollingstone.com |
www.rsssf.com |
www.soccerbase.com |
www.usatoday.com |
www.variety.com |
We can see a lot more pop culture media present: newspapers, magazines, sporting information. Also we can see research oriented websites like worldcat.org, ssd.jpl.nasa.gov, adsabs.harvard.edu make it into the top 100.
I work for the US federal government so I was interested to look at what .gov domains were in the top 100:
hostname | links |
---|---|
www.ncbi.nlm.nih.gov | 419816 |
www.pubmedcentral.nih.gov | 62134 |
geonames.usgs.gov | 57423 |
factfinder.census.gov | 48530 |
www.census.gov | 33018 |
www.nr.nps.gov | 25962 |
www.fcc.gov | 25941 |
ssd.jpl.nasa.gov | 20178 |
eclipse.gsfc.nasa.gov | 20063 |
bioguide.congress.gov | 18880 |
www.nlm.nih.gov | 15115 |
www.nps.gov | 12196 |
Which points to the importance of federal biomedical, geospatial, scientific, demographic and biographical information to wikipedians. It would be interesting to take a look at higher education institutions at some point. Doing these one off reports is giving me some ideas about what linkypedia could turn into. Thanks Jodi.