Jodi Schneider pointed out to me in an email that my previous post about the top 100 hosts referenced in wikipedia may have been slightly off balance since it counted all pages on wikipedia (talk pages, files, etc), and was not limited to only links in articles. The indicator for her was the high ranking of www.google.com, which seemed odd to her in the article space.

So I downloaded the enwiki-latest-page.sql.gz, loaded it in, and then joined on it in my query to come up with a new list. Jodi was right, itโ€™s a lot more interesting:

This removed a lot of the interwiki links between the English wikipedia and other language wikipedias (which would be interesting to look at in their own right). It also removed administrative links to things like www.dnsstuff.com. Also interesting is that it removed www.facebook.com from the list, which probably were linked to from user profile pages? The neat thing is it introduced new sites into the top 100 like the following:

adsabs.harvard.edu
bioguide.congress.gov
cfa-www.harvard.edu
eclipse.gsfc.nasa.gov
openjurist.org
select.nytimes.com
ssd.jpl.nasa.gov
worldcat.org
www1.arbitron.com
www.animenewsnetwork.com
www.cbc.ca
www.cricinfo.com
www.cricketarchive.com
www.discogs.com
www.expasy.org
www.fifa.com
www.gutenberg.org
www.history.navy.mil
www.hockeydb.com
www.imagesofengland.org.uk
www.independent.co.uk
www.jstor.org
www.leighrayment.com
www.mtv.com
www.nfl.com
www.nhm.ac.uk
www.nps.gov
www.racingpost.com
www.radio-locator.com
www.reuters.com
www.rollingstone.com
www.rsssf.com
www.soccerbase.com
www.usatoday.com
www.variety.com

We can see a lot more pop culture media present: newspapers, magazines, sporting information. Also we can see research oriented websites like worldcat.org, ssd.jpl.nasa.gov, adsabs.harvard.edu make it into the top 100.

I work for the US federal government so I was interested to look at what .gov domains were in the top 100:

hostname links
www.ncbi.nlm.nih.gov 419816
www.pubmedcentral.nih.gov 62134
geonames.usgs.gov 57423
factfinder.census.gov 48530
www.census.gov 33018
www.nr.nps.gov 25962
www.fcc.gov 25941
ssd.jpl.nasa.gov 20178
eclipse.gsfc.nasa.gov 20063
bioguide.congress.gov 18880
www.nlm.nih.gov 15115
www.nps.gov 12196

Which points to the importance of federal biomedical, geospatial, scientific, demographic and biographical information to wikipedians. It would be interesting to take a look at higher education institutions at some point. Doing these one off reports is giving me some ideas about what linkypedia could turn into. Thanks Jodi.