inkdroid › crawling bibliographic data

Skip to content

Tag Archives: robots

crawling bibliographic data

Thursday, January 22, 2009

Today’s Guardian article Why you can’t find a library book in your search engine prompted me to look at Worldcat’s robots.txt file for the first time. Part of the beauty of the web is that it’s an open information space where anyone (people and robots) can start with a single URL and follow their nose [...]

Filed in html, libraries, web, worldcat | Also tagged books, crawling, google, http, indexing, libraries, oclc | Comments (2)

Search
What I'm Doing...
- viaf.org has an opensearch description (yay) but they don't allow http clients to auto-discover it (boo) 2 hrs ago
- @gkob thanks for writing about uberblic's #wikipedia data extraction and real time update mechanisms http://bit.ly/ddJCD6 3 hrs ago
- @adrianstevenson funnily enough I was reading about URI Sets this AM on the train: http://bit.ly/cqAKsv ; an important effort imho 6 hrs ago
- @adrianstevenson @azaroth42 i wonder if talking about a URI Set saves some people from having to say "No, not that kind of Graph!!" :-) in reply to adrianstevenson 6 hrs ago
- i *think* i successfully hooked @mjgiarlo into subscribing to last.fm with eyecandy from playground.last.fm e.g. http://bit.ly/bA545z 9 hrs ago
- RT @sallamar: Smelling the fresh copy of the RESTful Web Services Cookbook http://bit.ly/dCMLEL ~ smellin my PDF copy w/ print on the way 1 day ago
- I wonder if Google's (new?) bike directions come with an enhanced life insurance policy http://bit.ly/ar88hu 1 day ago
- @dchud George W Bush in reply to dchud 1 day ago
- learned that there is a bibtex ontology http://bit.ly/cC7Bth #ldow2010 reviewing FTW! 2 days ago
- nice! @abdelazer created issue tickets for outstanding #openpub issues http://bit.ly/cb1jss 2 days ago
- heh, I forgot about tinythread http://a.tinythread.com/I4MljW0lrd 3 days ago
- @jwax55 heheh, yeah I guess that about covers it ; if it weren't for Reid I might not be able to add "husband" and "dad" :-) #nojoke in reply to jwax55 3 days ago
- @jwax55 wow, it is a small world ... Reid is impossible to summarize in 140 characters, so I'll just say awesome :-) in reply to jwax55 3 days ago
- enjoying four tet's latest a lot more than his previous http://bit.ly/b1myUb 3 days ago
- @repetej thanks, I have searched around fruitlessly more than once in the past in reply to repetej 3 days ago
- @repetej what's your username on last.fm already? :-) in reply to repetej 3 days ago
- kinda weird that Kesa was singing http://bit.ly/cIQUsH Saturday afternoon when Linkous was leaving http://bit.ly/cf6tzr 3 days ago
- @dchud endorsed your idea of trying a virtual #cutesig meeting first 3 days ago
- @dchud i wouldn't mind a virtual meeting earlier, and if things work out plan for f2f meeting in reply to dchud 3 days ago
- @jjtuttle what did you say? in reply to jjtuttle 3 days ago
- More updates...
Recent Bookmarks
inkdroid
Subscriber
- Logos
  Atlas Sound
  3h,7m ago
- Washington School
  Atlas Sound
  3h,10m ago
- Kid Klimax
  Atlas Sound
  3h,13m ago
- My Halo
  Atlas Sound
  3h,16m ago
- Quick Canal (w/ Laetitia Sadier)
  Atlas Sound
  3h,23m ago
- Shelia
  Atlas Sound
  3h,29m ago
- Attic Lights
  Atlas Sound
  3h,32m ago
- Criminals
  Atlas Sound
  3h,36m ago
- Walkabout (w/ Noah Lennox)
  Atlas Sound
  3h,39m ago
- An Orchid
  Atlas Sound
  3h,43m ago
Photos

More Photos
LibraryThing
Tags

atom bagit bibliography books cataloging code4lib conferences data dublincore google harvesting html http lc lcsh libraries linkeddata loc marc metadata microformats newspapers oai-ore oai-pmh oclc ocr owl podcasts python rdf rdfa repositories rest search semanticweb semweb skos sparql standards uri url w3c web worldcat xml
Pages
Archives