LOD Laundromat

Open for Business

Wouter Beek (wouter@triply.cc), 2016-05-10


Hi SemWeb people, The Linked Movie Database SPARQL endpoint has ‘throttling’ preventing to get exhaustive results.

2016-03-11, semantic-web@w3.org

Linked Data Fragments

Luca answers:

I have a Linked Data Fragments version running here. I can't seem to extract the dump, but you can crawl it all you want since LDFs have no throttling ;)

Linked Data Fragments

Reply to Luca:

Your server does not include CORS...


Jean-Claude answers:

There is also an archive here from 2009: http://www.cs.toronto.edu/~oktie/linkedmdb/


Reply to Jean-Claude:

Thanks, exactly what I was looking for!

A person asks how to access a SW DB...

  • SPARQL throttles
  • LDF is misconfigured
  • Datadump does the job

How much time was there between the possibility of the WWW and the WWW?

  • 1963, Hypertext, Ted Nelson
  • 1968, Videoconferencing, Douglas Engelbracht
  • 1969, Large-scale networks, ARPANET
  • 1991, The first Web site goes online, TBL

How much time will there be between the possibility of the SW and the SW?

Why does not everybody use the SW all day long today?

Metcalfe's Law

The value of a network is proportional to the square of the number of connected nodes

So... how many connected nodes does the SW have?

Data growth is exponential

SW growth is linear


[Why1] Allocative Efficiency

What the consumer is willing to pay should equal the marginal cost of production

[Why2] Multi-tenancy

Difficult in a decentralized deployment

SW layer cake


  • Metcalfe's Law
  • Allocative Efficiency
  • Multi-tenancy

LOD Laundromat

Beek & Rietveld & Bazoobandi & Wielemaker & Schlobach “LOD laundromat: A Uniform Way of Publishing Other People’s Dirty Data” ISWC 2014
Rietveld & Verborgh & Beek & Vander Sande & Schlobach, “Linked Data-as-a-Service: The Semantic Web Redeployed” ESWC 2015

LOD Laundromat Layer Cake

Rietveld & Beek & Schlobach “LOD Lab: Experiments at LOD Scale” International Semantic Web Conference 2015 (Best Paper Award)

SW innovation is mainly technical

< ... >


{ ... }