A Semantic Web shoebox – annotating photos with RSS and RDF

January 31st, 2003  |  Published in photos, rdf, wordnet, xml  |  7 Comments

I’ve had a proposal for a paper on RDF and annotating photos accepted for XML Europe 2003. Yay! Here’s what I submitted:


RSS 1.0 (RDF Site Summary) is a well-known XML format commonly used for syndicating news headlines. By design it is an extensible format in which metadata expressed using any RDF vocabulary can be linked to its component items, while still maintaining compatibility with applications such as newsreaders that may be unaware of such vocabularies. This paper will discuss some interesting applications that can be built with RSS as a base. The annotation of collections of photographs is used as a case study.

Using an RDF representation of Wordnet, the lexical database of English, we attach keywords to photographs to indicate what they objects they depict. With simple inference logic, we create improved search engines over this data. For example, using the hypernym information in Wordnet to extrapolate from keywords, a search for buildings can find hotels, churches, houses and other related photographs. We can automatically build a Yahoo-like hierarchical web site of photographs organised by the meaning of their keywords.

Using the Friend Of A Friend (FOAF) vocabulary, we can record which photographs show particular people. Applications can then display related information with the photograph by using information gathered by spidering the existing network of FOAF information on the web.

Dynamically-built RSS channels are an ideal format for expressing search results; hence people who are interested could use newsreaders to subscribe to new pictures of any Wordnet noun, particular person or other metadeta criteria. This RSS is easily turned into web pages using templating tools. A Blogger-like front page can be built by building an RSS ‘meta-channel’ summary of the 10 newest photo collections.

Processing toolkits for RDF are available in many languages, and RDF’s natural integration with the web’s URI system makes it easy to build applications in a loosely-coupled style. Tools for this project built using the Redland API in Perl and the Jena toolkit in Java easily interoperate, using the RDF output of one as the input of another. New applications can be built by others using any language or environment with RDF and HTTP support (even Mozilla), without needing to be granted any special database access or other privileges.

Update: slides from this and other talks are available.

Responses

  1. stuck-on-mobile-e-com ;-) says:

    June 18th, 2003 at 5:29 pm (#)

    rdf with photo

    mark starts to annotate his poto gallery with rdf: rdf photo gallery [dive into mark] cool, i looked also into it last year but had neither a web site nor a (working) digital cam but with the first galeries now online, just need a real biig time slot ;…

  2. Andrew Grumet's Weblog says:

    June 20th, 2003 at 5:50 pm (#)

    More programmer nerdism

    hackdiary: “Using an RDF representation of Wordnet, the lexical database of English, we attach keywords to photographs to indicate what they objects they depict. With simple inference logic, we create improved search engines over this data. For example…

  3. Incessant Ramblings says:

    June 26th, 2003 at 6:21 am (#)

    something useful that uses the buzzword “semantic”

    More programmer nerdism hackdiary: annotating photos with RSS and RDF: “Using an RDF representation of Wordnet, the lexical database of English, we attach keywords to…

  4. Snapping Links II (The Revenge) says:

    November 5th, 2003 at 12:35 am (#)

    two for me, one for Kat

    sorting tables, annotating photos, and the nature of the universe.

  5. Lost Boy says:

    January 8th, 2004 at 1:59 pm (#)

    Lazy Photo Annotation

    I was taken to task by my mother over Xmas. She’d been browsing my website during her lunch hour and

  6. Lost Boy says:

    January 8th, 2004 at 2:06 pm (#)

    Lazy Photo Annotation

    I was taken to task by my mother over Xmas. She’d been browsing my website during her lunch hour and

  7. phil.wilson says:

    February 11th, 2004 at 10:49 pm (#)

    JAlbum RDF skin

    JAlbum is what I used to make my online gallery of the photos I took when in Rome, and it uses JSP-based skins to generate the index and individual pages.