The Muninn Project - Clojure

Retrieving Historical Photos of Film Stars using DBpedia

m4farrel — Thu, 29 Jan 2015 14:23:20 +0000

This is a follow-up to the previous blog post on retrieving historical art from the Rijksmuseum. Like historical art, film star photos inform us about politics and human culture at particular times throughout history - but there are so many film star photos that it becomes difficult to devote sufficient attention to each individual photo. We can use DBpedia to retrieve historical photos of film stars and display them in our statistically generated scenes of historical events. We'll display both film star photos and historical art that best fit the contexts of our statistically generated scenes - and use the context of the scenes that they are placed in to interpret them for their historical significance.

As an example, let’s look at film stars who were active around the time that Anne Frank was alive. We'll look at film stars who became active 1900-1945, even though Anne Frank was born in 1929. Anne Frank pasted photos of film stars on her wall who were active before she was born, such as Greta Garbo who became active in 1920. Here’s a SPARQL query to retrieve film stars who were active during that time period:

PREFIX wordnet: <http://www.w3.org/2006/03/wn/wn20/instances/>

SELECT DISTINCT ?actor ?thumb ?start {
{
    ?actor dbpprop:wordnet_type wordnet:synset-actor-noun-1 .
} UNION {
    ?actor dbpedia-owl:occupation dbpedia:Actor .
}
?actor dbpedia-owl:thumbnail ?thumb .
?actor dbpedia-owl:activeYearsStartYear ?start .
FILTER (?start > "1900-01-01"^^xsd:date)
FILTER (?start < "1945-01-01"^^xsd:date)
FILTER EXISTS {
    {
      ?film dbpedia-owl:starring ?actor .
    } UNION {
      ?film dbpprop:starring ?actor .
    }
}
}

We can execute that SPARQL query and retrieve the results by sending a GET request to DBpedia’s SPARQL endpoint:

http://dbpedia.org/sparql?default-graph-uri=http%3A%2F%2Fdbpedia.org&for...???

Note: we’d set the query parameter to be our SPARQL query.

Here's a sample of the results that are returned after executing the SPARQL query:

actor	thumb	start
http://dbpedia.org/resource/Amparo_Rivelles	http://commons.wikimedia.org/wiki/Special:FilePath/Amparo_Rivelles.jpg?width=300	"1942+02:00"^^<http://www.w3.org/2001/XMLSchema#gYear>
http://dbpedia.org/resource/Art_Acord	http://commons.wikimedia.org/wiki/Special:FilePath/Art_Acord_Kephren_1917.jpg?width=300	"1912+02:00"^^<http://www.w3.org/2001/XMLSchema#gYear>
http://dbpedia.org/resource/Bobby_Burns	http://commons.wikimedia.org/wiki/Special:FilePath/Cuckoo_Comedies_(1919)_-_Ad_1.jpg?width=300	"1908+02:00"^^<http://www.w3.org/2001/XMLSchema#gYear>
...	...	...

There are too many results to list in the table above. So, how many film stars were active during that time period?

> (film-stars/count 1900 1945)

1633

Let’s have a look at a sample of a film star photo that we would place in our statistically generated scenes of historical events:

> (film-stars/sample 1900 1945)

There are a couple of problems with retrieving film star photos using DBpedia.

One problem is that some photos of film stars are modern, and would look out of place in our exhibits. We could check if the photos are greyscale before displaying them, but this might not always be effective. For example, this photo of Philip Ober was taken in 1950, even though we only want film stars who were active between 1900 - 1945; we wouldn't want photos that were taken after the date when a particular historical scene that we are recreating takes place. There is no property that tells us when the photo of film star was taken.

Another problem is that there isn’t information available about when some film stars were active, e.g. Sonja Henie as mentioned in this article from the Anne Frank House; this means that they are not included in the result of our SPARQL query. It might be possible to use the release dates of the films that actors/actresses starred in as a proxy for information on when they were active.

We've made a Unity3d picture frame asset that retrieves a random film star photo from DBpedia and displays it when the scene that it is placed in is played. The asset is available in this repository. Stay tuned for more on statistically generating historical scenes!

Language English

Tags:

Film Stars

DBpedia

linked open data

Unity3d

Arcadia

Clojure

Racket

Retrieving Historical Art from the Rijksmuseum

m4farrel — Mon, 19 Jan 2015 14:02:18 +0000

The Muninn Project aims to statistically recreate scenes of historical events using Linked Open Data. Historical art is rich with information important to the study of politics and human culture - but there is so much historical art to examine that it becomes difficult to devote sufficient attention to each individual piece of art. So, how might we resolve this problem of "information overload"? If we statistically recreate scenes of historical events, and retrieve relevant art to display in them, we argue that analysis of the art becomes easier with the additional historical context provided by the scene. Let’s try this.

The Rijksmuseum is a national historical art museum located in Amsterdam. They provide a public API for retrieving art objects in their collection, which you can read more about here. There’s close to one million art objects made available by the Rijksmuseum. We can narrow down our search for historical art: we’ll try to sample only the art that best fits the context of our recreated historical scenes.

As an example, we’ll retrieve art from the Rijksmuseum produced between 1845 and 1945 to display in a scene of a historical event that took place during that time period. We could send a GET request with the following URL to retrieve the first piece of art that satisfies this constraint:

https://www.rijksmuseum.nl/api/en/collection?key=WfTGhlrw&q=&yearfrom=18...

Note that: we’ve also restricted the type of art that we retrieve; we’re only retrieving prints, even though the Rijksmuseum also provides photos. We’ll begin to look at historical photos to display in our scenes in a future blog post. The Rijksmuseum may or may not be the best source for photos, though they certainly provide very high quality images of prints that are important to Dutch history. Calls to the Rijksmuseum API return a JSON object, listing the titles of art that match our search parameters, and links to images of them.

Let’s look at the art objects that match our search parameters. You might be wondering, how many of the Rijkmuseum’s art objects were produced between these years?

> (rijksmuseum/count 1845 1945)

7622

There is a fair volume of historical art to examine between those years. So, what might a sample of that art look like?

> (rijksmuseum/sample 1845 1945)

This sample of historical art is of Japanese origin. Most of the Rijkmuseum art is not of East Asian origin, though they keep a small collection. We might wish to restrict the art we sample by the geographical location that our historical scenes take place in. This is possible with the Rijksmuseum API, but only approximately, by modern or historic country.

We’ve been playing with Unity3d, a game engine; we’ve made a picture frame asset that retrieves and displays a sample of historical art when the scene that it is placed in is played. A repository containing that asset can be found here. The script that retrieves art from the Rijksmuseum was written in Clojure, with the new Arcadia plugin; we hope to explore how the functional programming paradigm might help us further progress on the Muninn project.

We hope to retrieve art from the Rijksmuseum and place it in our statistically recreated scenes of historical events. The Unity3d asset that we have created facilitates this: we need to make more progress on statistically building the structure of our scenes, but we are now able to populate picture frames with art in our scenes once we have determined where they should be placed. It would be nice to display a description of the art to the viewer, to aid the analysis of the art in the context of the scene. Stay tuned for more information on this endeavour!

Language English

Tags:

Rijksmuseum

Historical Art

Information Retrieval