Social Documentary – a media artist installation in Istanbul imagining Linked Television in other ways

Social Documentary is an artistic installation to navigate in a collection of crowd-sourced videos which has been produced in collaboration with LinkedTV. Those videos are related to the events that happened at Gezi Park (Istanbul) in June 2013.

The visitors are invited to interact with the installation by choosing keywords through the manipulation of three cubes. Each cube represents a class of keywords (people, action, emotion). As the videos are cut into segments and tagged with the same keywords, the system will automatically choose the most relevant video according to the position of the cubes. A Kinect-based system allows us to track the two closest visitors’ faces and infer on their interest for the played video. The more the visitors are interested, the higher is the probability to display this video to the next visitors, like in recommendation system on video broadcast platforms. In this way, the installation evolves with its public. Some segments will emerge from the others as the “most popular”.

Social Documentary – a multimodal interactive TV installation from Linked Television on Vimeo.

This video presents the public exhibit which completed a one week workshop that took place in August 2014, at BüyükAyi atelier, Istanbul. This workshop has boosted up the physical realisation of the project. In one week, the interaction table has been rebuilt from a former one coming from a previous BüyükAyi project, all the equipment has been included in it and the software parts have been upgraded. For example, a lot of filtering has been added to avoid false marker detection or loss of people tracking in the Interest Tracker software. The public presentation brought about twenty people to the BüyükAyi place, most of them were from artists’ circles but we also welcomed some tourists intrigued by the event. In general, the installation intrigued the visitors and they spent a few minutes playing with it. Some of them came to us with ideas to improve it; the most recurrent idea was to take a better advantage of the second screen. We will work on this direction by incorporating multimedia content coming from LinkedTV enrichment services.

The artists would like to present this installation in other places in Istanbul, like art galleries or museums and in conferences on human-machine interaction but no date has been set yet. Nevertheless, this installation should be easy to reproduce and all the sources are freely available on github ( We hope other people will build their own and present other type of multimedia content.

For further information, feel free to contact us:

Fabien Grisard :

Tags: , ,

Leave a Comment

You must be logged in to post a comment.