The future of television? @linkedtv prepares TV for seamless integration with the Web to the benefit of broadcasters and viewers.

As the EU funded R&D project LinkedTV began its work in October 2011, bringing together 12 European research and industry experts from 8 countries, its stated goal was the “seamless interlinking of TV and the Web”. Convergence of TV and the Web was at its beginning and the visionary group, led scientifically by Dr Lyndon Nixon, now Assistant Professor at the New Media Technology Group in MODUL University Vienna, foresaw a near term future where watching TV or browsing Web content would become essentially the same experience, with consumers moving between TV and Web content as easily as Web users were following hyperlinks to browse different Web pages back then. TV viewing as a passive experience would be perfectly complemented by the active browsing of additional information and content on the Web that it could trigger.

The group could not have anticipated how quickly and significantly technology in the market would shift in this direction, with increasing Internet bandwidth and device capabilities making TV/video streaming over Internet available to all, broadcasters launching TVoD and Catch-up TV services to their viewers and SmartTV sales meaning TV viewing in the living room now also had an Internet backchannel available. The utopian world of merged TV and Web seemed close; however TV programme viewers weren’t getting their information needs answered through Web-connected apps on their TVs, instead of having full screen Facebook on their TV they were looking for information on things in the TV shows, background to the news story, more examples of the art visible in the background of the scene – and are there paintings by that artist in the nearby museum?

Today’s TV viewers are multitaskers – they have a laptop, tablet or smartphone to hand while consuming TV on the big screen, and they turn to that second device to use the Web for additional information and content. However, companion applications are not well synchronised to this search – largely, their “knowledge” of what’s on is limited to identifying the programme and linking to social Web conversation around it or a list of cast members. What they don’t know, and today can’t know, is what is INSIDE the TV programme at the time the user is viewing it and could be interested in. So viewer’s real needs for Web and TV convergence are still not answered today – how to find out more about something you see in a TV programme if you don’t know what it’s called, for example?

LinkedTV has been working on the solution. By bringing together R&D experts across Europe who could provide the right tools to enable the envisioned interlinking of TV and the Web, we have produced a number of demonstrators where the experience of watching news – from the German broadcaster RBB – or a cultural heritage programme – the Dutch version of Antiques Roadshow from AVROTROS – is enhanced by additional information and content at the viewers fingertips – whether through remote control actions on a HbbTV-supporting SmartTV or through a Web application on their tablet or laptop. This information goes far beyond programme description or cast details like today’s offers – LinkedTV enables linking to information about concepts like persons, places and organisations inside the news story, links to background or related stories, or even browsing similar art objects in European collections while watching the discussion about another art object on screen.

“Years of collaboration, knowledge and technology transfer, implementation, prototyping and evaluation have brought us to this point, where we can offer an integrated set of services and software to content owners who would like to enrich their video with links to related information”, summarizes Dr Nixon, who initiated the LinkedTV idea following his PhD on multimedia enrichment in 2007 and acted as scientific coordinator of the LinkedTV project work, which finished in March 2015. “Trials with RBB and AVROTROS viewers have shown they appreciate the ability to easily access further information about what they see in the TV programme when they want. Viewers result in being more satisfied and engaged by the content. The broadcasters also stand to gain by offering LinkedTV enrichments as an added value service alongside selected content, as it can attract both new viewers and retain existing viewers, and promote their archived and long tail content with a new viewer experience.”

LinkedTV results – software, services, demos and reports – are published publicly at

LinkedTV products and demonstrators for media organisations are presented at

LinkedCulture demonstrator:

LinkedNews demonstrator:

Technology consultancy and proof of concept creation are possible. Organisations interested in LinkedTV enrichments for their content can contact Modul Technology GmbH c/o Lyndon Nixon.

Posted in Uncategorized by No Comments

@CERTHellas announces new online video analysis service with interactive user interface

We would like to announce the availability of a new on-line video analysis service with interactive user interface developed by LinkedTV partner CERTH-ITI. This is a web-based service that lets you upload videos in various formats, performs visual analysis algorithms on the videos (shot segmentation, scene segmentation and visual concept detection), and allows you to navigate through the analysis results with the help of an interactive user interface.

The service supports videos in mp4, webm, avi, mov, wmv, ogv, mpg, flv, and mkv format. A few hundred visual concept detectors are evaluated for each video shot. The complete service runs at high speed (i.e., it is several times faster than real-time video processing). The results user interface allows viewing the video structure (shots, scenes), viewing the concept detection results for each shot, and searching by concept within the set of detected shots.

You can access our web service and try how it works for your own videos at:


Posted in Uncategorized by No Comments

LinkedTV @IBCShow 2015 discover linking television to the Web at Stand 8.F03. FREE entry into IBC with our code:

LinkedTV is pleased to participate as part of the 2nd Screen CC (Content Convergence) mini-cluster in this year’s IBC Exhibition.

The mini-cluster is a collaborative initiative of EU-funded research projects focused on developing innovative solutions for production, delivery, consumption and ecosystems for monetisation of 2nd Screen content. It is composed of 4 leading EU projects with the combined investment of more than 20M €, and the participation of leading business stakeholders and research institutions in the Media Area, including the BBC, Deutsche Welle, Fraunhofer IAIS, Huawei, RAI, RBB, Surrey University, TPVision and NEC, to name just a few.

Our customer code will allow you to register for the IBC Exhibition for FREE, even though early bird registration has closed. With your registration pass, you will also receive a travel pass for the show, which you can pick up from Information Points onsite. Just
register through using the code 20755.

You can then locate us in the Future Zone (Hall 8) at booth 8.F03 and learn more about LinkedTV.

Find below a description of the demonstrators of the different projects:

  • SAM ( SAM will be demonstrating all the running prototypes developed in the 2nd year of the project. Content from SAM partners will depict the novel SAM proposal for 2nd Screen media related content production, syndication, monetisation and social consumption.
  • LinkedTV ( will be demonstrating at IBC the first outcomes of its exploitation stages after the finalisation of the project. It will include all the final demonstrators on multimedia analysis for automatic annotation of TV programs.
  • MediaScape ( MediaScape will be demonstrating the seamless discovery, authentication, synchronisation and adaptation of networked media content in different devices. These devices include HbbTV devices (such us TV sets of set-top boxes), browser based (HTML5) devices such PCs, Tablets, Smart Phones etc. and some other devices with more limited capabilities like radio devices.
  • Bridget ( Bridget will be demonstrating running prototypes of the 2nd screen authoring tool and the content player, employing the BRIDGET flexible architecture based on the forthcoming MPEG MLAF format for Media-linking. We will also demonstrate advanced tools for content analysis, search and 3D augmentation to support efficient and low-cost production of exciting content.

See you in Amsterdam!!!

Original announcement at the mini-cluster page.

Posted in Uncategorized by No Comments

Final project report online: summary of ALL scientific and technological results of LinkedTV

42 months of R&D in an international EU-funded project covering media analysis, annotation, linking, personalisation and UIs, a software architecture for all of this on server and client side, and three distinct scenarios covering the domains of News, Cultural Heritage and Media Arts…. how to explain the results of all of this?

LinkedTV is pleased to publish publicly online its final project report which covers the technical outcomes of all the project workpackages covering all the scientific research areas mentioned above. In summarised form the reader can find out the main innovations and outputs in each topic achieved by the project partners, and of course to get at the technology itself, one can check out individual software and services (much open source) or the LinkedTV Showcase for enquiring about a commercial solution.

Posted in Uncategorized by No Comments

LinkedTV #mediaanalysis service @CERTHellas now outputs #MPEG7 #AVDP metadata

Given the increasing business interest in the LinkedTV technologies and the need to conform to industry standards, we are pleased to announce on behalf of the media analysis partner CERTH-ITI that the LinkedTV media analysis service, which has in the project output the results of all individual media analysis algorithms* in an aggregated format known as Exmaralda (EXB), will now additionally export analysis results in the EBU/ISO MPEG7 AVDP (Audio Visual Description Profile) result format. The LinkedTV Platform now also stores media analysis results in this format. More information about the MPEG7 AVDP format:

* The LinkedTV aggregated media analysis service, available for external use, covers shot and scene segmentation, concept detection, object re-detection, keyword extraction, ASR and face detection, according to client configuration.

LinkedTVs “Social Documentary” interactive video exhibit is @mundaneumasbl part of @MONS2015

The Mons, Belgium based museum Mundaneum re-opened this summer 2015 with a new exhibition “Mapping Knowledge: Understanding the World through Data” as part of the European Capital of Culture 2015 events. LinkedTV is pleased to be present in this exhibition through the “Mundaneum Documentary”, an adapted version of the projects ‘Social Documentary’ multimodal interactive video exhibit. The media art installation allows visitors to explore Belgian video material along different facets through physical interaction with the tabletop interface. It leads us to rethink how we consume and interact with audiovisual content outside of traditional television and streaming models.

Mundaneum Documentary can be visited this year at the Mundaneum, Mons, Belgium. 

News item in French (Numediart)

Extended version of aggregated media analysis service – adding scene segmentation for ANY video content

We are pleased to announce an extended version of the LinkedTV tv2avd service (a.k.a. “Aggregated multimodal media analysis service”). This new version integrates software from our partner CERTH for video scene segmentation analysis which is applicable in any type of content, contrary to the developed chapter segmentation techniques which are strictly adapted to the analysis requirements of the LinkedTV scenarios (since they were based on algorithms that rely on the detection/re-detection of specific visual cues that appear in the AVROTROS and RBB content only).

In other words, the updated/extended version of the service contains the tools for providing a higher level temporal segmentation (than shots) of any video other than the material used in the project scenarios, since now the LinkedTV project is finished and new clients may wish to analyze other types of content (e.g. for demonstration purposes).

See a video demo explaining the existing functionalities.

Full list of LinkedTV Tools and Services published! AV analysis, annotation, enrichment, personalisation and enriched TV playout!

With the LinkedTV project over, our tools and services – many of which are open source – can also be applied in other new media and data contexts. LinkedTV partners will be happy to support you in tool set-up or access, according to the respective licenses and terms of use. Discover in our list:

  • LinkedTV Platform – The full server-side solution to analysing, annotating and enriching your media content.
  • Media Analysis – Online services for analysing media visually, audially or in terms of associated text.
  • Media Annotation – Services to annotate media resources with concepts from controlled vocabularies.
  • Media Enrichment – Tools and services that enable media to be linked on the basis of its annotation to related content from the Web.
  • Personalisation – A complete framework for capturing user interests, modelling them and using the model to filter or rank concept and content suggestions.
  • Playout – Tools for building LinkedTV applications and their user interfaces.
Posted in News by No Comments

LinkedTV video analysis innovations to be presented by @CERTHellas at @ICMR2015 @ICME2015 @ICIP2015

Don’t miss presentations of the innovations in video analysis achieved by our partner CERTH-ITI during the LinkedTV project!

Tags: ,
Posted in Events News by No Comments

Linked Media @WWWfirenze: workshop report – all slides and links now online! #lime2015 #www2015 #linkeddata #linkedmedia

Last Monday we were pleased to hold the 3rd international workshop on Linked Media at the WWW 2015 conference. This is the second time LiME took place at a WWW conference and ca. 25 people attended to hear presentations, see demos and join the discussion on annotating media with Linked Data and using those annotations for media retrieval, mixing and applications.

It was encouraging to see the uptake of what we have called the Linked Media principles in the film and media industry through our keynote speaker Dr Harald Sack, whose D-Werft project is working on “Linked Production Data” for the media value chain. Subsequent talks addressed research and development in parts of the Linked Media workflow – media analysis, annotation, retrieval and linking. We heard about a video portal where video material has been analysed and semantically annotated, leading to improved and more granular search and browsing. We learnt about an initiative to publish audio metadata as Linked Data. Chair Dr Lyndon Nixon closed by showing how Linked Media can be supported by tools from the LinkedTV project to annotate video and expose that metadata via an API and SPARQL endpoint.

The consensus at the end of the workshop was that this initiative needs to continue, particularly as there are no other scientific events so focused on the topics of semantic multimedia description and Linked Data. We are grateful for the support of all presenters and participants and look forward to the next Linked Media workshop. Follow @linkedtv to stay informed!

All workshop presentations as well as complementary links are published at the LiME workshop webpage.