The future of television? @linkedtv prepares TV for seamless integration with the Web to the benefit of broadcasters and viewers.

As the EU funded R&D project LinkedTV began its work in October 2011, bringing together 12 European research and industry experts from 8 countries, its stated goal was the “seamless interlinking of TV and the Web”. Convergence of TV and the Web was at its beginning and the visionary group, led scientifically by Dr Lyndon Nixon, now Assistant Professor at the New Media Technology Group in MODUL University Vienna, foresaw a near term future where watching TV or browsing Web content would become essentially the same experience, with consumers moving between TV and Web content as easily as Web users were following hyperlinks to browse different Web pages back then. TV viewing as a passive experience would be perfectly complemented by the active browsing of additional information and content on the Web that it could trigger.

The group could not have anticipated how quickly and significantly technology in the market would shift in this direction, with increasing Internet bandwidth and device capabilities making TV/video streaming over Internet available to all, broadcasters launching TVoD and Catch-up TV services to their viewers and SmartTV sales meaning TV viewing in the living room now also had an Internet backchannel available. The utopian world of merged TV and Web seemed close; however TV programme viewers weren’t getting their information needs answered through Web-connected apps on their TVs, instead of having full screen Facebook on their TV they were looking for information on things in the TV shows, background to the news story, more examples of the art visible in the background of the scene – and are there paintings by that artist in the nearby museum?

Today’s TV viewers are multitaskers – they have a laptop, tablet or smartphone to hand while consuming TV on the big screen, and they turn to that second device to use the Web for additional information and content. However, companion applications are not well synchronised to this search – largely, their “knowledge” of what’s on is limited to identifying the programme and linking to social Web conversation around it or a list of cast members. What they don’t know, and today can’t know, is what is INSIDE the TV programme at the time the user is viewing it and could be interested in. So viewer’s real needs for Web and TV convergence are still not answered today – how to find out more about something you see in a TV programme if you don’t know what it’s called, for example?

LinkedTV has been working on the solution. By bringing together R&D experts across Europe who could provide the right tools to enable the envisioned interlinking of TV and the Web, we have produced a number of demonstrators where the experience of watching news – from the German broadcaster RBB – or a cultural heritage programme – the Dutch version of Antiques Roadshow from AVROTROS – is enhanced by additional information and content at the viewers fingertips – whether through remote control actions on a HbbTV-supporting SmartTV or through a Web application on their tablet or laptop. This information goes far beyond programme description or cast details like today’s offers – LinkedTV enables linking to information about concepts like persons, places and organisations inside the news story, links to background or related stories, or even browsing similar art objects in European collections while watching the discussion about another art object on screen.

“Years of collaboration, knowledge and technology transfer, implementation, prototyping and evaluation have brought us to this point, where we can offer an integrated set of services and software to content owners who would like to enrich their video with links to related information”, summarizes Dr Nixon, who initiated the LinkedTV idea following his PhD on multimedia enrichment in 2007 and acted as scientific coordinator of the LinkedTV project work, which finished in March 2015. “Trials with RBB and AVROTROS viewers have shown they appreciate the ability to easily access further information about what they see in the TV programme when they want. Viewers result in being more satisfied and engaged by the content. The broadcasters also stand to gain by offering LinkedTV enrichments as an added value service alongside selected content, as it can attract both new viewers and retain existing viewers, and promote their archived and long tail content with a new viewer experience.”

LinkedTV results – software, services, demos and reports – are published publicly at http://www.linkedtv.eu

LinkedTV products and demonstrators for media organisations are presented at http://showcase.linkedtv.eu

LinkedCulture demonstrator: https://vimeo.com/108891238

LinkedNews demonstrator: https://vimeo.com/119107849

Technology consultancy and proof of concept creation are possible. Organisations interested in LinkedTV enrichments for their content can contact Modul Technology GmbH c/o Lyndon Nixon.

Posted in Uncategorized by lyndon.nixon@sti2.org. No Comments

Final project report online: summary of ALL scientific and technological results of LinkedTV

42 months of R&D in an international EU-funded project covering media analysis, annotation, linking, personalisation and UIs, a software architecture for all of this on server and client side, and three distinct scenarios covering the domains of News, Cultural Heritage and Media Arts…. how to explain the results of all of this?

LinkedTV is pleased to publish publicly online its final project report which covers the technical outcomes of all the project workpackages covering all the scientific research areas mentioned above. In summarised form the reader can find out the main innovations and outputs in each topic achieved by the project partners, and of course to get at the technology itself, one can check out individual software and services (much open source) or the LinkedTV Showcase for enquiring about a commercial solution.

Posted in Uncategorized by lyndon.nixon@sti2.org. No Comments

LinkedTV #mediaanalysis service @CERTHellas now outputs #MPEG7 #AVDP metadata

Given the increasing business interest in the LinkedTV technologies and the need to conform to industry standards, we are pleased to announce on behalf of the media analysis partner CERTH-ITI that the LinkedTV media analysis service, which has in the project output the results of all individual media analysis algorithms* in an aggregated format known as Exmaralda (EXB), will now additionally export analysis results in the EBU/ISO MPEG7 AVDP (Audio Visual Description Profile) result format. The LinkedTV Platform now also stores media analysis results in this format. More information about the MPEG7 AVDP format:

* The LinkedTV aggregated media analysis service, available for external use, covers shot and scene segmentation, concept detection, object re-detection, keyword extraction, ASR and face detection, according to client configuration.

LinkedTVs “Social Documentary” interactive video exhibit is @mundaneumasbl part of @MONS2015

The Mons, Belgium based museum Mundaneum re-opened this summer 2015 with a new exhibition “Mapping Knowledge: Understanding the World through Data” as part of the European Capital of Culture 2015 events. LinkedTV is pleased to be present in this exhibition through the “Mundaneum Documentary”, an adapted version of the projects ‘Social Documentary’ multimodal interactive video exhibit. The media art installation allows visitors to explore Belgian video material along different facets through physical interaction with the tabletop interface. It leads us to rethink how we consume and interact with audiovisual content outside of traditional television and streaming models.

Mundaneum Documentary can be visited this year at the Mundaneum, Mons, Belgium. 

News item in French (Numediart)

Extended version of aggregated media analysis service – adding scene segmentation for ANY video content

We are pleased to announce an extended version of the LinkedTV tv2avd service (a.k.a. “Aggregated multimodal media analysis service”). This new version integrates software from our partner CERTH for video scene segmentation analysis which is applicable in any type of content, contrary to the developed chapter segmentation techniques which are strictly adapted to the analysis requirements of the LinkedTV scenarios (since they were based on algorithms that rely on the detection/re-detection of specific visual cues that appear in the AVROTROS and RBB content only).

In other words, the updated/extended version of the service contains the tools for providing a higher level temporal segmentation (than shots) of any video other than the material used in the project scenarios, since now the LinkedTV project is finished and new clients may wish to analyze other types of content (e.g. for demonstration purposes).

See a video demo explaining the existing functionalities.

Full list of LinkedTV Tools and Services published! AV analysis, annotation, enrichment, personalisation and enriched TV playout!

With the LinkedTV project over, our tools and services – many of which are open source – can also be applied in other new media and data contexts. LinkedTV partners will be happy to support you in tool set-up or access, according to the respective licenses and terms of use. Discover in our list:

  • LinkedTV Platform – The full server-side solution to analysing, annotating and enriching your media content.
  • Media Analysis – Online services for analysing media visually, audially or in terms of associated text.
  • Media Annotation – Services to annotate media resources with concepts from controlled vocabularies.
  • Media Enrichment – Tools and services that enable media to be linked on the basis of its annotation to related content from the Web.
  • Personalisation – A complete framework for capturing user interests, modelling them and using the model to filter or rank concept and content suggestions.
  • Playout – Tools for building LinkedTV applications and their user interfaces.
Posted in News by lyndon.nixon@sti2.org. No Comments

LinkedTV video analysis innovations to be presented by @CERTHellas at @ICMR2015 @ICME2015 @ICIP2015

Don’t miss presentations of the innovations in video analysis achieved by our partner CERTH-ITI during the LinkedTV project!

Tags: ,
Posted in Events News by lyndon.nixon@sti2.org. No Comments

Linked Media @WWWfirenze: workshop report – all slides and links now online! #lime2015 #www2015 #linkeddata #linkedmedia

Last Monday we were pleased to hold the 3rd international workshop on Linked Media at the WWW 2015 conference. This is the second time LiME took place at a WWW conference and ca. 25 people attended to hear presentations, see demos and join the discussion on annotating media with Linked Data and using those annotations for media retrieval, mixing and applications.

It was encouraging to see the uptake of what we have called the Linked Media principles in the film and media industry through our keynote speaker Dr Harald Sack, whose D-Werft project is working on “Linked Production Data” for the media value chain. Subsequent talks addressed research and development in parts of the Linked Media workflow – media analysis, annotation, retrieval and linking. We heard about a video portal where video material has been analysed and semantically annotated, leading to improved and more granular search and browsing. We learnt about an initiative to publish audio metadata as Linked Data. Chair Dr Lyndon Nixon closed by showing how Linked Media can be supported by tools from the LinkedTV project to annotate video and expose that metadata via an API and SPARQL endpoint.

The consensus at the end of the workshop was that this initiative needs to continue, particularly as there are no other scientific events so focused on the topics of semantic multimedia description and Linked Data. We are grateful for the support of all presenters and participants and look forward to the next Linked Media workshop. Follow @linkedtv to stay informed!

All workshop presentations as well as complementary links are published at the LiME workshop webpage.

All 2014 project deliverables posted online – discover the final research and technology results of #LinkedTV!

The LinkedTV project is pleased to announce all of its public deliverables from 2014 are now online and available either as PDF download or viewing/sharing via SlideShare. These deliverables largely report the final research and technology outcomes of the project prior to their evaluations and exploitation. The scientific and professional community is invited to learn about the latest research and results around Linked Television:

and last but not least:

All project deliverables from 2011 onwards on available on the deliverables page.

Posted in Deliverables General News by lyndon.nixon@sti2.org. No Comments

Don’t miss LinkedTV @ACMTVX this year with demos and an industry offer #TVX2015 #LinkedCulture #SocialDocumentary

LinkedTV is pleased to be present with a workshop participation, interactive demonstrator and an industry presentation at this years ACM TV Experiences (TVX) 2015 conference in Brussels from June 3.5. Take advantage of the early registration until April 30!

On Wednesday, in the workshop on People, Context, and Devices: Defining the New Landscape of TV Experiences scientific coordinator Lyndon Nixon will demonstrate the LinkedCulture application as an example of the new consumption experience of TV and additional related information. LinkedTV looks forward to contribute on the topic of how to provide viewers a new user experience of TV linked to additional information and content from the Web in a way that enhances, and not disrupts, the original TV viewing wish.

On Thursday, in the demos session, University of Mons will show its innovative take on linked television, the Social Documentary. It is an interactive installation for collaborative navigation through a collection of video fragments, made up of a vertical main screen which displays the video and a horizontal second screen, which is used as control panel. A touch interface and three cubes with markers give the users an intuitive and intentional way to interact with the system. Besides, a color and depth camera is used to estimate the users’ gaze and quantify how interested they are in the displayed content. As the probability of displaying each video is linked to visitors’ interest in its content, the state of the system evolves through time and depending on the usage. The set-up points to a future creative form of television where video is split and consumed non-linearly according to triggers by the user such as attention or a wish to consume specific content with specific emotions, etc. A video is available at: http://www.numediart.org/2015/03/02/social-documentary

On Friday, in the Session 4 on “Multi-screening”, Lyndon Nixon will present LinkedTVs offer to broadcast TV entitled: “a broadcast solution for integrating the Web with your TV content”. LinkedTV offers a set of tools and services to enable content owners to deliver their video material alongside relevant Web information and content across the user’s screens, not disrupting the viewing of the TV programme while satisfying the viewers interest in or need for information when it occurs.

Want to know more about LinkedTV while you are at ACM TVX? – just drop a line to Lyndon dot Nixon at modul dot ac dot at.