LinkedTV does #icip2014 tutorial on Video Hyperlinking, papers on video analysis and concept detection for cross modal multimedia search

LinkedTV is being well represented at the International Conference on Image Processing held in Paris this year (27-30th Oct 2014). ICIP is the premier conference on Image Processing attracting this year over 1500 attendees.

LinkedTV presented its tutorial on Video Hyperlinking on the opening day of the conference. The 3 hour tutorial was well attended and generated many interesting discussions. It covered the topics of Video Analysis and HyperLink generation, building on the work carried out in LinkedTV’s workpackages on those topics led by partners CERTH and EURECOM as well as on results obtained through the participation to various international benchmarking activities (MediaEval 2014 report coming soon).

Two LinkedTV research papers on “LINKING TEXT AND VISUAL CONCEPTS SEMANTICALLY FOR CROSS MODAL MULTIMEDIA SEARCH” and “NO-REFERENCE BLUR ASSESSMENT IN NATURAL IMAGES USING FOURIER TRANSFORM AND SPATIAL PYRAMIDS” were also presented during the main conference.

 

Posted in Uncategorized by lyndon.nixon@sti2.org. No Comments

#iswc2014 Tutorial “Remixing Media on the Semantic Web” – All slides now online!

Learn with LinkedTV about:

  • Media Fragment URI specification
  • Named Entity extraction
  • Open Annotation Model
  • The LinkedTV Ontology
  • Linked Media principles
  • Publishing and retrieving semantic multimedia metadata
  • Enrichment of video and TV with links
  • Browsing and linking media fragments
  • User expectations and experience with enriched video
  • The LinkedNews and LinkedCulture applications

The slides of our ISWC2014 tutorial “Remixing Media on the Semantic Web” are available directly from the event webpage.

Posted in Uncategorized by lyndon.nixon@sti2.org. No Comments

LinkedTV brings hypernym discovery to German #DBPedia! @DBpedia_De #lod #lhd #thd #ner

LinkedTV is pleased to contribute to the German DBPedia effort through the addition of hypernym discovery within Wikipedia article text. The “Linked Hypernyms Dataset” identifies the types of a resource through statistical type inference co-occurrence.

With this, a key problem for the German DBPedia dataset is being addressed: the sparsity of RDF type properties on DBPedia resources which makes SPARQL querying more difficult.

The new German DBPedia dataset now contains between 43 and 53% more rdf:type triples.

The same dataset is applied in the LinkedTV project to classify extracted entities from TV programming by type. This functionality is encapsulated in the service Targeted Hypernym Discovery (THD), developed and provided by our partner University of Economics Prague.

This was originally announced following the 2nd DBPedia Community meeting at http://de.dbpedia.org/node/30.

 

Tags: ,
Posted in Demos News by lyndon.nixon@sti2.org. No Comments

#HyperTED a LinkedTV prototype in the top 10 finalists for the #VICI challenge of @linkedupproject at @iswc2014

“HyperTED: Exploring TED talks at the fragment level” offers a unique and innovative way for exploring over 1681 TED talks at the media fragment level, opening a window to a more effective and efficient dissemination of the knowledge present in those inspirational conferences. Anyone can play with this app at http://linkedtv.eurecom.fr/mediafragmentplayer.

HyperTED has been developed using key LinkedTV technologies such as video chaptering, hot spots detection based on the NERD framework for extracting and disambiguating named entities, and hyperlinking technologies that enable to recommend fragments of other TED talks as well as educational resources such as MOOCs based on what you’re viewing!

Vote for us at http://linkedup-project.eu/vici-peoples-choice/. We are competing for the People’s Choice Vote.

Tags: , , , ,
Posted in Demos News by lyndon.nixon@sti2.org. No Comments

LinkedNews: Web and #HbbTV application for enriched news viewing developed with @rbb_inno. Video demo now available!

The LinkedNews scenario, driven by LinkedTV partner Rundfunk Berlin Brandenburg (RBB), has been released for the project’s third year with two updated approaches to viewer access and interaction with LinkedTV annotations and enrichments:


(1) A mobile application: starting with a connected device such as a laptop and tablet, the viewer can choose a news programme and begin to watch as well as browse the annotations and enrichments on the same screen. They also have the option to send the news programme video to an available other screen (e.g. their TV set) and continue to browse the LinkedTV enrichment content on their mobile device synchronized to the news programme. This is an adaptation of last years’ LinkedNews tablet interface for use with RBB content and enrichments. In particular, the available navigation for browsing enrichments has been aligned to the dimensions of enrichment supported for the RBB scenario which are related news items from RBB and related news items from other sources;


(2) An HbbTV application: starting with a SmartTV or set top box (STB) with HbbTV functionality, the “red button” mode allows the viewer to access the LinkedTV application and begin to explore video chapters and their annotations. For annotated concepts, also relevant information for each concept can be displayed on the main screen. Again, if the viewer wishes to explore further the LinkedTV enrichments they may connect a second screen to the LinkedTV application which will mirror the list of video chapters and their annotations but offer a more complete browsing of available enrichment links from the LinkedTV system using the LinkedNews interface described above.

See the HbbTV application in our video below, made during the IFA 2014 in Berlin this month:

LinkedTV demonstration of LinkedNews: HbbTV application for enrichment of a news program with related information from Linked Television on Vimeo.

Tags: , ,
Posted in News by lyndon.nixon@sti2.org. No Comments

Visit our Linked Television Living Room @IBCShow FutureZone stand 8F42, starting TODAY until September 16, and experience the future of television!

We would like to invite you to our stand at the IBC 2014 in Amsterdam, starting today and running until Tuesday September 16. You will find LinkedTV in the Future Zone of the exhibition located near Hall 8 on stand 8F42.

In a comfortable living room atmosphere we will present a LinkedTV News and a LinkedTV Culture TV show demonstrating our latest research and development results. Make yourself comfortable on our sofa and discover new information about the programme you are watching easily and directly on a companion device. Gain more background information on the news or explore topics of interest in the world of art and artiques! Project members will be around to give you a live presentation and to answer your questions.

The LinkedTV consortium would be very glad to meet you at our stand. If you need a free exhibition entry contact us!

Tags: , , ,
Posted in News by lyndon.nixon@sti2.org. No Comments

LinkedTV and HbbTV @IFA_Berlin and #ICCE2014: how your SmartTV can provide the information you’re looking for

LinkedTV has been active this week in Berlin in the context of the Internationale Funk Ausstellung (IFA) – Europe’s answer to CES – and the parallel International Conference on Consumer Electronics (ICCE).

European households who purchase a new SmartTV will most likely have HbbTV capability, the European standard for hybrid broadcast-broadband content delivery. HbbTV has established itself today as a replacement for the old Teletext/Videotext that was once delivered within analog TV. It also provides access to online Mediatheken, the broadcasters TV archives. However, LinkedTV considers this only the beginning of what HbbTV is capable of offering viewers. HbbTV lets TV viewers access additional applications via the red button, however programme-specific applications are still limited. Combined with LinkedTV technology, a HbbTV capable SmartTV or Set Top Box could offer LinkedTV enrichments during supported TV programmes, accessed via the red button and then either displayed as overlays on the TV screen or pushed to a companion device such as the viewers tablet or laptop.

A proof of concept of LinkedTV over HbbTV has been shown this week at the IFA, courtesy of our partner Rundfunk Berlin Brandenburg (RBB)

Meanwhile, our scientific coordinator Dr Lyndon Nixon of MODUL University presented the Linked Television vision, implementation and HbbTV prototype at the ICCE conference.

Finally, LinkedTV reiterated its commitment to the HbbTV 2.0 specification which is not yet launched in Consumer Electronics devices. Several key functionalities such as the ability to discover and connect to another screen or synchronize Internet content to broadcast TV are currently missing in HbbTV for LinkedTV to become a living room reality. Our prototype demonstrates the feasibility of the approach and we look forward to the next generation HbbTV devices that can support it!

A position paper on HbbTV 2.0 and LinkedTV considers this in more detail:

 

 

Tags: , , , , ,
Posted in News by lyndon.nixon@sti2.org. No Comments

LinkedTV in September: demos @IFA_Berlin @IBCShow of #hbbtv #secondscreen solutions for syncronised enrichment of TV programmes

LinkedTV is pleased to be giving public demos of the Linked Television experience this month at both IFA Berlin and IBC Amsterdam!

During IFA, visit our partner Rundfunk Berlin Brandenburg (RBB) which is part of the German public broadcasters area in Hall 2.2. From the 5 to 10 September in the “Digitales Wohnzimmer” (digital living room) LinkedTV provides the demo of Interactive News – discover background information to the news you watch direct and interactive on your smart TV using LinkedTV innovation built on top of HbbTV technology!

Shortly after, the leading broadcasters exhibition IBC (12-16 September) will feature a dedicated LinkedTV living room set up in the FutureZone, Hall 8 Stand F42. Relax on the sofa with a tablet and discover watching TV while getting background and complementary information on your local screen providing you with a deeper understanding of both news and cultural heritage programmes, even across linguistic barriers!

LinkedTV can invite you with a free entry code for the IBC exhibition, just contact us with your name and company!

See you in September!

Tags: , , , ,
Posted in News by lyndon.nixon@sti2.org. No Comments

Semantic TV comes home: @LinkedTV demos @IBCShow 11-16 September in Amsterdam!

Originally published at TVBEurope courtesy Adrian Pennington. 

In the LinkedTV project, researchers are connecting TV content with the internet, so audiences can benefit from an more informative and personalised viewing experience.

Visitors to IBC’s Future Zone can see for themselves in a living room simulation. While watching a TV programme they can explore more information and content about concepts and topics via a companion app. The technology that makes this programme enhancement possible is targeted at broadcasters and OTT content providers.

“We will show this for two genres where further information exploration is a typical interest of viewers: a newscast by Rundfunk Berlin-Brandenburg and a documentary series of the Dutch TV station AVRO,” explained scientific co-ordinator Lyndon Nixon. “We think that viewer interest is sometimes lost or frustrated because it is not possible to easily find everything we see on TV: how do I Google for the painting I just saw on the wall behind the presenter when I don’t know the name of the artwork nor the artist?”

The institute is working with eleven partners from seven countries on LinkedTV. Software scans the contents of a show prior to its broadcast via speech analysis and image processing for topic-related content from the web.

“We want to seamlessly combine TV and the internet so that viewers can directly access background information about the current programme during the show, without having to spend a lot of time and effort themselves in searching for it,” said project manager Heike Horstmann.

Since the software provides a great number of unfiltered hits and semantic links, the researchers have developed methods to narrow down the results according to certain criteria.

“For example, content will be displayed only if it complies with laws for the protection of minors and for which the copyright is no problem,” Horstmann added. The editorial team adds the final touches, checking suggested content for relevance and eliminating any duplication from the hit list.

Parallel to the broadcast, the viewer then finds information sorted according to topic for each chapter of a TV programme. If desired, they can specify filter criteria that determine which content is displayed – defining topics of particular interest or hiding results for specific content. The software is also capable of learning and adjusts the offer of information to the user’s behaviour.

“If the viewer repeatedly accesses the weather report or information on a particular topic, for instance, this content will be displayed in a prioritised fashion,” said Horstmann. The viewer can view both broadcast and additional content directly on the screen of a connected TV or on another device with web access, such as a tablet or laptop.

The best approach would be to use two screens that are synchronised with each other in parallel. Generally, the show then runs on the television, while further content is displayed on the second screen.

 

Tags: ,
Posted in News by lyndon.nixon@sti2.org. No Comments

Paper on Video Hyperlinking using Scene Segmentation will be presented @ACMMM2014.

A LinkedTV paper titled “Automatic fine-grained hyperlinking of videos within a closed collection using scene segmentation” was accepted for presentation at the ACM Multimedia 2014 (MM) conference, taking place in November in Orlando, Florida.

ACM MM is ACM’s premier conference on multimedia, attracting every year more than 500 top researchers of the Multimedia field. The LinkedTV paper reports on LinkedTV’s findings and results arising mainly from its participation to the Search and Hyperlinking task of the MediaEval 2013 benchmarking activity – a task where LinkedTV achieved first place in hyperlinking and second place in search -, and is the joint work of the LinkedTV partners CERTH, Eurecom, UEP and Fraunhofer IAIS.