The LinkedTV project is working on concepts of Future Television, and two of those concepts will be demoed next week at the European Conference on Interactive Television (EuroITV2013) -
- Connected Media Experiences: interactive video on your television will show work by LinkedTV scientific coordinator Lyndon Nixon and STI International on porting Web based interactive video to the GoogleTV platform. Using the Sony set-top box and remote control, viewers are alerted to additional information about actors, characters, places and other concepts in the TV program and by simple button pressing can quickly browse in and back out of the dynamically inserted info. This work is part of the Austrian project ConnectME. An online demo (runs on latest desktop and tablet browsers as well as GoogleTV) can be accessed.
- Enriched Multiscreen TV Experience will demo LinkedTV’s multi-screen player for interactive television, developed by partner Noterik. TV viewers can use their mobile device to browse the concepts in the TV program and select concepts of interest to access additional content enhancing their TV experience while not disrupting their viewing on the main TV screen. An online video of the multiscreen technology can be seen here.
The demos sessions take place on Tuesday and Wednesday afternoon for EuroITV attendees.
The LinkedTV workpackage on Media Analysis recently reported a number of advances in video analysis technologies. These include the development of elaborate general-purpose dimensionality reduction and machine learning techniques, their application to the problems of video event detection and recounting, the development of new ways for compactly representing video content and their use towards more accurate video concept detection, and the development of a fast and accurate technique for re-detecting known objects in video.
These advances are presented in detailed in several new papers published or accepted in different international journals and conferences, in particular at ICIP 2013 and ICME 2013:
- Nikolaos Gkalelis, Vasileios Mezaris, Ioannis Kompatsiaris, T. Stathaki, “Video event recounting using mixture subclass discriminant analysis”, Proc. IEEE International Conference on Image Processing (ICIP 2013), Melbourne, Australia, September 2013.
- Panagiotis Sidiropoulos, Vasileios Mezaris, Ioannis Kompatsiaris, “Enhancing video concept detection with the use of tomographs”, Proc. IEEE International Conference on Image Processing (ICIP 2013), Melbourne, Australia, September 2013.
- Evlampios Apostolidis, Vasileios Mezaris, Ioannis Kompatsiaris, “Fast object re-detection and localization in video for spatio-temporal fragment creation”, Proc. 1st Int. Workshop on Media Fragment Creation and reMIXing (MMIX’13) at the IEEE Int. Conf. on Multimedia and Expo (ICME 2013), San Jose, CA, USA, 15-19 July 2013.
- Nikolaos Gkalelis, Vasileios Mezaris, Michail Dimopoulos, Ioannis Kompatsiaris, Tania Stathaki, “Video event detection using a subclass recoding error-correcting output codes framework”, Proc. IEEE Int. Conf. on Multimedia and Expo (ICME 2013), San Jose, CA, USA, 15-19 July 2013.
LinkedTV is proud to support, through the EU’s 7th Framework Programme funding, these research advances which contribute greatly to the projects goal of reducing the cost and effort for video owners to conceptually annotate audiovisual material, at increasing scales as faced by broadcasters, archives and many other institutions today.
On 30 May, a joint HBB-NEXT – LinkedTV meeting took place at the Netherlands Institute for Sound and Vision, which was was attended by 15 professionals from the Dutch media industry. The reason for the shared meeting is that both projects work on similar topics and issues (Connected TV, multiple device access, contextualisation, etc) TNO, Sound and Vision and Noterik joined forces and organised a meeting to exchange experiences and ideas.
Oskar van Deventer (TNO) kicked off and presented an HBB-NEXT demo that uses face recognition to provide individual and group content recommendations which was developed jointly with project partner STUBA. He also gave an update on HbbTV 2.0 standardisation. With the “HBB-NEXT Feedback workshops” the project has a regular forum that is very valuable for the ongoing development work of the project. On that score Victor Klos (TNO) presented and discussed identity management for HbbTV with the group.
After this, Lotte Baltussen (Sound and Vision) gave a general overview of LinkedTV (in Dutch) and the lessons-learned from the first focus groups that were held recently. From this, we learned that viewers of Tussen Kunst and Kitsch (see the scenario here) would prefer to really delve deep into extra information about the art objects presented in the show afterwards. If they would be presented with too much information during the programme, it would distract them too much. The attendees then discussed how the editors of programmes should work with the additional information that will automatically be generated by the LinkedTV system, because many links to related content can be generated. The work on an editor tool, and the revision of the scenarios and requirements is already ongoing within in LinkedTV, and will be expanded and presented in the coming months.
Then, Daniel Ockeloen (Noterik) gave an overview of what LinkedTV has technically built so far (in Dutch) and the ongoing work on a LinkedTV second screen and the future work on multiple screen. In order to be able to quickly prototype these new applications and test them, a multiscreen toolkit is being developed. This should serve the development of apps for multiple user groups with a variety of interests and requirements.
The meeting ended with a discussion on on how to deal with adapting LinkedTV’s additional information to various types of television formats, and on the other hand how and when to best present this information to end users. Over drinks, the participants agreed that it had been a fruitful afternoon, and the intention to follow it up with another meeting in the future.
A special thanks to Rob Koenen from TNO for getting in touch and organising the meeting!
LinkedTV is pleased to announce the publication of two new videos at its YouTube channel:
- A video on Context Detection shows how viewer context is extracted using a Kinect sensor detecting the couch location and the viewer location.
- A video on User Interest Extraction shows an approach to detecting level of viewer interest in a TV program using a Kinect sensor to determine time spent looking at or away from the TV screen.
Both videos show work done by the project partner University of Mons and being demonstrated this year at the INTERTAIN 2013 conference where LinkedTV also runs a special session on interactive technology for future television.
The WWW Conference has published its Companion Proceedings online at http://www2013.org/papers/companion.htm and the first Worldwide Workshop on Linked Media (LiME 2013) is included! Check out the keynote of LinkedTV scientific co-ordinator Lyndon Nixon on the importance of Linked Media to the Future Web (the slides are also on Slideshare) as well as the seven accepted papers. Direct links from the workshop agenda to the proceedings publication have been added at the LiME workshop event page.
Yesterdays first Worldwide Workshop on Linked Media (LIME 2013) brought together over 20 participants to present on and discuss work related to the vision and goal of Linked Media. Firstly, LinkedTV scientific co-ordinator keynoted on what is Linked Media precisely, an important question for building a research community around the topic. His keynote slides are now published, see them below:
Seven further workshop presentations covered topics from linking within video collections to viewer attention tracking. The workshop TitanPad contains links to demos or videos for every presentation. A closing discussion on Linked Media noted that the included topics were very broad and that a categorization of problems would be useful to better structure discussion. What is the core concept of Linked Media?
We hope, within the LinkedTV project and involving external, interested voices, to further define and push forward the Linked Media vision.
If the future Web will be able to fully leverage the scale and quality of online media, a Web scale layer of structured, interlinked media annotations is needed. This layer, which we call Linked Media (inspired by the Linked Data movement for making structured, interlinked descriptions of resources better available online), is a fundamental part of the vision of the LinkedTV project. In our view, an automated enrichment of audiovisual material with other media drawn from online sources will only work effectively if online media is described in a structured and a semantic manner.
Mobile and tablet devices, as well as connected TVs, introduce novel application domains that will benefit from broad understanding and acceptance of Linked Media standards. At next weeks World Wide Web Conference (WWW2013), the first ever Workshop on Linked Media (LiME) will take place. As keynote, LinkedTV scientific coordinator Lyndon Nixon will provide an overview of current practices and specification efforts in the domain of video and Web content integration, drawing from the LinkedTV and MediaMixer projects. From this, a vision for a Linked Media layer on the future Web emerges, to which LinkedTV as a project is contributing. During the workshop, which also features seven scientific presentations around Linked Media themes, interactive and open discussion will be encouraged to explore the Linked Media goal and how to get there.
WWW2013 attendees are cordially invited in their registration to also plan to attend the Linked Media workshop on the Monday (1-5pm), and we look forward to seeing you there!
The next European conference on Interactive Television (EuroITV) to be held June 24-26 2013 in Como, Italy, promises to be as every year a highlight for researchers and industry experts working in the domain of Smart and Interactive Television. This year the LinkedTV project will be particularly present with several project partners presenting papers or demos, as well as the 4th edition of the Future Television workshop taking place on the pre-conference day.
In the main conference, LinkedTV is pleased to announce that the following demos and short papers have been accepted in the program:
- Daniel Ockeloen,Kati Hyyppä, Pieter van Leeuwen. Enriched Multiscreen TV Experience. Demo
- Ana Carina Palumbo, Lynda Hardman. User Information Needs for Environmental Opinion-forming and Decision-making in Link-enriched Video. Short Paper
- Vuk Milicic, José Luis Redondo Garcia, Giuseppe Rizzo, Raphaël Troncy. Grab your Favorite Video Fragment: Interact with a Kinect and Discover Enriched Hypervideo. Demo
- Lyndon Nixon, Matthias Bauer and Cristian Bara. Connected Media Experiences: interactive video on your television. Demo
Clearly LinkedTV is working to put hypervideo (video where a viewer can interact with objects within the video) onto the research and industry agenda, with single and multi-screen demos, interaction using the remote control, touch and gesture, and the interface and experience being backed by user trials. We look forward to meeting with EuroITV attendees – for the interested, please note that early registration at EuroITV is available until May 1st!
LinkedTV is pleased to announce a special session on Social Events in Web Multimedia taking place during the International Conference on Multimedia Retrieval ICMR 2013, on April 18th 2013. Project partners CERTH and EURECOM are responsible for organizing this session in which the latest research on video analysis, annotation and enrichment where it relates to mining the Web for media related to a specific event will be presented. See http://www.icmr2013.org/sessions.php for the session description and http://impact.utc.edu/icmr2013/program.php for its place in the conference program.