TEST AND GET A LINKEDTV SOLUTION FOR YOUR BUSINESS
For corrections or enquiries regarding this list, contact the list administrator. All tools and services are the responsibility of the respective organisation.
LINKEDTV offers a solution for audiovisual content owners to semi-automatically enrich media with links to additional information and content related to objects and topics in the program and build client applications which access this data and provide new added value services to consumers.
Check out LinkedTV for yourself! Acquire a free, single-use access to LinkedTV’s platform and services and see an application demonstrating how LinkedTV can enhance and enrich your content! Just contact LinkedTV to discuss your desired solution.
Tool and service categories
LinkedTV platform
The full server-side solution to analysing, annotating and enriching your media content.
LinkedTV Platform
Description
The LinkedTV Platform creates, manages and publishes rich metadata for audiovisual assets, and exposes this metadata to other applications via an API and query interface. It handles media analysis, annotation and enrichment through co-ordination of the underlying LinkedTV services (see below) and adds a common framework for video ingestion, data upload, workflow customisation and monitoring (Web dashboard), user authentication and security. The Platform can be used on its own as a rich media metadata management system or together with front end components (see PLAYOUT below) to support LinkedTV applications. It can be provided as on-site software but is built to be used as a Platform as a Service (PaaS).
Download / API
Web interface of the
LinkedTV project instance.
API and administration dashboard restricted to licensed users.
License
Commercial. Tiered by volume of processed video. Available as PaaS or software installation. Free for demonstration and prototyping (GPL v2) inside a LinkedTV Solution.
Responsible partner
Condat
Contact person
Media analysis
Online services for analysing media visually, orally or in terms of associated text.
Aggregated multimodal media analysis service
Description
This REST-based service integrates all the different visual, audio and text analysis techniques of LinkedTV. Specifically, it takes as input a video file and text files with the subtitles/ASR transcripts/metadata of the video, and performs the following types of analysis: [Visual analysis] Shot segmentation, Chapter segmentation, Concept detection, Face detection and tracking, [Audio analysis] Speech and speaker recognition and [Text analysis] Keyword extraction. (These services are also individually available, see below)
Download / API
By purchase only
License
Commercial. Pricing based on services used and volume of requests. Free test results available for a small amount of content as part of a LinkedTV Solution.
Responsible partner
CERTH-ITI
Contact person
Evlampios Apostolidis
or
Vasileios Mezaris
Object re-detection in video
Description
This tool is used for finding (and spatially demarcating) automatically occurrences of manually specified instances of objects in videos.
Download / API
By purchase only
License
Commercial. Single purchase fee.
Responsible partner
CERTH-ITI
Contact person
Evlampios Apostolidis
or
Vasileios Mezaris
Video shot and scene segmentation
Description
This tool is used for the automatic segmentation of videos into shots and scenes. It can detect both abrupt and gradual shot transitions with high accuracy, by jointly examining global and local image descriptors, and then also group the shots into scenes. Parallel computing, either CPU-based (via multi-threading) or GPU-based (via CUDA programming), is used, depending on the version of the tool, for making the whole video analysis several times faster than real-time processing.
Download / API
A restricted version is publicly available at shot segmentation demo.
License
Commercial for full version. Single purchase fee or API pay per use/volume.
Responsible partner
CERTH-ITI
Contact person
Evlampios Apostolidis
or
Vasileios Mezaris
Video shot segmentation and concept detection
Description
This tool is used for identifying the high level semantics of videos in the shot level. The algorithm starts with the segmentation of the video into shots and the extraction of a number of representative keyframes for each detected shot (using the Shot segmentation tool described above). These keyframes are then used for the detection of high level visual concepts that describe the semantic content of each shot.
Download / API
By purchase only.
License
Commercial for full version. Single purchase fee or API pay per use/volume.
Responsible partner
CERTH-ITI
Contact person
Audio mining, including German ASR and audio segmentation
Description
Audio Mining targets at scenarios in the context of Multimedia Indexing and Search. Therefore, the tool analyses a given audio/video file and returns textual information for indexing. Speech and speaker segmentation as well as speech recognition are performed in order to turn speech into text. It delivers segments, characteristic keywords and various metadata. Finally, it can build an index for Multimedia Search.
Download / API
By purchase only.
License
Commercial, based on volume.
Responsible partner
Fraunhofer IAIS
Contact person
Mixture Subclass Discriminant Analysis (MSDA)
Description
This tool is an implementation of MSDA and a GSDA/KMSDA in Matlab code. MSDA is a dimensionality reduction method that alleviates two shortcomings of Subclass Discriminant Analysis (SDA). In short, MSDA modifies the objective function of SDA, and utilizes a partitioning procedure to help with the discrimination of data with Gaussian homoscedastic subclass structure. KMSDA is the kernel-extension of MSDA; GSDA is a speeded-up version of KMSDA. This tool is for non-commercial use.
Download / API
A non-optimized version is publicly available at http://www.iti.gr/~bmezaris/downloads.html
License
Non-optimized version free for non-commercial use. Licensing conditions for commercial use please contact CERTH-ITI. Commercial for full version. Single purchase fee or API pay per use/volume.
Responsible partner
CERTH-ITI
Contact person
Keyword Extraction Tool
Description
Keyword extraction is a Web application and Web service, which performs keyword extraction from English, German and Dutch text. The system is based on the standard TF-IDF approach, which is extended with language-specific POS tagging and noun-phrase chunking for identification of key phrases.
Download / API
By request only.
License
Open source (Apache 2.0), but uses TreeTagger which is not free for commercial use. Code at https://github.com/KIZI/LTVKeywordExtractor
Responsible partner
UEP
Contact person
Media annotation
TV2RDF
Description
An online service that converts media transcription (.srt format), legacy TVAnytime metadata and media analysis results into an integrated RDF file according to the LinkedTV ontology. Media fragments are annotated with named entities extracted by NERD (see below). Results can be pushed to the LinkedTV Platform and used for media enrichment.
Download / API
http://linkedtv.eurecom.fr/tv2rdf/
License
Open Source (Apache 2.0). Code on request.
Responsible partner
EURECOM
Contact person
NERD (Named Entity Recognition)
Description
A Framework compiling 12 NER extractors including: AlchemyAPI, dataTxt, DBpedia Spotlight, Lupedia, OpenCalais, Saplo, SemiTags, TextRazor, THD, Wikimeta, Yahoo! Content Analysis Framework and Zemanta (Extractiv and Evri are no longer available). NERD detects automatically the language of the text being analyzed. NERD provides an individual dashboard to monitor logged in user activity.
Download / API
http://nerd.eurecom.fr/api/ (needs an API key). Documentation)
License
Open source (Apache 2.0). Codebase. Free for non-commercial use. Customised NERD set-ups for commercial usage on request.
Responsible partner
EURECOM
Contact
SemiTags
Description
Named Entity Recognition and Disambiguation Web Service for Dutch and German
Download / API
By request only
License
Open source (Apache 2.0), but uses TreeTagger which is not free for commercial use. Codebase
Responsible partner
University of Economics, Prague
Contact person
Wikifier Evaluation Framework for GATE
Description
GATE plugins for evaluation of Wikipedia-based NER systems (also known as Wikifiers), which provide links to Wikipedia articles describing recognized entities, and classify those entities with types from the DBpedia Ontology. The plugins come with two evaluation datasets.
Download / API
http://ner.vse.cz/datasets/evaluation/ (http://ner.vse.cz/datasets/evaluation/tools/)
License
Responsible partner
University of Economics, Prague
Contact person
THD
Description
Fine-grained entity recognition, linking and classification system for English, Dutch and German. For more, see here
Download / API
Extraction and Classification (Documentation)
License
Open source (GPL v3). Codebase
Responsible partner
University of Economics, Prague
Contact person
Linked Hypernyms Dataset
Description
This Linked Hypernym dataset attaches entity articles in English, German and Dutch Wikipedia with a DBpedia resource or a DBpedia ontology concept as their type. The types are hypernyms mined from articles’ free text using hand-crafted lexicosyntactic patterns.
Download / API
Linked Hypernyms dataset (Dataset Description)
License
Creative Commons Attribution Only Share Alike (CC BY-SA 3.0)
Responsible partner
University of Economics, Prague
Contact person
Entity Expander
Description
A helper service which suggests, for a set of entities extracted from a news programme, a alternative, ranked set of related entities for that news programme.
Download / API
http://linkedtv.eurecom.fr/entitycontext/api/
License
Open Source (Apache 2.0). Code on request. Depends on Google CSE terms of use.
Responsible partner
EURECOM
Contact person
Media Enrichment
Editor Tool
Description
Check media analysis and annotation results for video on the LinkedTV Platform in an easy to use Web interface. Select entities of interest and execute LinkedTV enrichment services to add links from video fragments to related information and content. Allows both checking/correcting automatic results as well as adding manual annotations and links. Save to LinkedTV Platform and to file. Compatible with the LinkedTV Player for video playout with annotations and enrichments.
Download / API
Editor Tool, LinkedTV project instance – one test video available. Free demonstration login with your own content by request as part of a LinkedTV Solution.
License
Open Source (GPL). Codebase (ZIP download). Customisation available from Sound and Vision independently or as part of a LinkedTV Solution.
Responsible partner
Sound and Vision
Contact person
Media Collector
Description
An API that enables to search flexibly for media enrichments from different sources based on a search term. Media comes from the IRAPI service (see below) OR fresh media items shared on social networks. Additional services can be added.
Download / API
http://linkedtv.eurecom.fr/api/mediacollector/search/
License
Open source (Apache 2.0). Codebase, please note Social Web enrichment dependent on respective social network APIs’ terms and conditions.
Responsible partner
EURECOM
Contact person
TVEnricher
Description
An enrichment service customised to the needs of the customer. Currently set up to support the LinkedTV scenario “LinkedCulture”. Aggregates enrichment links from a set of underlying enrichment services and provides them to an application via a single and flexible REST API in a common data format.
Download / API
http://linkedtv.eurecom.fr/tvenricher/api/
License
Open Source (Apache 2.0). Code on request. For customised instances using different enrichment services, contact below.
Responsible partner
EURECOM
Contact person
TVNewsEnricher
Description
An enrichment service customisable for news programming combined with the EntityExpander (see above). Currently set up to support the LinkedTV scenario “LinkedNews”. Suggests links to online news articles and news media based on sets of entities annotated to a news item.
Download / API
http://linkedtv.eurecom.fr/newsenricher/api/
License
Open Source (Apache 2.0). Code on request. Depends on Google CSE terms of use.
Responsible partner
EURECOM
Contact person
IRAPI & irDashboard
Description
An enrichment service which uses a pre-crawled index of web sites (whitelist) to suggest Web links that are relevant for an entity or set of entities. Solr is used for the content index and IRAPI can be configured to crawl and return Web pages, online images or videos. irDashboard is a web application for administrators to control and monitor how the white list is crawled and indexed.
Download / API
https://ir.lmcloud.vse.cz/
License
Open source (Apache 2.0). Codebase
Responsible partner
University of Economics Prague
Contact person
Entity Proxy
Description
Returns a so-called information card (a description made up of selected properties and their values) for any concept identified via the DBPedia knowledge base.
Download / API
http://linkedtv.project.cwi.nl/explore/entity_proxy
License
Open Source (MIT). Codebase. Installed as a library with ClioPatria.
Responsible partner
CWI
Contact person
Personalisation
EasyMiner
Description
Association rule mining system for inferring user (dis)interests in topics based on captured user interaction (by GAIN, see below)
Download / API
http://easyminer.eu
License
Open Source (modified BSD). Codebase.
Responsible partner
University of Economics, Prague
Contact person
InBeat – GAIN
Description
Software framework for capturing and preprocessing user interaction with a LinkedTV application
Download/API
http://inbeat.eu/gain/docs/rest (Documentation)
License
Open Source (modified BSD). Codebase.
Responsible partner
University of Economics, Prague
Contact person
LinkedTV User Model Ontology (LUMO)
Description
The LUMO ontology is developed within the LinkedTV project to semantically represent user-pertinent information, in order to enable semantic personalization and contextualization (i.e. filtering) of concepts and content in the networked media domain. LUMO is accompanied by a separate mappings ontology, modelling mappings of LUMO to several existing ontologies and vocabularies (DBPedia ontology, the Linked Hypernyms Dataset (LHD), YAGO, schema.org, IPTC news codes, GUMO).
Download / API
- LUMO: http://data.linkedtv.eu/ontologies/lumo
- LUMO mappings: http://data.linkedtv.eu/ontologies/lumo_mappings/
- LUMO documentation: http://mklab.iti.gr/project/lumo
License
Open Source (Creative Commons Attribution-ShareAlike License (v3.0)) already deployed on Github: ontology in OWL format and mappings in OWL format
Responsible partner
CERTH-ITI
Contact person
LiFR
Description
LiFR is a general purpose fuzzy semantic reasoner, which for the purposes of LinkedTV performs content filtering by semantically matching a user profile against a set of available content items, and concept filtering by expanding the interests of a user along the LinkedTV personalization concept space (LUMO).
Download / API
http://mklab.iti.gr/project/LiFR
License
Open Source (LGPL). Code on request.
Responsible partner
CERTH-ITI
Contact person
Linked Profiler
Description
Linked Profiler is a semantic profile engineering API, responsible for receiving input by captured or explicitly declared user interests and (a) unifying it under a common personalisation-centric vocabulary LUMO and, based on the uniform input (b) learning a user profile over time and content consumption through its subcomponent Simple Learner. It ultimately produces a fuzzy semantic user profile that can be received by the LinkedTV filtering tools (see LiFR, above). For user interest input, works with GAIN and EasyMiner, see above.
Download / API
http://mklab.iti.gr/project/linkedtv-profiling-tools
License
Open Source (LGPL). Code on request.
Responsible partner
CERTH-ITI
Contact person
Playout
Multiscreen Toolkit
Description
A software framework which provides client applications a set of convenience methods for user authentication, management, enrichment retrieval from the LinkedTV Platform, synchronisation to TV or video playout and management of content across multiple connected screens.
Download / API
License
Open Source (GPL v3). Packaged within Noterik’s Springfield framework. Code at http://github.com/noterik. Consultancy, concept development, application UI/UX implementation & technical support available from Noterik independently or as part of a LinkedTV Solution.
Responsible partner
Noterik BV
Contact person
LinkedTV User Interface
Description
An implementation of a HTML-based UI for providing users access to LinkedTV enrichments on a companion device.
Download / API
License
According to agreements with the customer. LinkedCulture UI public code example. LinkedNews UI public code example. Not to be re-used without permission.
Responsible partner
CWI
