Analysis Data

In order to give new teams an easy entry, we provide results of content analysis to all teams. The V3C dataset already comes with segmentation information and includes shot boundaries as well as keyframes. Moreover, we provide resulting data from different content analysis steps (e.g., color, faces, text, detected ImageNet classes, etc.). The analysis data of V3C1 is available here and described in this article, the one for V3C2 can be found here. Also, the ASR data has been released here (many thanks to Luca Rossetto et al.)! Moreover, the SIRET team shared their shot detection network too (many thanks to Jakub Lokoc and his team)!

Shot Boundary Detection

The SIRET team provides a state-of-the-art shot boundary detection network TransNet V2 in https://github.com/soCzech/TransNetV2 (see paper here: https://arxiv.org/pdf/2008.04838.pdf).

Existing Browsing Tool

If you want to join the VBS competition but do not have enough resources to build a new system from scratch, you can start with and extend a simple lightweight version of SOMHunter, the winning system at VBS 2020. The system is provided with all the necessary metadata for the V3C1 dataset. https://github.com/siret/somhunter

Providing a solid basis for research and development in the area of multimedia management retrieval, vitrivr is a modular open-source multimedia retrieval stack which has been participating to VBS for several years. It’s flexible architecture allows it to serve as a platform for the development of new retrieval approaches. The entire stack is available from https://vitrivr.org/

V3C Dataset

VBS uses the V3C1+V3C2+V3C3 dataset in collaboration with NIST, i.e. TRECVID (i.e. with the Ad-Hoc Video Search (AVS) Task) , which consists of 28450 video files, amounting for 3801h of video content (4143693 master shots) and 8.7 TB in size. In order to download the dataset (which is provided by NIST), please complete this data agreement form and send a scan to angela.ellis@nist.gov with CC to gawad@nist.gov and ks@itec.aau.at. You will be provided with a link for downloading the data.

Marine Video Data

The marine video dataset, as well as references etc., can be found on this website. The snapshot that we will use is available at https://download-dbis.dmi.unibas.ch/mvk/.

Submission of Results to DRES

How you can submit results to DRES is described on the Communication with DRES page.

Previous VBS Tasks

Tasks from VBS2018-VBS2024 can be downloaded from this GitHub repository.