Overview of Ad-Hoc Group on Hybrid Model Development and HRC Generation Tools
This project overview outlines the objectives and findings of the Ad-Hoc Group, focusing on the transition from SRC to Bitstream-PVS and the development of a robust HRC generation toolchain. It details the key components involved in HRC validation and hybrid model input conversion. The presentation emphasizes the importance of a flexible hybrid model input format, the tools for facilitating this process, and the structure of the hybrid model. Challenges and future directions in hybrid model software development are also discussed, along with the advantages of a standardized approach.
Overview of Ad-Hoc Group on Hybrid Model Development and HRC Generation Tools
E N D
Presentation Transcript
JEG Project: Overview of Ad-Hoc Group Marcus Barkowsky, Nicolas Staelens, Yves Dhondt, Lucjan Janowski, Ulrich Engelke, Marie-Neige Garcia, Savvas Argyropoulos
Objectives • From SRC to Bitstream-PVS • HRC Generation toolchain • HRC Validation • From Bitstream-PVS to Hybrid Model input • Hybrid model input format • Tools for generating the Hybrid Model input format • Towards Hybrid Model development • Hybrid model structure and framework • Hybrid model performance evaluation Marcus Barkowsky: JEG Overview
Overview PVS HRC Subjective Experiment SRC PCAP MOS Hybrid Model Training /Validation Objective Score Marcus Barkowsky: JEG Overview
Improvement • Disadvantage of PCAP as input to Hybrid Model • Difficult to parse because of different formats for • Transmission protocols • Multiplex • Encoders • Flexibility achieved by Hybrid Model Input Format • XML structure • Contains mandatory and optional fields • Independent of Protocols Marcus Barkowsky: JEG Overview
Overview PVS HRC Subjective Experiment SRC PCAP MOS HMIX extractor HMIX Hybrid Model Training /Validation Objective Score Marcus Barkowsky: JEG Overview
Overview PVS HRC Subjective Experiment SRC PCAP MOS PCAP Parsing HMIX1 Annex-B H.264 Parsing HMIX2 Hybrid Model Training /Validation Objective Score Marcus Barkowsky: JEG Overview
Common working system • Easy installation and portability • Everything inside a VirtualBox Installation of „Computer“ within 5 minutes • Linux operating system to avoid licensing issues • All necessary video/image tools included • Data is stored on the host system • Purpose • HRC generation • graphical user interface • common scenarios predefined • easy distribution of work over a set of computers • HMIX generation • Hybrid model execution • Training • Evaluation of model performance Marcus Barkowsky: JEG Overview
Virtual Box Image coverage PVS HRC Subjective Experiment SRC PCAP MOS PCAP Parsing HMIX1 Annex-B H.264 Parsing HMIX2 Hybrid Model Training /Validation Objective Score Marcus Barkowsky: JEG Overview
Individual presentations • Nicolas: HRC generation system • Lucjan: Generation of Annex-B and HMIX1 from PCAP • Nicolas: Generation of HMIX2 from Annex-B • Savvas, Marcus: Overview of a hybrid model Marcus Barkowsky: JEG Overview
Open problems • Software development for the Hybrid model: • Advantages of common data format • Free choice of programming language for each lab • Non-open-source program parts possible • No software coordinator necessary • Implicit caching structure • Advantages of a common source code • Easy to apply to images • The reference software may become normative Marcus Barkowsky: JEG Overview
Open problems • HRC generation • Automatic network configuration • Graphical user interface • Update and synchronisation of software • Definition of common format for video databases • Search for golden sample video sequences (~10), and silver samples (~100) • HRC checking (and recalibration) programs Marcus Barkowsky: JEG Overview
