SVC4QoE_Replace_Slice Subjective quality assessment (with ACR-HR method) of VGA videos with simulated transmissions error on H.264/SVC coding

Information
Categories | Quality Assessment / Videos |
---|---|
Processing | H.264 / H.264 SVC |
Quality assessment method | Absolute Category Rating - Hidden Reference |
Resolution | Less than 960x540 |
Created the | 12 Jan 2015 |
Overview
Overview
This database contains 9 contents with for each content, the reference (without processing or degradation) and 14 different HRCs. The HRCs are h264 and h264/SVC with simulated transmission errors. Several error concealments was tested using the h264/SVC capability. There is one spreadsheet with the individual score and the MOS for each video for the results of subjective test using ACR methodology. A text file presents the conditions in which the videos was evaluated.
The contents of this database are VGA (640x480) videos. The display mode is progressive and the frame rate is 60Hz.
Provided data
Videos
The AVI videos are provided in the "Videos" directory. You can play the videos with a standard video player like VLC for example.
Subjective scores
The subjective scores are provided. An Excel file is provided. In this file, a PVS (an AVI video) is associated to a line and an observer to a column. You have access to all individual vote from each observer to each AVI video. The last column is the Mean Opinion Score (MOS).
Hypothetical reference circuits (HRC)
The HRC are h264 and h264/SVC coded with the JSVM coder version 9.18. The AVC and SVC enhancement layer are coded at 600kb/s at 30Hz. The simulated transmission errors occured in the enhancement layer was concealed by several error concealment technics using the base layer information. In the first one, we patch the error slice by the value of the base layer upscaled pixels. In the second one, we switch to the upscaled base layer. Several coding scenarios were used to generate the base layer. There are 4 version of the base layer. The first one is coded at 120kb/s at 15Hz, the second one is coded at 120kb/s at 30Hz, the third one is coded at 200kb/s at 15Hz and the last one is coded at 200kb/s at 30Hz. The upscaled base layer was also evaluated.
HRC | Description |
---|---|
00 | Reference |
01 | H.264 AVC coding at 30fps and coded at 600kb/s with transmission error |
02 | H.264 SVC coding with base layer at 120kb/s and 15fps upscaled to VGA |
03 | H.264 SVC coding with transmission error : the error slices are replaced by the base layer at 15fps and coded at 120kb/s |
04 | H.264 SVC coding with transmission error : the error frames are replaced by the base layer at 15fps and coded at 120kb/s |
05 | H.264 SVC coding with base layer at 120kb/s and 30fps upscaled to VGA |
06 | H.264 SVC coding with transmission error : the error slices are replaced by the base layer at 30fps and coded at 120kb/s |
07 | H.264 SVC coding with transmission error : the error frames are replaced by the base layer at 30fps and coded at 120kb/s |
08 | H.264 SVC coding with base layer at 200kb/s and 15fps upscaled to VGA |
09 | H.264 SVC coding with transmission error : the error slices are replaced by the base layer at 15fps and coded at 200kb/s |
10 | H.264 SVC coding with transmission error : the error frames are replaced by the base layer at 15fps and coded at 200kb/s |
11 | H.264 SVC coding with base layer at 200kb/s and 30fps upscaled to VGA |
12 | H.264 SVC coding with transmission error : the error slices are replaced by the base layer at 30fps and coded at 200kb/s |
13 | H.264 SVC coding with transmission error : the error frames are replaced by the base layer at 30fps and coded at 200kb/s |
14 | H.264 AVC coding at 30fps and coded at 600kb/s |
Experience information
Display | LCD TvLogic LVM401 |
Luminance | 0.1/180cd/m² |
Observation distance | 4H |
Resolution | VGA (640x480) |
Frequency | 30 Hz |
Methodology | ACR |
Duration | 40 minutes |
Number of videos | 135 |
Rejection method | VQEG MM tesplan |
Number of observers | 29 (0 rejected) |
Source publication : Please, cite the following paper(s) in your publications if you use this database in your work
Aligning subjective tests using a low cost common set Y. Pitrey, U. Engelke, M. Barkowsky, R. Pépion, P. Le Callet
Database Download Guide for ftp://ftp.ivc.polytech.univ-nantes.fr/IRCCyN_IVC_SVC4QoE_ReplaceSlice/


Use a FTP Manager to download all files at once
Host | ftp.ivc.polytech.univ-nantes.fr |
---|---|
Port | 21 |
User information | Anonymous |
Directory | IRCCyN_IVC_SVC4QoE_ReplaceSlice/ |
With Filezilla (Windows, Linux, Mac OS)
- Download the FileZilla Client software at https://filezilla-project.org/ and install it.
- Launch File > Sites Manager and fill in the form. The Host is ftp.ivc.polytech.univ-nantes.fr. Use Anonymous for Logon Type. All others fields can be left blank. Finally, press Connect.
- In the first panel, you can see connection's logs. Normally, a message like Response: 220 ftproxy FTP server (Version 1.9.2.4 - 2005/01/11 13:03:28) ready. is printed.
- The left column below contains your computer file system and the selected folder. In the right column, you can see the FTP server file system and its selected folder.
- In the left colum, select the local directory in which receive the database. In the right panel, find IRCCyN_IVC_SVC4QoE_ReplaceSlice/ , right click and press Download.
- Bottom panel shows file transfer informations. All files of the databases are being downloaded in your computer. Please wait during the transfer.
With WGET (Linux)
Copy and paste this command in a terminal :
wget -P your/destination/folder ftp://ftp.ivc.polytech.univ-nantes.fr/IRCCyN_IVC_SVC4QoE_ReplaceSlice/