Your navigator is out-of-date
Our fonctionnalites cannot works well or create some bugs. Please use a more recent version (at least Internet Explorer 8) or an other navigator
SVC4QoE_Temporal_Switch Subjective quality scores (using ACR-HR) for videos switching between 2 qualities
Menu
Information
| Categories | Quality Assessment / Videos |
|---|---|
| Processing | H.264 / H.264 SVC |
| Quality assessment method | Absolute Category Rating - Hidden Reference |
| Resolution | Less than 960x540 |
| Created the | 12 Jan 2015 |
Overview
This database contains 11 contents with for each content, the reference (without processing or degradation) and 36 different HRCs. The HRCs are h264 and h264/SVC. Several switching conditions were created between the base layer and the enhancement layer. There is one spreadsheet with the individual score and the MOS for each video for the results of subjective test using ACR methodology. A text file presents the conditions in which the videos was evaluated.
The contents of this database are VGA (640x480) videos. The display mode is progressive and the frame rate is 60Hz.
Provided data
Videos
The AVI videos are provided in the "Videos" directory. You can play the videos with a standard video player like VLC for example.
Subjective scores
An Excel file is provided. In this file, a PVS (an AVI video) is associated to a line and an observer to a column. You have access to all individual vote from each observer to each AVI video.
The last column is the Mean Opinion Score (MOS).
The subjective experiment were done in 2 sessions. You can used the results of the session A or the session B (see the first column of the Excel file). The better is to used both : it will reduce the standard deviation and so the confidence interval.
All results are in the Excel file. In the first column, you can find the session of the test (A or B) where the current video was included. In the second column, you can find the name of the video. You can see, it misses src06 and src12 and hrc01, hrc03, hrc13, hrc14, hrc21 and hrc30. These videos were removed after a pretest because of a poor interest.
Hypothetical Reference Circuits (HRC)
The HRC are h264 and h264/SVC coded with the JSVM coder version 9.18. The AVC and SVC layers are coded at different QP values at 30Hz. Some videos are the combinaison of the enhancement layer and the base layer upscaled by switching between the layers in different ways.
QP0 is the QP of the base layer and QP1 is the QP of the enhancement layer. The video is a switch between the 2 layers (the base layer is upscale from QVGA to VGA). The number of frame is the number of frames displayed for each layer. The first one is always the enhancement layer.
| HRC | QP of the base layer | QP of the enhancement layer | HRC name |
|---|---|---|---|
| 00 | Reference | ||
| 02 | 44 | 32 | 49/56/8/56/8/56/8/56/63 |
| 04 | 38 | 32 | 49/32/32/32/32/32/32/32/87 |
| 05 | 38 | 32 | 177/128/55 |
| 06 | 44 | 32 | 113/8/8/8/128/8/87 |
| 07 | 44 | 32 | 113/8/32/8/32/8/159 |
| 08 | 38 | 32 | 177/64/119 |
| 09 | 44 | 32 | 177/32/16/32/103 |
| 10 | 38 | 32 | 113/32/128/32/55 |
| 11 | 44 | 32 | 113/64/64/64/55 |
| 12 | 44 | 32 | 177/8/8/8/8/8/143 |
| 15 | 44 | 32 | 177/64/119 |
| 16 | 38 | 32 | 113/64/64/64/55 |
| 17 | 44 | 32 | 177/32/151 |
| 18 | 44 | 32 | 177/8/8/8/159 |
| 19 | 44 | 32 | 177/8/16/8/151 |
| 20 | 44 | 32 | 113/32/128/32/55 |
| 22 | 44 | 32 | 177/16/167 |
| 23 | 44 | 32 | 113/8/128/8/103 |
| 24 | 44 | 32 | 177/2/181 |
| 25 | 44 | 32 | 177/8/175 |
| 26 | 44 | 32 | 177/2/16/2/163 |
| 27 | 44 | 32 | 177/2/128/2/51 |
| 28 | 38 | 32 | 177/8/8/8/159 |
| 29 | 38 | 32 | 177/16/167 |
| 31 | AVC coding with QP = 32 | ||
| 32 | AVC coding with QP = 38 | ||
| 33 | AVC coding with QP = 44 | ||
| 34 | AVC coding at 600kb/s with transmission errors | ||
| 35 | SVC coding with trnasmission error in the enhancement layer : the error frames are replaced by the base layer at 15Hz and coded at 120kb/s | ||
| 36 | SVC coding with trnasmission error in the enhancement layer : the error slices are replaced by the base layer at 30Hz and coded at 200kb/s | ||
| 37 | SVC coding with base layer QP = 32 and enhancement layer QP = 44 | ||
| 38 | SVC coding with base layer QP = 44 and enhancement layer QP = 32 | ||
| 39 | AVC coding with QP = 44 in QVGA upscaled in VGA | ||
| 40 | AVC coding with QP = 38 in QVGA upscaled in VGA | ||
| 41 | SVC coding with base layer QP = 38 and enhancement layer QP = 32 |
Experience information
The alignment of the 2 parts of the test was checked by check the result of a pool of identical videos put in the 2 parts. The test is composed by 2 parts. To be sure to do not have any context effect, the combination of SRC (source content) and HRC (version) are cross distribute in the 2 parts of the test. Some PVS (Processed Video Sequence or video under test) are in the both part. These videos were used to check the good "alignment" of the 2 parts.
| Display | LCD TvLogic LVM401 |
| Luminance | 0.1/180cd/m² |
| Observation distance | 4H |
| Resolution | VGA (640x480) |
| Frequency | 30 Hz |
| Methodology | ACR |
| Duration | 2x60 minutes |
| Number of videos | 390 |
| Rejection method | VQEG MM tesplan |
| Number of observers | 28 (0 rejected) |
Related pages
Source publication : Please, cite the following paper(s) in your publications if you use this database in your work
Subjective quality of svc-coded videos with different error-patterns concealed using spatial scalability Y. Pitrey, U. Engelke, P. Le Callet, M. Barkowsky, R. Pépion
Conference paperThird European Workshop on Visual Information Processing (EUVIP), Aug 2011, Paris, France
Aligning subjective tests using a low cost common set Y. Pitrey, U. Engelke, M. Barkowsky, R. Pépion, P. Le Callet
Conference paperEuro ITV, Jun 2011, Lisbonne, Portugal
Database Download Guide for ftp://ftp.ivc.polytech.univ-nantes.fr/IRCCyN_IVC_SVC4QoE_Temporal_Switch/
Use a FTP Manager to download all files at once
| Host | ftp.ivc.polytech.univ-nantes.fr |
|---|---|
| Port | 21 |
| User information | Anonymous |
| Directory | IRCCyN_IVC_SVC4QoE_Temporal_Switch/ |
With Filezilla (Windows, Linux, Mac OS)
- Download the FileZilla Client software at https://filezilla-project.org/ and install it.
- Launch File > Sites Manager and fill in the form. The Host is ftp.ivc.polytech.univ-nantes.fr. Use Anonymous for Logon Type. All others fields can be left blank. Finally, press Connect.
- In the first panel, you can see connection's logs. Normally, a message like Response: 220 ftproxy FTP server (Version 1.9.2.4 - 2005/01/11 13:03:28) ready. is printed.
- The left column below contains your computer file system and the selected folder. In the right column, you can see the FTP server file system and its selected folder.
- In the left colum, select the local directory in which receive the database. In the right panel, find IRCCyN_IVC_SVC4QoE_Temporal_Switch/ , right click and press Download.
- Bottom panel shows file transfer informations. All files of the databases are being downloaded in your computer. Please wait during the transfer.
With WGET (Linux)
Copy and paste this command in a terminal :
wget -P your/destination/folder ftp://ftp.ivc.polytech.univ-nantes.fr/IRCCyN_IVC_SVC4QoE_Temporal_Switch/
