Your navigator is out-of-date
Our fonctionnalites cannot works well or create some bugs. Please use a more recent version (at least Internet Explorer 8) or an other navigator
SD_vs_HD_H264 Quality assessment of HD and SD video contents using Pair Comparison
Menu
Information
| Categories | Quality Assessment / Videos |
|---|---|
| Processing | H.264 |
| Quality assessment method | Pair Comparison |
| Resolution | 1920x1080 / Between 1920x1080 and 960x540 |
| Created the | 12 Jan 2015 |
Presentation & Goal
The IRCCyN IVC SD vs HD H.264 quality database contains 28 HD and 8 QHD video sequences of 10 seconds at 25 frames per second. MOS scores obtained by a comparative method with adjectival categorical judgment (pair comparison with 7 categories) experiment are provided.
Four different sequences, come from SVT, are considered in this database. The sequences are New Mobile & Calendar, Parkrun, Shields and Stockholm Pan. For the HD contents, seven H.264 bitrate were selected in a expert pretest to well cover the complete range of quality. For the SD versions, only two versions is selected (good and excellent quality).
Initial goal
This database was done to compare different resolution. Because no such experiments have been normalized yet to compare video sequences from different resolution, the authors define a new methodology.
Possible usage
This video quality database can be used to evaluate a video quality metric in a scalability context or to work on multiple resolution issues.
Dataset description
A specific protocol have been designed for these tests. The protocol is derived from the comparative method with adjectival categorical judgement described in the BT.500-11 ITU Recommandation.
| Caption to choose | Value stored |
|---|---|
| I prefer much more A than B | +3 |
| I prefer more A than B | +2 |
| I prefer a little more A than B | +1 |
| I have no preference | 0 |
| I prefer a little less A than B | -1 |
| I prefer less A than B | -2 |
| I prefer much less A than B | -3 |
We provide a spreadsheet with the Mean Opinion Score (MOS) for each of the Pair comparison between the HD and the SD version.
The PVS (yuv videos) are available on our FTP server and are in the YUV420 format.
The information about the source contents, video tested generation, subjective experiment environment and available data are provided in a description file.
Source contents (SRC)
Source number |
Source name |
Preview |
Description |
|---|---|---|---|
| 01 | New Mobile and Calendar HD |  |
Description : Calendar zoom-out and discovering a miniature train. Author : Sveriges Television AB (SVT). Link |
| 02 | ParkRun |  |
Description : A man running in a snow covered park with an umbrella. Author : Sveriges Television AB (SVT). Link |
| 03 | Shields |  |
Description : A man walking and showing shields during a camera pan. Author : Sveriges Television AB (SVT). Link |
| 04 | OldTown |  |
Description : Sky view of Stockholm. Author : Sveriges Television AB (SVT). Link |
Copyrights
Individuals and organizations extracting sequences from this archive agree that the sequences and all intellectual property rights therein remain the property of Sveriges Television AB (SVT), Sweden. These sequences may only be used for the purpose of developing, testing and presenting technology standards. SVT makes no warranties with respect to the materials and expressly disclaim any warranties regarding their fitness for any purpose.
Hypothetical Reference Circuits (HRC)
The HRC consist of H.264 coding with the JM coder version 7.5. The bitrates are not fixed for all contents but vary depending on the content complexity. The bitrates were selected such that a minimum quality level for typical HDTV scenarios is guaranteed.
HRC Number |
Description |
|---|---|
| 01 | H.264 coding targetting very low quality by expert pretest. |
| 02 | H.264 coding targetting low quality by expert pretest. |
| 03 | H.264 coding targetting medium quality by expert pretest |
| 04 | H.264 coding targetting medium-high quality by expert pretest. |
| 05 | H.264 coding targetting high quality by expert pretest. |
| 06 | H.264 coding targetting very high quality by expert pretest. |
| 07 | H.264 coding targetting excellent quality by expert pretest. |
| 08 | SD H.264 coding targetting high quality by expert pretest. |
| 09 | SD H.264 coding targetting excellent quality by expert pretest. |
Experience information
Features |
|
|---|---|
| Highlights of this database | HD vs SD |
| New protocol | |
| video quality | |
| Video | |
| Frame frequency | 25Hz |
| Video format | 1920x1080 and 960x540 |
| Video length | 250 frames |
| Video duration | 10 seconds |
| Number of videos | 28 HD + 8 SD |
| Subjective test | |
| Observation distance | 3H (HD) and 6H (SD) |
| Environment | ITU-R BT.500-11 |
| Background luminance | 25cd/m² |
| Methodology | derived from the comparative method with adjectival categorical judgment |
| Duration | 30 minutes |
| Pre screening | Snellen, Ishihara |
| Observers | |
| Number of observers | 21 naives |
| Display | |
| Display | CRT JVC DT-V 1910CG |
| Display resolution | 1080i |
| Display frequency | 50Hz |
| Display mode | interlaced |
| Display luminance max | 70cd/m² |
Related pages
Source publication : Please, cite the following paper(s) in your publications if you use this database in your work
From sd to hd television: effects of h.264 distortions versus display size on quality of experience S. Péchard, M. Carnec, P. Le Callet, D. Barba
Conference paperInternational Conference on Image Processing, Oct 2006, Atlanta, United States
Database Download Guide for ftp://ftp.ivc.polytech.univ-nantes.fr/IRCCyN_IVC_SD_vs_HD_H264/
Use a FTP Manager to download all files at once
| Host | ftp.ivc.polytech.univ-nantes.fr |
|---|---|
| Port | 21 |
| User information | Anonymous |
| Directory | IRCCyN_IVC_SD_vs_HD_H264/ |
With Filezilla (Windows, Linux, Mac OS)
- Download the FileZilla Client software at https://filezilla-project.org/ and install it.
- Launch File > Sites Manager and fill in the form. The Host is ftp.ivc.polytech.univ-nantes.fr. Use Anonymous for Logon Type. All others fields can be left blank. Finally, press Connect.
- In the first panel, you can see connection's logs. Normally, a message like Response: 220 ftproxy FTP server (Version 1.9.2.4 - 2005/01/11 13:03:28) ready. is printed.
- The left column below contains your computer file system and the selected folder. In the right column, you can see the FTP server file system and its selected folder.
- In the left colum, select the local directory in which receive the database. In the right panel, find IRCCyN_IVC_SD_vs_HD_H264/ , right click and press Download.
- Bottom panel shows file transfer informations. All files of the databases are being downloaded in your computer. Please wait during the transfer.
With WGET (Linux)
Copy and paste this command in a terminal :
wget -P your/destination/folder ftp://ftp.ivc.polytech.univ-nantes.fr/IRCCyN_IVC_SD_vs_HD_H264/
