Visual Sign Language Datset
Introduction
The Visual Sign Language dataset consists of synchronized and calibrated multiview video data of two sign languages: VGT(Flemish) and DSGS(Swiss-German). We captured general movements and facial expression to aid the creation of realistic virtual signers for the EU project Content4All. Additionally, we captured a database of actual sign language that consists of real weather forecasts and phrases that are related to weather forecasts. For each shot, we can provide a written version of the signed content. In order to provide suitable data for high quality face model, all sign language shots are available with manuals and without manuals to ensure that the signer’s face is not occluded by her hands.
Acquisition
Setup: We used a multiview-stereo setup consisting of 16 stereo pairs (32 cameras) to capture each signer from 16 different viewpoints. In order to increase the quality of reconstructed 3D geometry and texture, both signers have been captured under diffuse light.
The following tables contain technical dataset details, a preview of each stereo-camera viewpoint followed by a description of captured sequences for both datasets (VGT and DSGS).
| General Dataset Details | ||
|---|---|---|
| VGT | DSGS | |
| Frame dimensions [px] | 5120x3840 | 5120x3840 |
| codec | H264 | H264 |
| container | MP4 | MP4 |
| min/avg/max take length [sec] | 22/75/183 | 23/90/163 |
| total length [sec] | 667 | 1004 |
| number of takes | 10 | 11 |
| total number of video files | 320 | 352 |
| VGT | DSGS | ||||
|---|---|---|---|---|---|
 |  | ||||
| ID | Length[mm:ss] | Content | ID | Length[mm:ss] | Content |
| T010 | 00:33 | T-Pose and general body movements | T009 | 00:43 | T-Pose and general body movements |
| T011 | 01:45 | 60 handshapes | T012 | 02:30 | 60 handshapes |
| T018 | 00:22 | Walking a circle | T015 | 00:30 | Walking a circle |
| T020 | 00:44 | General mouth expressions | T018 | 00:50 | General mouth expressions |
| T022 | 00:47 | General eye expressions | T021 | 00:23 | General eye expressions |
| T027 | 01:21 | Visemes | T028 | 02:42 | Visemes |
| T036 | 01:11 | Forecast I(with/without manuals) | T036 | 01:27 | Phrases I(with manuals) |
| T042 | 01:17 | Forecast II(with/without manuals) | T038 | 01:39 | Phrases I(without manuals) |
| T045 | 03:03 | Phrases I(with/without manuals) | T044 | 01:44 | Phrases II(with/without manuals) |
| T049 | 02:06 | Phrases II(with/without manuals) | T049 | 02:43 | Forecast(with manuals) |
| T053 | 02:42 | Forecast(without manuals) | |||
Data Preview
| VGT | ||
|---|---|---|
| T010 |  |
preview |
| T011 |  |
preview |
| T018 |  |
preview |
| T020 |  |
preview |
| T022 |  |
preview |
| T027 |  |
preview |
| T036 |  |
preview |
| T042 |  |
preview |
| T045 |  |
preview |
| T049 |  |
preview |
| DSGS | ||
|---|---|---|
| T009 |  |
preview |
| T012 |  |
preview |
| T015 |  |
preview |
| T018 |  |
preview |
| T021 |  |
preview |
| T028 |  |
preview |
| T036 |  |
preview |
| T038 |  |
preview |
| T044 |  |
preview |
| T049 |  |
preview |
| T053 |  |
preview |
Requesting the data
Please send an e-mail to P. Eisert (peter.eisert@hhi.fraunhofer.de) to request access to the database.
Acknowledgments
This work has partly been funded by the European Union’s Horizon 2020 research and innovation programme under grant agreement No 762021 (Content4All).