Leaderboard

ASR task

Date Team name Title Devel local (WER) Devel (WER) Test (WER)
1. 2016-09-13 14:26:01 BUT BUT - Babel Kaldi BLSTM 8kHz - LM tune Late submission 12.2
6.4 | 36.0 | 19.1
ELSA | FORVO | RHINOSPIKE
17.6
6.2 | 56.4 | 16.9
ELSA | FORVO | RHINOSPIKE
46.3
4.6 | 52.6 | 32.2 | 84.7
ELSA | FORVO | RHINOSPIKE | YOUTUBE
2. 2016-09-12 09:34:35 BUT test 2 11.7
6.0 | 41.0 | 16.6
ELSA | FORVO | RHINOSPIKE
17.9
6.4 | 58.1 | 15.8
ELSA | FORVO | RHINOSPIKE
48
4.9 | 55.7 | 35.4 | 87.2
ELSA | FORVO | RHINOSPIKE | YOUTUBE
3. 2016-09-13 12:47:28 BUT P BUT - Babel Kaldi BLSTM 8kHz 11.7
6.0 | 41.0 | 16.6
ELSA | FORVO | RHINOSPIKE
17.9
6.4 | 58.1 | 15.8
ELSA | FORVO | RHINOSPIKE
48
4.9 | 55.7 | 35.4 | 87.2
ELSA | FORVO | RHINOSPIKE | YOUTUBE
4. 2016-09-12 16:56:39 NNI NNI Submission Trial3.5 15.1
5.6 | 48.2 | 28.5
ELSA | FORVO | RHINOSPIKE
23
7.3 | 65.3 | 34.6
ELSA | FORVO | RHINOSPIKE
50.5
7.1 | 56.4 | 46.8 | 89.5
ELSA | FORVO | RHINOSPIKE | YOUTUBE
5. 2016-09-12 17:34:30 NNI P-NNI_Submission 15.1
5.6 | 48.2 | 28.5
ELSA | FORVO | RHINOSPIKE
23
7.3 | 65.3 | 34.6
ELSA | FORVO | RHINOSPIKE
50.5
7.1 | 56.4 | 46.8 | 89.5
ELSA | FORVO | RHINOSPIKE | YOUTUBE
6. 2016-09-12 10:27:03 NNI NNI Submission Trial3.2 15.2
5.7 | 48.2 | 28.7
ELSA | FORVO | RHINOSPIKE
23
7.2 | 65.8 | 34.8
ELSA | FORVO | RHINOSPIKE
50.6
7.0 | 57.3 | 47.1 | 89.6
ELSA | FORVO | RHINOSPIKE | YOUTUBE
7. 2016-09-12 14:57:07 ININ ININ submission 13.5
7.7 | 63.3 | 11.3
ELSA | FORVO | RHINOSPIKE
20.5
7.3 | 75.9 | 7.9
ELSA | FORVO | RHINOSPIKE
51.2
5.7 | 72.5 | 25.3 | 91.4
ELSA | FORVO | RHINOSPIKE | YOUTUBE
8. 2016-09-12 18:50:59 ININ P-ININ_Submission 13.5
7.7 | 63.3 | 11.3
ELSA | FORVO | RHINOSPIKE
20.5
7.3 | 75.9 | 7.9
ELSA | FORVO | RHINOSPIKE
51.2
5.7 | 72.5 | 25.3 | 91.4
ELSA | FORVO | RHINOSPIKE | YOUTUBE
9. 2016-08-22 13:27:27 ININ ININ temporary submission 18.4
11.5 | 82.0 | 14.4
ELSA | FORVO | RHINOSPIKE
28.5
14.3 | 89.0 | 14.0
ELSA | FORVO | RHINOSPIKE
58.6
14.3 | 87.3 | 40.3 | 95.4
ELSA | FORVO | RHINOSPIKE | YOUTUBE
10. 2016-09-13 14:24:11 BASELINE BABEL BUT 2014 Surprise language (OpenKWS) system Late submission 39.6
32.6 | 75.5 | 45.3
ELSA | FORVO | RHINOSPIKE
46.4
37.2 | 81.1 | 42.0
ELSA | FORVO | RHINOSPIKE
59.6
36.2 | 73.0 | 67.3 | 77.5
ELSA | FORVO | RHINOSPIKE | YOUTUBE
11. 2016-05-02 16:10:49 BASELINE KALDI Baseline, graphemes, v1 58.8
48.9 | 102.9 | 69.3
ELSA | FORVO | RHINOSPIKE
60.4
45.3 | 99.8 | 73.5
ELSA | FORVO | RHINOSPIKE
75.5
46.7 | 98.1 | 76.2 | 97.1
ELSA | FORVO | RHINOSPIKE | YOUTUBE

Subword task

Date Team name Title Devel local (NMI) Devel (NMI) Test (NMI)
1. 2016-09-13 09:32:06 BUT AUD phone-loop [primary] 12.38
15.09 | 20.05 | 24.55
ELSA | FORVO | RHINOSPIKE
5.08
6.45 | 8.76 | 14.19
ELSA | FORVO | RHINOSPIKE
4.56
5.52 | 9.59 | 18.49 | 7.59
ELSA | FORVO | RHINOSPIKE | YOUTUBE
2. 2016-06-10 15:45:32 BASELINE KALDI Baseline, graphemes, v1 11.65
15.76 | 23.16 | 21.41
ELSA | FORVO | RHINOSPIKE
5.48
7.88 | 10.44 | 13.81
ELSA | FORVO | RHINOSPIKE
4.29
7.49 | 11.25 | 15.99 | 6.35
ELSA | FORVO | RHINOSPIKE | YOUTUBE
NMI - normalized mutual information
WER - word error rate