Leaderboard
ASR task
Date | Team name | Title | Devel local (WER) | Devel (WER) | Test (WER) | |
---|---|---|---|---|---|---|
1. | 2016-09-13 14:26:01 | BUT | BUT - Babel Kaldi BLSTM 8kHz - LM tune Late submission | 12.2 6.4 | 36.0 | 19.1 ELSA | FORVO | RHINOSPIKE |
17.6 6.2 | 56.4 | 16.9 ELSA | FORVO | RHINOSPIKE |
46.3 4.6 | 52.6 | 32.2 | 84.7 ELSA | FORVO | RHINOSPIKE | YOUTUBE |
2. | 2016-09-12 09:34:35 | BUT | test 2 | 11.7 6.0 | 41.0 | 16.6 ELSA | FORVO | RHINOSPIKE |
17.9 6.4 | 58.1 | 15.8 ELSA | FORVO | RHINOSPIKE |
48 4.9 | 55.7 | 35.4 | 87.2 ELSA | FORVO | RHINOSPIKE | YOUTUBE |
3. | 2016-09-13 12:47:28 | BUT | P BUT - Babel Kaldi BLSTM 8kHz | 11.7 6.0 | 41.0 | 16.6 ELSA | FORVO | RHINOSPIKE |
17.9 6.4 | 58.1 | 15.8 ELSA | FORVO | RHINOSPIKE |
48 4.9 | 55.7 | 35.4 | 87.2 ELSA | FORVO | RHINOSPIKE | YOUTUBE |
4. | 2016-09-12 16:56:39 | NNI | NNI Submission Trial3.5 | 15.1 5.6 | 48.2 | 28.5 ELSA | FORVO | RHINOSPIKE |
23 7.3 | 65.3 | 34.6 ELSA | FORVO | RHINOSPIKE |
50.5 7.1 | 56.4 | 46.8 | 89.5 ELSA | FORVO | RHINOSPIKE | YOUTUBE |
5. | 2016-09-12 17:34:30 | NNI | P-NNI_Submission | 15.1 5.6 | 48.2 | 28.5 ELSA | FORVO | RHINOSPIKE |
23 7.3 | 65.3 | 34.6 ELSA | FORVO | RHINOSPIKE |
50.5 7.1 | 56.4 | 46.8 | 89.5 ELSA | FORVO | RHINOSPIKE | YOUTUBE |
6. | 2016-09-12 10:27:03 | NNI | NNI Submission Trial3.2 | 15.2 5.7 | 48.2 | 28.7 ELSA | FORVO | RHINOSPIKE |
23 7.2 | 65.8 | 34.8 ELSA | FORVO | RHINOSPIKE |
50.6 7.0 | 57.3 | 47.1 | 89.6 ELSA | FORVO | RHINOSPIKE | YOUTUBE |
7. | 2016-09-12 14:57:07 | ININ | ININ submission | 13.5 7.7 | 63.3 | 11.3 ELSA | FORVO | RHINOSPIKE |
20.5 7.3 | 75.9 | 7.9 ELSA | FORVO | RHINOSPIKE |
51.2 5.7 | 72.5 | 25.3 | 91.4 ELSA | FORVO | RHINOSPIKE | YOUTUBE |
8. | 2016-09-12 18:50:59 | ININ | P-ININ_Submission | 13.5 7.7 | 63.3 | 11.3 ELSA | FORVO | RHINOSPIKE |
20.5 7.3 | 75.9 | 7.9 ELSA | FORVO | RHINOSPIKE |
51.2 5.7 | 72.5 | 25.3 | 91.4 ELSA | FORVO | RHINOSPIKE | YOUTUBE |
9. | 2016-08-22 13:27:27 | ININ | ININ temporary submission | 18.4 11.5 | 82.0 | 14.4 ELSA | FORVO | RHINOSPIKE |
28.5 14.3 | 89.0 | 14.0 ELSA | FORVO | RHINOSPIKE |
58.6 14.3 | 87.3 | 40.3 | 95.4 ELSA | FORVO | RHINOSPIKE | YOUTUBE |
10. | 2016-09-13 14:24:11 | BASELINE | BABEL BUT 2014 Surprise language (OpenKWS) system Late submission | 39.6 32.6 | 75.5 | 45.3 ELSA | FORVO | RHINOSPIKE |
46.4 37.2 | 81.1 | 42.0 ELSA | FORVO | RHINOSPIKE |
59.6 36.2 | 73.0 | 67.3 | 77.5 ELSA | FORVO | RHINOSPIKE | YOUTUBE |
11. | 2016-05-02 16:10:49 | BASELINE | KALDI Baseline, graphemes, v1 | 58.8 48.9 | 102.9 | 69.3 ELSA | FORVO | RHINOSPIKE |
60.4 45.3 | 99.8 | 73.5 ELSA | FORVO | RHINOSPIKE |
75.5 46.7 | 98.1 | 76.2 | 97.1 ELSA | FORVO | RHINOSPIKE | YOUTUBE |
Subword task
Date | Team name | Title | Devel local (NMI) | Devel (NMI) | Test (NMI) | |
---|---|---|---|---|---|---|
1. | 2016-09-13 09:32:06 | BUT | AUD phone-loop [primary] | 12.38 15.09 | 20.05 | 24.55 ELSA | FORVO | RHINOSPIKE |
5.08 6.45 | 8.76 | 14.19 ELSA | FORVO | RHINOSPIKE |
4.56 5.52 | 9.59 | 18.49 | 7.59 ELSA | FORVO | RHINOSPIKE | YOUTUBE |
2. | 2016-06-10 15:45:32 | BASELINE | KALDI Baseline, graphemes, v1 | 11.65 15.76 | 23.16 | 21.41 ELSA | FORVO | RHINOSPIKE |
5.48 7.88 | 10.44 | 13.81 ELSA | FORVO | RHINOSPIKE |
4.29 7.49 | 11.25 | 15.99 | 6.35 ELSA | FORVO | RHINOSPIKE | YOUTUBE |
NMI - normalized mutual information
WER - word error rate
WER - word error rate