<< List of all deliverables

D2.2.2: Speech recognition for L2 update

Project: FIN-CLARIAH
Grant agreement: Academy of Finland no. 345610
Start date: 01-01-2022
Duration: 24 months

WP 2.2: Report on Speech recognition for L2
Date of reporting: 2023-11

Report author: Yaroslav Getman (Aalto University)
Contributors: Getman, Y., Phan, N., Al-Ghezi, R., Voskoboinik, E., Singh, M., Grosz, T., Clara, A., Kurimo, M. (Aalto University); Salvi, G., Svendsen, T. (Norwegian University of Science and Technology); Strömbergsson, S. (Karolinska Institutet); Smolander, A., Ylinen, S. (Tampere University); von Zansen, A., Hilden, R., Linden, K. (University of Helsinki); Kallio, H., Kuronen, M., Huhta, A., Kronholm, S. (University of Jyväskylä)

Deliverable location: Aalto Speech Research | Multi-task wav2vec2

Description

Systems trained to perform automatic speech recognition (ASR) and pronunciation rating for child L2 Finnish are available on HuggingFace Hub. The links to the models are collected on this GitHub page and the methods are described in [1] and [2].

ASR systems for L2 learners of Finnish are described in [3] and [4]. The scripts used to train the models are available on this GitHub page and the data will be released in Kielipankki here and here.

References

[1] Getman, Y., Al-Ghezi, R., Grosz, T., Kurimo, M. (2023) Multi-task wav2vec2 Serving as a Pronunciation Training System for Children. Proc. 9th Workshop on Speech and Language Technology in Education (SLaTE), 36-40, doi: 10.21437/SLaTE.2023-8
[2] Getman, Y., Phan, N., Al-Ghezi, R., Voskoboinik, E., Singh, M., Grosz, T., Kurimo, M., Salvi, G., Svendsen, T., Strömbergsson, S., Smolander, A., Ylinen, S. (2023) Developing an AI-Assisted Low-Resource Spoken Language Learning App for Children. IEEE Access, vol. 11, pp. 86025-86037, 2023, doi: 10.1109/ACCESS.2023.3304274
[3] Kurimo, M., Getman, Y., Voskoboinik, E., Al-Ghezi, R., Kallio, H., Kuronen, M., von Zansen, A., Hilden, R., Kronholm, S., Huhta, A., Linden, K. (2023) New data, benchmark and baseline for L2 speaking assessment for low-resource languages. Proc. 9th Workshop on Speech and Language Technology in Education (SLaTE), 166-170, doi: 10.21437/SLaTE.2023-32
[4] Al-Ghezi, R., Voskoboinik, K., Getman, Y., von Zansen, A., Kallio, H., Clara, A., Kuronen, M., Huhta, A., Hilden, R. (in review) Automatic speaking assessment of Spontaneus L2 Finnish and Swedish. Language Assessment Quarterly.

Search the Language Bank Portal:
Tanja Säily
Researcher of the Month: Tanja Säily

 

Upcoming events


Contact

The Language Bank's technical support:
kielipankki (at) csc.fi
tel. +358 9 4572001

Requests related to language resources:
fin-clarin (at) helsinki.fi
tel. +358 29 4129317

More contact information