OpenAI Whisper and it’s amazing power to do finetuning demonstrated on my Mother tongue

Talk Page for my talk @ Pycon India 2023, Hyderabad

conference
pycon
Audio
Deep learning
SMC
Talk Page
Python
Author

Kurian Benoy

Published

Sunday, October 1, 2023

Talk in 30 seconds

I talked about what is OpenAI whisper and some of it’s amazing feature. I highlighted the importance of fine-tuning Whisper in low-resource language like Malayalam which is able to get almost 90% accuracy compared to -10% accuracy of OpenAI whisper model weights. The results where calculated with a new github project called malayalam_asr_benchmarking created by me.

Pictures

Kurian speaking in pycon India Full view of Kurian speaking with the large screen

Tweets