19 May 2022

Intel helps facilitate AI language recognition

In today’s diverse international, multilingual work environment, the ability to accurately transcribe and translate becomes increasingly important. With these datasets, a computer using artificial intelligence can “hear” a spoken word and produce an automatic transcript or translation.

At the annual Conference on Neural Information Processing Systems (NeurIPS), two Intel-supported whitepapers on spoken language datasets were presented. The first paper, The People’s Speech, targets “automatic speech recognition” tasks; the second is Multilingual Spoken Words Corpus (MSWC), which involves “keyword spotting.” Datasets coming out of each project contribute a sizeable volume of rich audio data, and each is among the largest collection available in its class.

Both datasets will be widely available for users. They are licensed with extremely permissive licensing terms, including commercial use.

The MSWC paper is co-authored by Keith Achorn, an AI frameworks engineer in Intel’s Software and Advanced Technology Group (SATG).

The People’s Speech and MSWC projects started in 2018, under the auspices of ML Commons, to identify and chart the 50 most used languages in the world into a single dataset, and then figure out a way to make the data useful. Group members came from Intel, Harvard, Alibaba, Oracle, Landing AI, University of Michigan, Google, Baidu and others.

Both projects utilise “diverse speech,” which means they better represent a natural environment, complete with background noise and informal speech patterns with a mixture of recording equipment in different acoustic environments. This stands apart from highly controlled content such as audiobooks, which are more “sanitised.” Training on diverse speech has been correlated with better accuracy in real-world use.

The People’s Speech project includes tens of thousands of hours of supervised conversational audio. It is now among the world’s largest English speech recognition datasets licensed for academic and commercial usage and is free to download.

MSWC is an audio speech dataset that has more than 300,000 keywords in dozens of languages and can be accessed by smart devices. The MSWC is dataset spans languages spoken by over 5 billion people

Company info: Intel