Advances in Natural Language Generation for Indian Languages
1 182
6.3
Microsoft Research335 тыс
Следующее
Популярные
02.11.23 – 5871:07:21
08.02.22 – 10 91817:37Опубликовано 12 июля 2024, 19:29
Speaker: Dr. Raj Dabre
Host: Sunayana Sitaram
Much of recent progress for natural language generation (NLG) has been in the context of English and, in general, high resource languages, however, Indian languages have yet to see similar paradigm shifts despite their speaking population comprising about a fifth of the world's population. Two major constraints are data and compute, and in this talk, I will touch on both. I will begin with our earliest work on IndicBART, which leveraged monolingual data and helped overcome resource scarcity of Indian languages as measured on the IndicNLG benchmark. I will then highlight three recent works, two focusing on overcoming data scarcity via mass crawling, cleaning and synthetic data creation with the third focusing on compute scarcity via leveraging romanization alongside an existing strong English LLM. This will hopefully lead to discussions which will help push the boundary of language modeling and NLG for Indian languages.
See more at microsoft.com/en-us/research/v...
Host: Sunayana Sitaram
Much of recent progress for natural language generation (NLG) has been in the context of English and, in general, high resource languages, however, Indian languages have yet to see similar paradigm shifts despite their speaking population comprising about a fifth of the world's population. Two major constraints are data and compute, and in this talk, I will touch on both. I will begin with our earliest work on IndicBART, which leveraged monolingual data and helped overcome resource scarcity of Indian languages as measured on the IndicNLG benchmark. I will then highlight three recent works, two focusing on overcoming data scarcity via mass crawling, cleaning and synthetic data creation with the third focusing on compute scarcity via leveraging romanization alongside an existing strong English LLM. This will hopefully lead to discussions which will help push the boundary of language modeling and NLG for Indian languages.
See more at microsoft.com/en-us/research/v...
Свежие видео
8 дней – 9 0082:17
16 дней – 3 45112:05
19 дней – 7710:17
20 дней – 5221:00
23 дня – 131 1058:43Случайные видео
298 дней – 2 2781:41
337 дней – 9 603 4359:54
04.12.23 – 47 1600:58
19.06.23 – 9392:46
12.04.20 – 4 192 00316:34
2 дня – 28 00512:55
6 дней – 1 398 1599:57
7 дней – 340 32711:22
7 дней – 1 824 97110:16
10 дней – 2060:58
1 день – 102 7540:38
4 дня – 18 1872:02