Litmus Predictor

780
16.3
Опубликовано 29 октября 2021, 14:46
LITMUS: Linguistically Inspired Training and testing of MUltilingual Systems

LITMUS Predictor provides support for simulating performance in ~100 languages given training observations of the desired task-model. Each training observation specifies the finetuning data size + test-performance in different languages.

Further, the tool provides support for constructing a data collection strategy to maximize performance in desired targets subject to different constraints.

Project – microsoft.com/en-us/research/p...
Demo – microsoft.github.io/Litmus
Codebase – github.com/microsoft/Litmus
автотехномузыкадетское