notes/science/ai/attention/fb-roberta.txt
ihar_hancharenka caf1e29165 m
2025-08-29 10:24:09 +03:00

7 строки
262 B
Plaintext

https://github.com/pytorch/fairseq/tree/master/examples/roberta
https://ai.facebook.com/blog/roberta-an-optimized-method-for-pretraining-self-supervised-nlp-systems/
2019
https://www.infoq.com/news/2019/09/facebook-roberta-nlp/
https://arxiv.org/abs/1907.11692