File tree Expand file tree Collapse file tree
Expand file tree Collapse file tree Original file line number Diff line number Diff line change 2121</div >
2222
2323The ` manx ` toolkit for early Middle English lemmatization is based on data from
24- the [ LAEME] ( http://www.lel.ed.ac.uk/ihd/laeme2/laeme2.html ) corpus. Manx was
25- developed for research and educational purposes only. It shows how corpus data
26- from historical languages can be used to fine-tune large language models to
27- support researchers in their daily work.
24+ the [ LAEME] ( http://www.lel.ed.ac.uk/ihd/laeme2/laeme2.html ) corpus.
25+
26+ ` manx ` lets you fine-tune a ByT5 large language model for the downstream task
27+ of lemmatization of historical, early Middle English texts. The example
28+ fine-tuned ` google/byt5-small ` model published on
29+ [ Huggingface] ( https://huggingface.co/mdm-code/me-lemmatize-byt5-small ) offers
30+ the lemma accuracy of 92.5% for the validation part of the data split from the
31+ LAEME corpus. Manx was developed for research and educational purposes only. It
32+ shows how corpus data from historical languages can be used to fine-tune large
33+ language models to support researchers in their daily work.
2834
2935The project does not interfere with the copyright statement for LAEME given
3036[ here] ( http://www.lel.ed.ac.uk/ihd/laeme2/front_page/laeme_copyright.html ) . The
You can’t perform that action at this time.
0 commit comments