Skip to content

Commit b627d39

Browse files
committed
Add readme description
1 parent aff0075 commit b627d39

1 file changed

Lines changed: 10 additions & 4 deletions

File tree

README.md

Lines changed: 10 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -21,10 +21,16 @@
2121
</div>
2222

2323
The `manx` toolkit for early Middle English lemmatization is based on data from
24-
the [LAEME](http://www.lel.ed.ac.uk/ihd/laeme2/laeme2.html) corpus. Manx was
25-
developed for research and educational purposes only. It shows how corpus data
26-
from historical languages can be used to fine-tune large language models to
27-
support researchers in their daily work.
24+
the [LAEME](http://www.lel.ed.ac.uk/ihd/laeme2/laeme2.html) corpus.
25+
26+
`manx` lets you fine-tune a ByT5 large language model for the downstream task
27+
of lemmatization of historical, early Middle English texts. The example
28+
fine-tuned `google/byt5-small` model published on
29+
[Huggingface](https://huggingface.co/mdm-code/me-lemmatize-byt5-small) offers
30+
the lemma accuracy of 92.5% for the validation part of the data split from the
31+
LAEME corpus. Manx was developed for research and educational purposes only. It
32+
shows how corpus data from historical languages can be used to fine-tune large
33+
language models to support researchers in their daily work.
2834

2935
The project does not interfere with the copyright statement for LAEME given
3036
[here](http://www.lel.ed.ac.uk/ihd/laeme2/front_page/laeme_copyright.html). The

0 commit comments

Comments
 (0)