Digital Humanities Workshop: From Manual Annotation to Machine Learning

Using a real-world scenario in reception research (identification and classification of evaluative passages in book reviews) to give participants experience with manual annotation & machine learning

Dr Simone Rebora, Associate Professor of Comparative Literature (University of Verona).

The workshop will use a real-world scenario in reception research (the identification and classification of evaluative passages in book reviews) to give participants experience with manual annotation and machine learning. There will be two sessions, both combining theory and hands-on activities. The first part will focus on manual annotation, presenting different tools and discussing topics including annotation guidelines, inter-rater agreement, and dataset curation.

The second part will build upon the results of the first, showing how (1) annotated datasets can be used to train machine learning algorithms and (2) annotation guidelines can be adapted to “instruct” Large Language Models such as ChatGPT, Llama2, and Gemini.
 

For further information:

Olivia Santovetti (o.santovetti@leeds.ac.uk)

Laura Lucia Rossi (l.l.rossi@leeds.ac.uk)

Alessio Baldini (a.baldini@leeds.ac.uk