Annotators-in-the-loop: Testing a Novel Annotation Procedure on Italian Case Law
Contributo in Atti di convegno
Data di Pubblicazione:
2023
Citazione:
Annotators-in-the-loop: Testing a Novel Annotation Procedure on Italian Case Law / E. Zanoli, M. Barbini, D. Riva, S. Picascia, E. Furiosi, S. D'Ancona, C. Chesi - In: Proceedings of the 17th Linguistic Annotation Workshop (LAW-XVII) / [a cura di] J. Prange, A. Friedrich. - [s.l] : Association for Computational Linguistics, 2023. - ISBN 978-1-959429-83-8. - pp. 118-128 (( Intervento presentato al 17. convegno Linguistic Annotation Worksho nel 2023 [10.18653/v1/2023.law-1.12].
Abstract:
The availability of annotated legal corpora is crucial for a number of tasks, such as legal search, legal information retrieval, and predictive justice. Annotation is mostly assumed to be a straightforward task: as long as the annotation scheme is well defined and the guidelines are clear, annotators are expected to agree on the labels. This is not always the case, especially in legal annotation, which can be extremely difficult even for expert annotators. We propose a legal annotation procedure that takes into account annotator certainty and improves it through negotiation. We also collect annotator feedback and show that our approach contributes to a positive annotation environment. Our work invites reflection on often neglected ethical concerns regarding legal annotation.
Tipologia IRIS:
03 - Contributo in volume
Elenco autori:
E. Zanoli, M. Barbini, D. Riva, S. Picascia, E. Furiosi, S. D'Ancona, C. Chesi
Link alla scheda completa:
Link al Full Text:
Titolo del libro:
Proceedings of the 17th Linguistic Annotation Workshop (LAW-XVII)