EASSE: Easier Automatic Sentence Simplification Evaluation - INRIA - Institut National de Recherche en Informatique et en Automatique Accéder directement au contenu
Communication Dans Un Congrès Année : 2019

EASSE: Easier Automatic Sentence Simplification Evaluation

Résumé

We introduce EASSE, a Python package aiming to facilitate and standardise automatic evaluation and comparison of Sentence Simplification (SS) systems. EASSE provides a single access point to a broad range of evaluation resources: standard automatic metrics for assessing SS outputs (e.g. SARI), word-level accuracy scores for certain simplification transformations, reference-independent quality estimation features (e.g. compression ratio), and standard test data for SS evaluation (e.g. TurkCorpus). Finally, EASSE generates easy-to-visualise reports on the various met-rics and features above and on how a particular SS output fares against reference simplifications. Through experiments, we show that these functionalities allow for better comparison and understanding of the performance of SS systems.
Fichier principal
Vignette du fichier
D19-3009.pdf (462.29 Ko) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)
Loading...

Dates et versions

hal-02272950 , version 1 (22-01-2020)

Identifiants

  • HAL Id : hal-02272950 , version 1

Citer

Fernando Alva-Manchego, Louis Martin, Carolina Scarton, Lucia Specia. EASSE: Easier Automatic Sentence Simplification Evaluation. EMNLP-IJCNLP 2019 - Conference on Empirical Methods in Natural Language Processing and 9th International Joint Conference on Natural Language Processing (demo session), Nov 2019, Hong Kong, China. pp.49-54. ⟨hal-02272950⟩

Collections

INRIA INRIA2
83 Consultations
226 Téléchargements

Partager

Gmail Facebook X LinkedIn More