LVMED: Dataset of Latvian text normalisation samples for the medical domain

  Authors

Lasmanis, Viesturs Jūlijs and Grūzītis, Normunds

  Item identifier

http://hdl.handle.net/20.500.12574/85

 Project URL

https://gitlab.com/ailab/lvmed

 Demo URL

https://huggingface.co/AiLab-IMCS-UL/lvmed

 Date issued

2023-05

 Type

corpus, text

 Size

79834 sentences

 Language(s)

Latvian

 Description

The CSV dataset contains sentence pairs for a text-to-text transformation task: given a sentence that contains 0..n abbreviations, rewrite (normalize) the sentence in full words (word forms). Training dataset: 64,665 sentence pairs Validation dataset: 7,185 sentence pairs. Testing dataset: 7,984 sentence pairs. All sentences are extracted from a public web corpus (https://korpuss.lv/id/Tīmeklis2020) and contain at least one medical term.

 Publisher

AiLab IMCS UL

 Acknowledgement

Recovery and Resilience Facility (RRF)

Project code: 2.3.1.1.i.0/1/22/I/CFLA/002

Project name: Language Technology Initiative

 Subject(s)

medical domain text normalization

 Collection(s)

Language resources and tools of AiLab IMCS UL

Show full item record