This work presents MarIA, a family of Spanish language models and associated resources
made available to the industry and the research community. Currently, MarIA includes …

The project LE-SIMPLE is an innovative attempt at building harmonized syntacticsemantic
lexicons for twelve European languages, intended for use in different Human Language …

This article deals with the problem of Cross-Lingual Text Categorization (CLTC), which
arises when documents in different languages must be classified according to the same …

One of the biomedical entity types of relevance for medicine or biosciences are chemical
compounds and drugs. The correct detection these entities is critical for other text mining …

This work presents the first large-scale biomedical Spanish language models trained from
scratch, using large biomedical corpora consisting of a total of 1.1 B tokens and an EHR …

There is an increasing interest in exploiting the content of electronic health records by
means of natural language processing and text-mining technologies, as they can result in …

This work presents biomedical and clinical language models for Spanish by experimenting
with different pretraining choices, such as masking at word and subword level, varying the …

Word embeddings are representations of words in a dense vector space. Although they are
not recent phenomena in Natural Language Processing (NLP), they have gained momentum …

Multilingual language models have been a crucial breakthrough as they considerably reduce
the need of data for under-resourced languages. Nevertheless, the superiority of language-…

This paper presents the Spanish RoBERTa-base and RoBERTa-large models, as well as
the corresponding performance evaluations. Both models were pre-trained using the largest …