This work presents MarIA, a family of Spanish language models and associated resources
made available to the industry and the research community. Currently, MarIA includes …

This work presents the first large-scale biomedical Spanish language models trained from
scratch, using large biomedical corpora consisting of a total of 1.1 B tokens and an EHR …

This work presents biomedical and clinical language models for Spanish by experimenting
with different pretraining choices, such as masking at word and subword level, varying the …

This paper presents the Spanish RoBERTa-base and RoBERTa-large models, as well as
the corresponding performance evaluations. Both models were pre-trained using the largest …

Controversy is a social phenomenon that emerges when a topic generates large disagreement
among people. In the public sphere, controversy is very often related to news. Whereas …

Background: In December 2020, the COVID-19 disease was confirmed in 1,665,775 patients
and caused 45,784 deaths in Spain. At that time, health decision support systems were …

We introduce CoWeSe (the Corpus Web Salud Espa\~nol), the largest Spanish biomedical
corpus to date, consisting of 4.5GB (about 750M tokens) of clean plain text. CoWeSe is the …

There are many Language Models for the English language according to its worldwide
relevance. However, for the Spanish language, even if it is a widely spoken language, there are …

We introduce a new language representation model in finance called Financial Embedding
Analysis of Sentiment (FinEAS). In financial markets, news and investor sentiment are …

In the recent years, transformer-based models have lead to significant advances in language
modelling for natural language processing. However, they require a vast amount of data to …