Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
ClimateEval: A Comprehensive Benchmark for NLP Tasks Related to Climate Change
RISE Research Institutes of Sweden, Digital Systems.ORCID iD: 0000-0002-7020-8275
RISE Research Institutes of Sweden, Digital Systems, Data Science. Uppsala University, SE.ORCID iD: 0009-0007-2792-9345
RISE Research Institutes of Sweden, Digital Systems, Data Science. Uppsala University, SE.ORCID iD: 0000-0002-7873-3971
Uppsala University, SE.ORCID iD: 0000-0002-2032-5211
2025 (English)In: Proceedings of the 2nd Workshop on Natural Language Processing Meets Climate Change (ClimateNLP 2025), Association for Computational Linguistics (ACL) , 2025, p. 194-207Conference paper, Published paper (Refereed)
Abstract [en]

ClimateEval is a comprehensive benchmark designed to evaluate natural language processing models across a broad range of tasks related to climate change.ClimateEval aggregates existing datasets along with a newly developed news classification dataset, created specifically for this release.This results in a benchmark of 25 tasks based on 13 datasets, covering key aspects of climate discourse, including text classification, question answering, and information extraction.Our benchmark provides a standardized evaluation suite for systematically assessing the performance of large language models (LLMs) on these tasks.Additionally, we conduct an extensive evaluation of open-source LLMs (ranging from 2B to 70B parameters) in both zero-shot and few-shot settings, analyzing their strengths and limitations in the domain of climate change.

Place, publisher, year, edition, pages
Association for Computational Linguistics (ACL) , 2025. p. 194-207
National Category
Natural Language Processing
Identifiers
URN: urn:nbn:se:ri:diva-82937DOI: 10.18653/v1/2025.climatenlp-1.13OAI: oai:DiVA.org:ri-82937DiVA, id: diva2:2109859
Conference
2nd Workshop on Natural Language Processing Meets Climate Change (ClimateNLP 2025), Vienna Austria
Note

Funding text: European Commission, Vetenskapsrådet, HORIZON EUROPE Framework Programme

Available from: 2026-10-12 Created: 2026-10-12 Last updated: 2026-10-12Bibliographically approved

Open Access in DiVA

No full text in DiVA

Other links

Publisher's full text

Authority records

Kurfalı, MurathanZahra, ShorouqNivre, Joakim

Search in DiVA

By author/editor
Kurfalı, MurathanZahra, ShorouqNivre, JoakimMessori, Gabriele
By organisation
Digital SystemsData Science
Natural Language Processing

Search outside of DiVA

GoogleGoogle Scholar

doi
urn-nbn

Altmetric score

doi
urn-nbn
Total: 3 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf