Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
Optimizing Signal Management in a Vaccine Adverse Event Reporting System: A Proof-of-Concept with COVID-19 Vaccines Using Signs, Symptoms, and Natural Language Processing
University of Copenhagen, Denmark.
GSK, United Kingdom; London School of Hygiene and Tropical Medicine, United Kingdom.
GSK, United Kingdom.
Uppsala University, Sweden.
Show others and affiliations
2024 (English)In: Drug Safety, ISSN 0114-5916, E-ISSN 1179-1942, Vol. 47, no 2, p. 173-Article in journal (Refereed) Published
Abstract [en]

Introduction: The Vaccine Adverse Event Reporting System (VAERS) has already been challenged by an extreme increase in the number of individual case safety reports (ICSRs) after the market introduction of coronavirus disease 2019 (COVID-19) vaccines. Evidence from scientific literature suggests that when there is an extreme increase in the number of ICSRs recorded in spontaneous reporting databases (such as the VAERS), an accompanying increase in the number of disproportionality signals (sometimes referred to as ‘statistical alerts’) generated is expected. Objectives: The objective of this study was to develop a natural language processing (NLP)-based approach to optimize signal management by excluding disproportionality signals related to listed adverse events following immunization (AEFIs). COVID-19 vaccines were used as a proof-of-concept. Methods: The VAERS was used as a data source, and the Finding Associated Concepts with Text Analysis (FACTA+) was used to extract signs and symptoms of listed AEFIs from MEDLINE for COVID-19 vaccines. Disproportionality analyses were conducted according to guidelines and recommendations provided by the US Centers for Disease Control and Prevention. By using signs and symptoms of listed AEFIs, we computed the proportion of disproportionality signals dismissed for COVID-19 vaccines using this approach. Nine NLP techniques, including Generative Pre-Trained Transformer 3.5 (GPT-3.5), were used to automatically retrieve Medical Dictionary for Regulatory Activities Preferred Terms (MedDRA PTs) from signs and symptoms extracted from FACTA+. Results: Overall, 17% of disproportionality signals for COVID-19 vaccines were dismissed as they reported signs and symptoms of listed AEFIs. Eight of nine NLP techniques used to automatically retrieve MedDRA PTs from signs and symptoms extracted from FACTA+ showed suboptimal performance. GPT-3.5 achieved an accuracy of 78% in correctly assigning MedDRA PTs. Conclusion: Our approach reduced the need for manual exclusion of disproportionality signals related to listed AEFIs and may lead to better optimization of time and resources in signal management. © 2023, The Author(s).

Place, publisher, year, edition, pages
Adis , 2024. Vol. 47, no 2, p. 173-
National Category
Other Medical Engineering Language Technology (Computational Linguistics)
Identifiers
URN: urn:nbn:se:ri:diva-68786DOI: 10.1007/s40264-023-01381-6Scopus ID: 2-s2.0-85178895864OAI: oai:DiVA.org:ri-68786DiVA, id: diva2:1827556
Available from: 2024-01-15 Created: 2024-01-15 Last updated: 2024-05-27

Open Access in DiVA

fulltext(922 kB)33 downloads
File information
File name FULLTEXT01.pdfFile size 922 kBChecksum SHA-512
941cdac8176aef2df4ae68e730f9ea615efbd62d44e9bc8ecb2a8bf12e53f35d670dcff4473a7ecc43de07597e878df0a6552b8fdcbb86c29a032a1d067d0621
Type fulltextMimetype application/pdf

Other links

Publisher's full textScopus

Authority records

Dürlich, Luise

Search in DiVA

By author/editor
Dürlich, Luise
By organisation
Data Science
In the same journal
Drug Safety
Other Medical EngineeringLanguage Technology (Computational Linguistics)

Search outside of DiVA

GoogleGoogle Scholar
Total: 33 downloads
The number of downloads is the sum of all downloads of full texts. It may include eg previous versions that are now no longer available

doi
urn-nbn

Altmetric score

doi
urn-nbn
Total: 171 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf