Endre søk
RefereraExporteraLink to record
Permanent link

Direct link
Referera
Referensformat
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Annet format
Fler format
Språk
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Annet språk
Fler språk
Utmatningsformat
  • html
  • text
  • asciidoc
  • rtf
Can We quantify domainhood?: Exploring measures to assess domain-specificity in web corpora
RISE - Research Institutes of Sweden, ICT, SICS.ORCID-id: 0000-0002-5737-8149
RISE - Research Institutes of Sweden, ICT, SICS. Linköping University, Sweden.
RISE - Research Institutes of Sweden, ICT, SICS. Linköping University, Sweden.
Örebro University, Sweden.
Vise andre og tillknytning
2018 (engelsk)Inngår i: Commun. Comput. Info. Sci., 2018, s. 207-217Konferansepaper, Publicerat paper (Fagfellevurdert)
Abstract [en]

Web corpora are a cornerstone of modern Language Technology. Corpora built from the web are convenient because their creation is fast and inexpensive. Several studies have been carried out to assess the representativeness of general-purpose web corpora by comparing them to traditional corpora. Less attention has been paid to assess the representativeness of specialized or domain-specific web corpora. In this paper, we focus on the assessment of domain representativeness of web corpora and we claim that it is possible to assess the degree of domain-specificity, or domainhood, of web corpora. We present a case study where we explore the effectiveness of different measures - namely the Mann-Withney-Wilcoxon Test, Kendall correlation coefficient, Kullback–Leibler divergence, log-likelihood and burstiness - to gauge domainhood. Our findings indicate that burstiness is the most suitable measure to single out domain-specific words from a specialized corpus and to allow for the quantification of domainhood.

sted, utgiver, år, opplag, sider
2018. s. 207-217
Emneord [en]
Big data, Data mining, Expert systems, Search engines, Domain specific, Domain specificity, Kendall correlation coefficients, Log likelihood, Modern languages, Specialized corpora, Web Corpora, Wilcoxon test, Information management
HSV kategori
Identifikatorer
URN: urn:nbn:se:ri:diva-35898DOI: 10.1007/978-3-319-99133-7_17Scopus ID: 2-s2.0-85052001976ISBN: 9783319991320 (tryckt)OAI: oai:DiVA.org:ri-35898DiVA, id: diva2:1261499
Konferanse
International Conference on Database and Expert Systems Applications DEXA 2018: Database and Expert Systems Applications pp 207-217
Merknad

Funding text: Acknowledgement. This research was supported by E-care@home, a “SIDUS - Strong Distributed Research Environment” project funded by the Swedish Knowledge Foundation. Project website: http://ecareathome.se/.

Tilgjengelig fra: 2018-11-07 Laget: 2018-11-07 Sist oppdatert: 2019-06-18bibliografisk kontrollert

Open Access i DiVA

Fulltekst mangler i DiVA

Andre lenker

Forlagets fulltekstScopus

Person

Santini, Marina

Søk i DiVA

Av forfatter/redaktør
Santini, Marina
Av organisasjonen

Søk utenfor DiVA

GoogleGoogle Scholar

doi
isbn
urn-nbn

Altmetric

doi
isbn
urn-nbn
Totalt: 12 treff
RefereraExporteraLink to record
Permanent link

Direct link
Referera
Referensformat
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Annet format
Fler format
Språk
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Annet språk
Fler språk
Utmatningsformat
  • html
  • text
  • asciidoc
  • rtf
v. 2.41.0