Structural Quality Metrics to Evaluate Knowledge Graph Quality

Year: 2022
Title: Structural Quality Metrics to Evaluate Knowledge Graph Quality
Abstract: Presents six structural quality metrics (ICR, IPR, CI, IMI, SPA, SPI) to evaluate KGs based on the specificity and active usage of the underlying ontology (structure).
Objectives: To devise a measure to compare KG quality based on the premise that structure (=ontology) is a key factor, moving beyond metrics focused solely on size/distribution.
Methodology: Defined and applied six structural quality metrics to compare six cross-domain KGs (Wikidata, DBpedia, YAGO, Freebase, Google KG, Raftel).
Algorithm Used: Statistical measures of ontology structure (ICR, IPR, CI, IMI, SPA, SPI)
Top Model: Structural Metrics Model
Accuracy: N/A (Structural comparison)
Advantages: Provides a novel viewpoint linking quality directly to schema richness and usage; effective for comparative, high-level assessment.
Drawbacks: Focuses on schema quality (T-box); generally omits instance-level semantic correctness; technical part (formal property definition) can be improved.
Source: https://www.researchgate.net/publication/365616417_Structural_Quality_Metrics_to_Evaluate_Knowledge_Graphs#full-text Edit

Criteria (5)

Name Description Definitions
Consistent representation Presents six structural quality metrics (ICR, IPR, CI, IMI, SPA, SPI) to evaluate KGs based on the specificity and active …
  • Quality dimension from Structural Quality Metrics to Evaluate Knowledge Graph Quality (2022)
  • Presents six structural quality metrics (ICR, IPR, CI, IMI, SPA, SPI) to evaluate KGs based …
Concise representation Presents six structural quality metrics (ICR, IPR, CI, IMI, SPA, SPI) to evaluate KGs based on the specificity and active …
  • Quality dimension from Structural Quality Metrics to Evaluate Knowledge Graph Quality (2022)
  • Presents six structural quality metrics (ICR, IPR, CI, IMI, SPA, SPI) to evaluate KGs based …
Interpretability Presents six structural quality metrics (ICR, IPR, CI, IMI, SPA, SPI) to evaluate KGs based on the specificity and active …
  • Quality dimension from Structural Quality Metrics to Evaluate Knowledge Graph Quality (2022)
  • Presents six structural quality metrics (ICR, IPR, CI, IMI, SPA, SPI) to evaluate KGs based …
Ease of understanding Presents six structural quality metrics (ICR, IPR, CI, IMI, SPA, SPI) to evaluate KGs based on the specificity and active …
  • Quality dimension from Structural Quality Metrics to Evaluate Knowledge Graph Quality (2022)
  • Presents six structural quality metrics (ICR, IPR, CI, IMI, SPA, SPI) to evaluate KGs based …
Structural Consistency Presents six structural quality metrics (ICR, IPR, CI, IMI, SPA, SPI) to evaluate KGs based on the specificity and active …
  • Quality dimension from Structural Quality Metrics to Evaluate Knowledge Graph Quality (2022)
  • Presents six structural quality metrics (ICR, IPR, CI, IMI, SPA, SPI) to evaluate KGs based …
Back to Frameworks Compare with Others