A Practical Framework for Evaluating the Quality of Knowledge Graphs.

Year:	2019
Title:	A Practical Framework for Evaluating the Quality of Knowledge Graphs.
Abstract:	Surveys existing KG evaluation practices and proposes a practical quality framework. It identifies key dimensions (“fit for purpose”), selects metrics per use-case requirements, and suggests evaluation procedures (e.g., scalable sampling for metrics).
Objectives:	Provide a “fit-for-purpose” quality assessment framework by linking user requirements to specific metrics and scalable evaluation methods.
Methodology:	Literature analysis of prior studies; development of a framework mapping use-case needs to choose quality dimensions and metrics, and recommending feasible evaluation approaches (trade-offs between feasibility and scalability).
Algorithm Used:	—
Top Model:	Conceptual framework
Accuracy:	—
Advantages:	Focuses on practical applicability and scalability of KG QA; covers multiple dimensions guided by requirements.
Drawbacks:	Conceptual (no empirical validation); framework-level only; actual tool or data not provided.
Source:	https://www.researchgate.net/publication/338361155_A_Practical_Framework_for_Evaluating_the_Quality_of_Knowledge_Graph#full-text Edit

Criteria (5)

Name	Description	Definitions
Relevancy	Surveys existing KG evaluation practices and proposes a practical quality framework. It identifies key dimensions (“fit for purpose”), selects metrics …	Quality dimension from A Practical Framework for Evaluating the Quality of Knowledge Graphs. (2019) Surveys existing KG evaluation practices and proposes a practical quality framework. It identifies key dimensions …
Accuracy	Surveys existing KG evaluation practices and proposes a practical quality framework. It identifies key dimensions (“fit for purpose”), selects metrics …	Quality dimension from A Practical Framework for Evaluating the Quality of Knowledge Graphs. (2019) Surveys existing KG evaluation practices and proposes a practical quality framework. It identifies key dimensions …
Completeness	Surveys existing KG evaluation practices and proposes a practical quality framework. It identifies key dimensions (“fit for purpose”), selects metrics …	Quality dimension from A Practical Framework for Evaluating the Quality of Knowledge Graphs. (2019) Surveys existing KG evaluation practices and proposes a practical quality framework. It identifies key dimensions …
Timeliness	Surveys existing KG evaluation practices and proposes a practical quality framework. It identifies key dimensions (“fit for purpose”), selects metrics …	Quality dimension from A Practical Framework for Evaluating the Quality of Knowledge Graphs. (2019) Surveys existing KG evaluation practices and proposes a practical quality framework. It identifies key dimensions …
Value added	Surveys existing KG evaluation practices and proposes a practical quality framework. It identifies key dimensions (“fit for purpose”), selects metrics …	Quality dimension from A Practical Framework for Evaluating the Quality of Knowledge Graphs. (2019) Surveys existing KG evaluation practices and proposes a practical quality framework. It identifies key dimensions …