Ontology Evaluation Approaches: A Case Study from Agriculture Domain

The quality of an ontology very much depends on its validity. Therefore, ontology validation and evaluation is very important task. However, according to the current literature, there is no agreed method or approach to evaluate an ontology. The choice of

  • PDF / 2,382,670 Bytes
  • 16 Pages / 439.37 x 666.142 pts Page_size
  • 100 Downloads / 198 Views

DOWNLOAD

REPORT


Department of Computer Science, University of Ruhuna, Matara, Sri Lanka [email protected] 2 School of Computing, Engineering and Mathematics, Western Sydney University, Penrith, NSW 2751, Australia [email protected] 3 University of Colombo School of Computing, Colombo 00700, Sri Lanka [email protected]

Abstract. The quality of an ontology very much depends on its validity. Therefore, ontology validation and evaluation is very important task. However, according to the current literature, there is no agreed method or approach to evaluate an ontology. The choice of a suitable approach very much depends on the purpose of validation or evaluation, the application in which the ontology is to be used, and on what aspect of the ontology we are trying to validate or evaluate. We have developed large user centered ontology to represent agricultural information and relevant knowledge in user context for Sri Lankan farmers. In this paper, we described the validation and evaluation procedures we applied to verify the content and examine the applicability of the developed ontology. We obtained expert suggestions and assessments for the criteria used to develop the ontology as well as to obtain user feedback especially from the farmers to measure the ontological commitment. Delphi Method, Modified Delphi Method and OOPS! Web-based tool were used to validate the ontology in terms of accuracy and quality. The implemented ontology is evaluated internally and externally to identify the deficiencies of the artifact in use. An online knowledge base with a SPARQL endpoint was created to share and reuse the domain knowledge. It was also made use of for the evaluation process. A mobile-based application is developed to check user satisfaction on the knowledge provided by the ontology. Since there is no single best or preferred method for ontology evaluation we reviewed various approaches used to evaluate the ontology and finally identified classification for ontology evaluation approaches based on our work. Keywords: Ontology  Evaluation  Validation  Delphi method Mobile-based application  SPARQL endpoint  Agriculture



1 Introduction Quality of an ontology very much depends on its validity. Thus by establishing the validity we can ascertain the quality. After designing the ontology, the contents of the ontology need to be validated; otherwise, defects in the ontology will spread to © Springer International Publishing Switzerland 2016 O. Gervasi et al. (Eds.): ICCSA 2016, Part IV, LNCS 9789, pp. 318–333, 2016. DOI: 10.1007/978-3-319-42089-9_23

A Case Study from Agriculture Domain

319

subsequent design and implementation activities. Therefore an ontology validation process is needed. Such a process will prevent application from using inconsistent, incorrect, redundant information, enhancing the quality of information captured in the ontology. However, according to the current literature, there is no single best or preferred approach to ontology validation and evaluation. The literature on ontology validation and eva