Evaluating an agent-based software maintenance knowledge management system (KMS) tool

Abdullah, Rusli (2011) Evaluating an agent-based software maintenance knowledge management system (KMS) tool. In: Pasific Rim Objective Measurement Symposium 2011, 13-15 July 2011, Nanyang Technological University, Singapore.

[img] PDF
Restricted to Repository staff only

831Kb

Abstract

Background: Software maintenance (SM) environment is highly complex,knowledge-driven and collaborative. Therefore, a knowledge Management System (KMS) is critical to provide an environment for sharing and sustaining knowledge among members of SM community of practice (CoP). An agent-based KMS prototype system called Software Maintenance Collaborative Agent Team (SCAT) was developed based on a new KMS framework, to assisst maintainers to share information and perform their SM activities. Aims: The aim of this study is to evaluate SCAT'ssuccess as a KMS tool against another existing similar tool called Rodriguez KMS SCAT was benchmark against another agent-based KMS prototype. We hypothesize that the extent of KMS success of SCAT is better than Rodriguez KMS Sample: A total of 15 users and maintainers took part in the evaluation of both tools and survey, consisting of 3 users, 6 helpdesk personnel, 8 developers, 2 systems analyst, a maintenance manager and a quality assurance analyst. Some SA and developers also doubled as helpdesk personnel, hence the extra numbers. Method: A survey was conducted to gauge the responses of users and maintainers on the success of both KMS tools, covering system quality,knowledge quality, user satisfaction, perceived KMS benefits and system use. The result of the survey are analyzed using Rasch rating-scale model to determine if SCAT fares better than Rodriguez model.Two Winsteps sessions were used, with person means set to 0. T-Test was used to compare both tools measure means and Common Person Equating plot and Measure Difference chart are used to further explain the results. Results:Based on t-test, we cannot conclude that SCAT KMS is better than Rodriguez KMS. However, in several important aspects such as Effectively Managing Knowledge, Improves Quality, and Efficient, SCAT fares significantly better. Rodriguez strong point is in decision making. Conclusion: Rasch could be utilized to effectively evaluate two KMS tools vis-a-vis a questionnaire survey. In our case, even though SCAT could not be concluded better than the benchmarked KMS tool, the analysis managed to identify several strong and weak key areas. As such, in future, SCAT could be enhanced to improve the meak areas.

Item Type:Conference or Workshop Item (Paper)
Keyword:Knowledge Management System, Software Maintenance, Multi-Agent System
Subject:Knowledge management -- Study and teaching.
Subject:Software maintenance.
Faculty or Institute:Faculty of Computer Science and Information Technology
ID Code:18458
Deposited By: Erni Suraya Abdul Aziz
Deposited On:05 Jan 2012 01:25
Last Modified:16 Dec 2013 08:39

Repository Staff Only: Edit item detail

Document Download Statistics

This item has been downloaded for since 05 Jan 2012 01:25.

View statistics for "Evaluating an agent-based software maintenance knowledge management system (KMS) tool"


Universiti Putra Malaysia Institutional Repository

Universiti Putra Malaysia Institutional Repository is an on-line digital archive that serves as a central collection and storage of scientific information and research at the Universiti Putra Malaysia.

Currently, the collections deposited in the IR consists of Master and PhD theses, Master and PhD Project Report, Journal Articles, Journal Bulletins, Conference Papers, UPM News, Newspaper Cuttings, Patents and Inaugural Lectures.

As the policy of the university does not permit users to view thesis in full text, access is only given to the first 24 pages only.