UPM Institutional Repository

Assessment of the analytic scale of argumentative writing (ASAW)


Nimehchisalem, Vahid and Mukundan, Jayakaran and Rafik-Galea, Shameem and Abd Samad, Arshad (2021) Assessment of the analytic scale of argumentative writing (ASAW). Pertanika Journal of Social Science and Humanities, 29 (spec.3). pp. 1-25. ISSN 0128-7702; ESSN: 2231-8534


The Analytic Scale of Argumentative Writing (ASAW) was developed because of the need for a genre-specific scale to assess English as a Second Language (ESL) university student writers’ argumentative essays. The present study reports the findings of field-testing ASAW. For this purpose, argumentative samples (n = 110) were collected and remote-scored by experienced raters (n = 5) who used ASAW. Overall, moderate to high inter-rater reliability (r = 0.7-0.9), as well as high (r = 0.84-0.92) and moderate to high (r = 0.70-0.77) intrarater reliability coefficients after short (6-week) and long (9-week) rating intervals were obtained, respectively. Some established instruments were used to score the same essays rated using ASAW to test the concurrent validity of the scale. The scores assigned by the raters using the scale demonstrated moderate (r = 0.51) to high (r = 0.77) correlations with the scores awarded using several other standard instruments. The raters who used ASAW were given a questionnaire to evaluate the scale itself, and on average, the results indicated that the raters were highly satisfied with it. It took an average of 5.5 minutes for the raters to evaluate an essay, indicating it was economical. The study has useful implications for refinement of ASAW and development and validation of similar scales and benchmarks in the future.

Download File

[img] Text
01 JSSH(S)-1508-2021.pdf

Download (497kB)

Additional Metadata

Item Type: Article
Divisions: Faculty of Educational Studies
Faculty of Modern Language and Communication
DOI Number: https://doi.org/10.47836/pjssh.29.S3.01
Publisher: Universiti Putra Malaysia Press
Keywords: Analytic scale; Argumentative writing; Assessing writing; English as a second language; Instrument evaluation
Depositing User: Ms. Nuraida Ibrahim
Date Deposited: 27 May 2022 22:44
Last Modified: 27 May 2022 22:44
Altmetrics: http://www.altmetric.com/details.php?domain=psasir.upm.edu.my&doi=10.47836/pjssh.29.S3.01
URI: http://psasir.upm.edu.my/id/eprint/92601
Statistic Details: View Download Statistic

Actions (login required)

View Item View Item