Inter-Rater Reliability of the Bahasa Malaysia Version of Patient Education Materials Assessment Tool

Abstract

INTRODUCTION: The Patient Education Materials Assessment Tool (PEMAT) is an instrument to evaluate understandability and actionability of patient education materials (PEMs). It has two versions: PEMAT-P for printable materials and PEMAT-A/V for audio-visual materials. The study aimed to determine inter-rater reliability of the Bahasa Malaysia version of PEMAT, designated as PEMAT-P(M) and PEMAT-A/V(M) using percent raw agreement, Fleiss’ kappa and Gwet’s AC1. METHODS: Nine health care workers from various health disciplines involved in provision of patient education at the Ministry of Health facilities were recruited to evaluate 13 printable PEMs and 13 audio-visual PEMs using PEMAT-P(M) and PEMAT-A/V(M) respectively. RESULTS: PEMAT-P(M) and PEMAT-A/V(M) generally showed substantial to almost perfect agreement (percent raw agreement), slight to almost perfect agreement (Fleiss’ kappa), and fair to almost perfect agreement measured (Gwet’s AC1). For PEMAT-P(M) understandability, the range of percent raw agreement, Fleiss’ kappa and Gwet’s AC1 were 0.615 to 0.966, 0.017 to 0.885 and 0.259 to 0.965 respectively. The range of percent raw agreement, Fleiss’ kappa and Gwet’s AC1 for PEMAT-P(M) actionability were 0.697 to 0.983, 0.208 to 0.891 and 0.394 to 0.980 respectively. For PEMAT-A/V(M) understandability, the range of percent raw agreement, Fleiss’ kappa and Gwet’s AC1 were 0.641 to 0.944, 0.012 to 0.904 and 0.397 to 0.931 respectively. The range of percent raw agreement, Fleiss’ kappa and Gwet’s AC1 for PEMAT-A/V(M) actionability were 0.795 to 0.915, 0.247 to 0.658 and 0.651 to 0.908 respectively. CONCLUSION: The PEMAT-P(M) and PEMAT-A/V(M) are reliable instruments for measuring understandability and actionability of Bahasa Malaysia PEMs.

Links

BibTeX (Download)

@proceedings{APCPH-2019-195,
title = {Inter-Rater Reliability of the Bahasa Malaysia Version of Patient Education Materials Assessment Tool},
author = {Wong Siong TingcPH and Norkhafizah Saddki and Wan Nor Arifin},
year  = {2019},
date = {2019-07-22},
urldate = {2019-07-22},
journal = {6th Asia-Pacific Conference on Public Health 2019 Proceedings},
issue = {6},
abstract = {INTRODUCTION: The Patient Education Materials Assessment Tool (PEMAT) is an instrument to evaluate understandability and actionability of patient education materials (PEMs). It has two versions: PEMAT-P for printable materials and PEMAT-A/V for audio-visual materials. The study aimed to determine inter-rater reliability of the Bahasa Malaysia version of PEMAT, designated as PEMAT-P(M) and PEMAT-A/V(M) using percent raw agreement, Fleiss’ kappa and Gwet’s AC1. METHODS: Nine health care workers from various health disciplines involved in provision of patient education at the Ministry of Health facilities were recruited to evaluate 13 printable PEMs and 13 audio-visual PEMs using PEMAT-P(M) and PEMAT-A/V(M) respectively. RESULTS: PEMAT-P(M) and PEMAT-A/V(M) generally showed substantial to almost perfect agreement (percent raw agreement), slight to almost perfect agreement (Fleiss’ kappa), and fair to almost perfect agreement measured (Gwet’s AC1). For PEMAT-P(M) understandability, the range of percent raw agreement, Fleiss’ kappa and Gwet’s AC1 were 0.615 to 0.966, 0.017 to 0.885 and 0.259 to 0.965 respectively. The range of percent raw agreement, Fleiss’ kappa and Gwet’s AC1 for PEMAT-P(M) actionability were 0.697 to 0.983, 0.208 to 0.891 and 0.394 to 0.980 respectively. For PEMAT-A/V(M) understandability, the range of percent raw agreement, Fleiss’ kappa and Gwet’s AC1 were 0.641 to 0.944, 0.012 to 0.904 and 0.397 to 0.931 respectively. The range of percent raw agreement, Fleiss’ kappa and Gwet’s AC1 for PEMAT-A/V(M) actionability were 0.795 to 0.915, 0.247 to 0.658 and 0.651 to 0.908 respectively. CONCLUSION: The PEMAT-P(M) and PEMAT-A/V(M) are reliable instruments for measuring understandability and actionability of Bahasa Malaysia PEMs.},
note = {Type: POSTER PRESENTATION; Organisation: School of Dental Sciences, Universiti Sains Malaysia (USM), Health Campus, Kubang Kerian, Kelantan, Malaysia, Unit of Biostatistics and Research Methodology, School of Medical Sciences, USM, Health Campus, Kubang Kerian, Kelantan, Malaysia},
keywords = {inter-rater reliability, Malaysia, patient education, psychometrics},
pubstate = {published},
tppubtype = {proceedings}
}