Korean Journal of Family Medicine

Comparison of Patient-Physician Interaction Scores of Clinical Practice Examination between Checklists and Rating Scale: Nam Eun Kim, Hoon Ki Park, Kyong Min Park, Bong Kyung Seo, Kye Yeung Park, Hwan Sik Hwang; Korean J Fam Med 2018;39(2):96-100. Published online March 22, 2018; DOI: https://doi.org/10.4082/kjfm.2018.39.2.96

Abstract
PDF

Background

The clinical practice examination (CPX) was introduced in 2010, and the Seoul-Gyeonggi CPX Consortium developed the patient-physician interaction (PPI) assessment tool in 2004. Both institutions use rating scales on classified sections of PPI but differ in their scoring of key components. This study investigated the accuracy of standardized patient scores across rating scales by comparing checklist methods and verified the concurrent validity of two comparable PPI rating tools.

Methods

An educational CPX module dyspepsia case was administered to 116 fourth-year medical students at Hanyang University College of Medicine. One experienced standardized patient rated exams using two different PPI scales. She scored checklists composed of 43 items related to the two original PPI scales through video clips of the same students. From these checklists, we calculated Pearson's correlation coefficient.

Results

The correlations of total PPI score between the checklist and rating scale methods were 0.29 for the Korean Medical Licensing Examination (KMLE) tool and 0.30 for the consortium tool. The correlations between the KMLE and consortium tools were 0.74 for checklists and 0.83 for rating scales. In terms of section scores, the consortium tool showed only three significant correlations between the two methods out of seven sections and the KMLE tool showed only two statistically significant correlations out of five sections.

Conclusion

The rating scale and checklist methods exhibited a weak relationship in the PPI assessment, but a high correlation between assessment tools using the same method. However, the current rating scale requires modification by reorganizing key scoring components through factor analysis.

Citations

Citations to this article as recorded by

Assessing the Communication Skills of Medical Workers Using Various Scales
N. I. Mustafayeva, Z. S. Vezirova, Z. F. Gumbatova, N. M. Shirinova
Virtual Technologies in Medicine.2023; (1): 30. CrossRef

6,051 View
38 Download
1 Crossref

The Current Educational Measurement of Family Practice Residents.: Min Jeong Kim, Ho Cheol Shin, Cheol Hawn Kim, Youn Seon Choi, Hang Lee, Ae Kyung Choi, Yu Jin Paek, Eon Sook Lee, Jin Ho Park, Yoon Jung Chang; J Korean Acad Fam Med 2007;28(8):616-625. Published online August 10, 2007

Abstract
PDF

Background
The educational assessment of residents is very important in order to check their knowledge and to improve their ability. In case of family practice, the residents spend most of their training time in outside rotations with other specialities. Therefore, they are requested to be evaluated by each specialist after each rotation. To give more accurate assessment, we surveyed directly our family practice residents and family practice faculties. Methods: A questionnaire was sent to family practice residents and family practice faculties in 116 hospitals from May to June 2006. The response rate was 29% and 78%, respectively. Results: Among the total, 70.2% of family practice residents thought an assessment is necessary, but only 51.7% were evaluated. Overall, 90.4% of family practice faculties knew about the assessment of residents made by other specialists, and only 56.7% of faculties requested other specialists to assess their family practice residents. Conclusion: Most of the family practice residents and their faculties knew the need for assessment, but they complained there were no objectivity and the assessment tool was lacking. In order to solve this problem, it is urgent to develop a unified form and guidelines of assesment. (J Korean Acad Fam Med 2007;28:616-625)

1,830 View
14 Download

Suitability Assessment of Patients' Education Materials Made by Korean Academy of Family Medicine.: Nak Jin Sung, Dong Uk Lee, Ki Heum Park; J Korean Acad Fam Med 2004;25(9):669-677. Published online November 5, 2004

Abstract
PDF

Background
: We assessed the suitability of patients' education materials made by KAFM (Korean Academy of Family Medicine) to suggest guidelines for making more efficient education materials.

Methods : The Korean version of SAM (Suitability Assessment of Materials) was used to evaluate patients' education materials of KAFM. The Korean version was modified within the centext of Korean language and culture by 3 family medicine specialists. We evaluated all materials which had been made up to October, 2003. Each item of evaluation criteria was assessed and agreed by 3 family medicine specialists.

Results : The total number of evaluated materials as 51. The average SAM score was 40.2% and its range was 22∼78%. The materials on 'Early detection and self examination of breast cancer', 'Back muscle exercise for back pain patients', and 'Treatment and management of hypertension' received high scores. The materials on 'TIA', 'Alcohol and liver', and 'Children's constipation' received low scores. Two materials (3.9%) were judged excellent, 18 (35.3%) adequate, and 31 (60.8%) not adequate. The criteria for each item such as learning aids via road signs, layout factors, and typography received high scores. The criteria for each item such as summary or review included, 'context is given first', 'cover graphic shows purpose', relevance of illustrations, and 'caption used for graphics' received low scores.

Conclusion : The items such as 'learning aids via road signs', 'layout factors', and 'typography' received high scores in the evaluation of patients' education materials by SAM criteria. There were also weak points noted about unclear purpose, less description about behavior change, irrelevance of illustrations, and lack of learning stimulation and motivation.