VALIDITAS DAN RELIABILITAS UJIAN SOCA (STUDENT ORAL CASE ANALYSIS): STUDI DI FAKULTAS KEDOKTERAN UNIVERSITAS LAMPUNG
RIZKA ARIES PUTRANTI, Prof. Dr. Ova Emilia, MMedEd, Sp.OG(K), Ph.D.; Efrayim Suryadi, SU, PA (K), MHPE.
2016 | Tesis | S2 Ilmu Pendidikan KedokteranLatar belakang. Institusi pendidikan kedokteran harus menentukan mahasiswa yang memenuhi kompetensi menggunakan ujian yang tepat. Disisi lain, ujian juga harus dapat memfasilitasi mahasiswa untuk belajar. Ujian lisan diharapkan dapat memfasilitasi mahasiswa untuk belajar, namun dianggap memiliki validitas dan reliabilitas yang rendah. Fakultas Kedokteran Universitas Lampung (FK Unila)menerapkan ujian lisan SOCA (Student Oral Case Analysis) sebagai salah satu komponen penilaian blok. Tujuan. Mengetahui validitas dan reliabilitas ujian SOCA di FK Unila Metode. Sebanyak 65 video dan 28 rubrik soal diambil saat pelaksanaan ujian SOCA FK Unila semester ganjil tahun ajaran 2014-2015. Video dan rubrik soal dinilai oleh lima orang panelis dan dianalisis menggunakan rumus Lawshe untuk validitas konten. Performa mahasiswa dalam video dinilai ulang oleh satu orang dosen lain untuk melihat reliabilitas inter-rater menggunakan kappa. Dua orang ahli dalam bidang pendidikan kedokteran dimintai pendapat terhadap rubrik soal SOCA untuk menilai kompleksitas kognitif. Data nilai ujian SOCA mahasiswa angkatan 2011, 2012, dan 2013 dianalisis untuk validitas konstruk dan konsistensi internal. Hasil. 93,7% pertanyaan dalam video dinilai valid (CVR>99%), dan 71,8% butir soal dari seluruh butir pertanyaan dinilai valid. Kompleksitas kognitif ujian SOCA FK Unila mengarah kepada tingkatan analyse, know how, dan 4a. Analisis reliabilitas inter-rater menunjukkan nilai kappa sebesar 0,549 (moderate agreement). Analiss Mann Whitney untuk validitas konstruk menunjukkan tidak terdapat perbedaan yang signifikan pada setiap angkatan. Penghitungan alfa Cronbach untuk konsistensi internal sebesar 0,575. Kesimpulan. Ujian SOCA semester ganjil tahun ajaran 2014-2015 memiliki validitas konten dan reliabilitas inter-rater yang cukup baik, kompleksitas kognitif sesuai tujuan, namun memiliki validitas konstruk dan konsistensi internal kurang baik.
Background. Medical faculty has to meke sure that the students meet the minimal competence needed using apropriate exam. While the exam itself should facilitate students to learn. Oral examination has known fot its ability to facilitate students learn but low in validity and reliability. Medical faculty of Lampung University (FK Unila) apply the student oral case analysis (SOCA) exam as one of block assessment component, as with MCQ, tutorial, and laboratory exam. Objective. Evaluate validity and reliability of SOCA examination at FK Unila Methods. Video of 65 students doing SOCA examination and 28 question rubrics had taken when odd semester exam year 2014-2015 has been carying out at FK Unila. Video and question rubrics were assessed by 5 panelis and analysed using Lawshe's content validity ratio (CVR) to determinate its content validity. Students performance on the video were re-assessed by another assessor to see inter-rater reliability, than analysed using kappa Cohen. Two expert in medical education assessed the cognitive comlpexity of the question rubrics. Data of SOCAs student's mark from year II, III, and IV were analysed for construct valdity and internal consistency. Result. 93,7% of the overall question in 65 video were valid (CVR>99%) and 71,8% question number in 28 question rubrics also valid according to 5 panelis. SOCA cognitive complexity were at level of analyse, know how and 4a. Inter-rater reliability analysis showed 0,549 (moderate agreement) kappa value. Mann Whitney analysis for construct validity showed no significant difference of all year. Cronbach alpha analysis showed internal consistency at the point 0,575. Conclussion. FK Unilas SOCA of odd semester examination year 2014-2015 has sufficient content validity, sufficient cognitive complexity and sufficent inter-rater reliability but lack in construct validity and internal consistency.
Kata Kunci : SOCA. validity. reliability. content. cognitive complexity. construct. inter-rater. internal consistency