logo
    Linking the choice of the class format and preclass learning experiences sheds light on a step further in blended medical education
    2
    Citation
    39
    Reference
    10
    Related Paper
    Citation Trend
    Abstract:
    The core principle of HyFlex ('hybrid' and 'flexible') learning is to maintain learning equity under most circumstances. Within a blended framework in precision medical education, how different preferences of synchronous learning environment influence learning process and outcome is limited. We investigated students' preclass online video learning experiences and their choices toward synchronous class formats.This was a mixed-methods study. During the 2021 academic year, all 5th-year medical students who had viewed online video clips presenting core concepts were asked to complete a survey on their preference for future synchronous class format (face-to-face, online, or HyFlex) and asked to provide reflective comments on their self-learning. Anonymous survey data, online records, and summative assessment scores (short-term learning outcomes) were collected. Kruskal - Wallis or Chi-square tests were used to compare differences between groups, and multiple linear regression was managed to select the factors associated with various choices. The students' comments were coded in a descriptive thematic analysis.Among 152 medical students, 150 responded to the questionnaires, and 109 provided comments. Medical students spent a median of 32 min online, significantly shorter in the face-to-face group than in the online and HyFlex groups. The online group had a lower preclass video completion rate for certain concepts. The choice was not associated with short-term learning outcomes. Student feedback revealed a higher frequency of multiple themes for each student in the face-to-face and HyFlex groups, and these themes fell into the categories of learning efficiency, focus concentration, and course attractiveness.Linking the choice of the class format and learning experiences of preclass online videos sheds light on a step further within a blended framework of precision medical education. Supplement of online interactive elements may help secure learning engagement among students choosing 'online only' class format of HyFlex learning.
    Keywords:
    Multiple choice
    Thematic Analysis
    Blended Learning
    Face-to-face
    Little is known regarding the psychometric properties of computerized long-menu formats in comparison to classic formats. We compared single-best-answer (Type A) and long-menu formats using identical question stems during the computer-based, summative, intermediate clinical-clerkship exams for nine disciplines. In this randomised sequential trial, we assigned the examinees for every summative exam to either the Type A or long-menu format (four different experimental questions, otherwise identical). The primary outcome was the power of discrimination. The study was carried out at the Faculty of Medicine, University of Geneva, Switzerland, and included all the students enrolled for the exams that were part of the study. Examinees were surveyed about the long-menu format at the end of the trial. The trial was stopped for futility (p = 0.7948) after 22 exams including 88 experimental items. The long-menu format had a similar discriminatory power but was more difficult than the Type A format (71.45% vs 77.80%; p = 0.0001). Over half of the options (54.4%) chosen by the examinees in long-menu formats were not proposed as distractors in the Type A formats. Most examinees agreed that their reasoning strategy was different. In a non-selected population of examinees taking summative exams, long-menu questions have the same discriminatory power as classic Type A questions, but they are slightly more difficult. They are perceived to be closer to real practice, which could have a positive educational impact. We would recommend their use in the final years of the curriculum, within realistic key-feature problems, to assess clinical reasoning and patient management skills.
    Multiple choice
    Citations (6)
    While blended learning combines online and face-to-face teaching, research on blended learning has primarily focused on the role of technology and the opportunities it creates for engaging students. Less focus has been put on face-to-face activities in blended learning. This paper argues that it is not only the online activities in blended learning that provide new opportunities for rethinking pedagogy in higher education, it is also imperative to reconsider the face-to-face activities when part of the learning is provided online. Based on a review of blended learning in business and management education, we identify what forms of teaching and learning are suggested to take place face-to-face when other activities are moved online. We draw from the Community of Inquiry framework to analyze how face- to-face activities contribute to a blended learning pedagogy and discuss the implications that this has for the role of teachers and students. Our findings suggest that that there are ample opportunities for research to explore existing and design new face- to-face activities that complement online activities in blended learning. We suggest that future research on blended learning should have a more balanced focus on online and face-to-face activities to support teachers and higher education institutions’ transition into blended learning.
    Blended Learning
    Face-to-face
    Previous studies have claimed that male advantage may arise from multiple choice question (MCQ) types; we have made a detailed evaluation of this hypothesis, finding limited evidence that female students are disadvantaged by MCQs in summative assessment. Additionally, we find no significant evidence of a gender gap around the use of multiple choice-type questions, including variants such as multiple response questions, in formative assessment. Our findings suggest that the use of a MCQ format is not a significant factor in the gender gap in assessment.
    Multiple choice
    Knowledge survey
    Disadvantaged
    Gender gap
    Citations (4)
    The study aimed at investigating Senior High School English teachers’ views on the drawbacks and the strengths of the employement of Multicple Choice Question as a summative assessment. Rooting within qualitative research paradigm, the current study employed descriptive qualitative design. The data were collected through in-depth interview with three experienced EFL teachers of a prominent state senior high school in Banjar, West Java. The results of the interview indicated that there are three strengths in using Multiple-Choice Question (MCQ) as a summative assessment. These strengths included teachers’ view that MCQ could result in quick and easy scoring, facilitate the assessment of varied language skills and encourage the students to answer the question carefully. Additionally, there were three drwabacks in using MCQ as a summative assessment such as teachers’ view that MCQ could only facilitate on low order of critical thinking, have low positive washback and require a lot of time in its designing phase. Interestingly, two out of three participants thought that MCQ has been a mandatory type of summative assessment suggested by the government. However, in fact, there has been no government policy which recommend certain type of summative assessment. Therefore, looking at the strengths and drawbacks of the use of MCQ could help to be better informed before deciding to use MCQ as a summative assessment.
    Multiple choice
    Abstract In this study, a blended learning model was designed for elementary school teacher educations in Universitas Pendidikan Indonesia Kampus Tasikmalaya. Students learned both from internet by using YouTube platform and face-to-face course. YouTube and online learning system that usually used in Universitas Pendidikan Indonesia was chosen for learning platform which can facilitate learning through texts, tests, assignments, and videos that made by lecturer itself. This research aims to determine the effects of face-to-face and blended learning model on the result and the student’s attitudes, opinions and perceptions on blended learning. This study used a combination design of both qualitative and quantitative methods. There were two different groups in this study, face-to-face group and blended learning group. The face-to-face learning group and the blended learning group consisted of 40 and 40 students. The face-to-face group conducted face-to-face lectures as usual for 16 meetings. Meanwhile, the blended learning group conducted lectures in an integrated model both face-to-face as well as online lectures through YouTube platform. The results showed that the blended learning group was more effective than the face-to-face group. The usability of face-to-face learning and blended learning in higher education is addressed in recommendations for future research and practice.
    Blended Learning
    Face-to-face
    This paper reports undergraduate student feedback contrasting conventional “Long-answer” examinations with automated multiple-choice question (MCQ) assessment. Feedback was gathered after students had undertaken formative MCQ assessments as a revision aid. Feedback was generally supportive of MCQ summative tests, with 74% expressing a preference for the new format. The examination conditions were preferred by 69% of students. Results indicate that students are in favour of the use of automated MCQ assessment. All topics can be reliably and validly assessed with an associated time saving of over 16 hours . The need for rigorous question and answer construction has been highlighted, but so long as sufficient care is taken at that preliminary stage, the overall benefits of the format outweigh the problems.
    Multiple choice
    Online assessment
    Citations (1)
    Through a thematic analysis of open-ended survey responses, we explore the challenges assessors face during assessment (summative evaluation and formative feedback) of students’ work. The assessors were primed by asking them to mark solutions to closed-ended engineering problems typical in introductory Electrical and Civil engineering courses. The subsequent survey asked the assessors to reflect on their experience. The analysis of the thematic frequency count is presented and discussed in this paper. The data suggests that from the perspective of assessors, current assessment practices need improvement. In particular, it appears that summative evaluation is seen as the primary goal and feedback is given as time allows. However, the participants also identified insufficient time as a challenge, which may further diminish feedback
    Thematic Analysis
    Thematic map
    Citations (0)
    The purpose of this study was to develop educational software for online assessment of multiple choice responses (MCQs). An automated assessment software program, duly developed in this study can display assessment items, record candidates' answers, and mark and provide instant reporting of candidates' performance scores. Field tests of the software were conducted on four primary schools located in Bindura town using a previous year summative Grade 7 assessment set by the Zimbabwe School Examination Council (ZIMSEC). Results were that computerized assessment in mathematics has the potential to enhance the quality of assessment standards and can drastically reduce material costs to the examination board. The paper exposes test mode benefits inherent in computer-based assessments, such as one-item display and ease of candidates selecting/changing optional answers. It also informs the ongoing debate on possible enhancement of candidates' performance on a computer-based assessment relative to the traditional pen-and-paper assessment format. The need for the development of diagnostic instructional software to compliment computerized assessments is one of the recommendations of the study.
    Multiple choice
    Online assessment
    Citations (1)
    Media coverage suggests that ChatGPT can pass examinations based on multiple choice questions (MCQs), including those used to qualify doctors, lawyers, scientists etc. This poses a potential risk to the integrity of those examinations. We reviewed current research evidence regarding the performance of ChatGPT on MCQ-based examinations in higher education, along with recommendations for how educators might address challenges and benefits arising from these data. 53 studies were included, covering 114 question sets, totalling 49014 MCQs. Free versions of ChatGPT based upon GPT-3/3.5 performed better than random guessing but failed most examinations, performing significantly worse than the average human student. GPT-4 passed most examinations with a performance that was on a par with human subjects. These findings indicate that all summative MCQ-based assessments should be conducted under secure conditions with restricted access to ChatGPT and similar tools, particularly those examinations which assess foundational knowledge.
    Multiple choice