Explore the Details of the USMLE catching them and unravel the details of the cheating scandal. Uncover the WHAT, WHY, and HOW behind the exposure.
{getToc} $title={Table of Contents}
We’ve discussed the cheating scandal previously in a separate blog, you can see it here.
How does the USMLE Work?
As they explain on their official website: “The USMLE program will conduct an investigation if it receives information that an individual may have engaged in cheating or other irregular behavior. During this time, anyone alleged to have engaged in such activity will be prohibited from registering for additional exams; previously unreleased scores, if any, may be withheld; and pending examination appointments will be canceled.”
So they are saying that all things keep running smoothly till they receive info about someone cheating. Each year in some centers there will be such cases.
What Happened in Nepali USMLE Center?
After the result of the step 2 exams published, group of Nepali meds flooded social media with their outstanding scores, many students were >280. So, they raised too many questions about these unusual results.
The USMLE program has identified a pattern of anomalous exam performance associated with Nepal, which challenges the validity of test results for a group of examinees,’ its statement said.
Medical educator Conrad Fisher of Med Quest Test Prep questioned in an X post about the high performance of Nepalis: ‘Of 138 with >275 applying to my program, 86% are Nepali. Of the top 100 applicant scores, 92% are Nepali.’
In response to these observations, Bishal Dhakal argued that the success of Nepali candidates could be attributed to their familiarity with exam preparation based on past tests. Dhakal contended that labeling it as cheating due to high scores was unfair, emphasizing the need to address any issues with exam centers independently, without implicating the entire country.
MEMORANDUM OPINION AND ORDER FROM UNITED STATES DISTRICT COURT FOR THE DISTRICT OF COLUMBIA
Investigation into Exams Associated with Nepal by early 2023, the Board had received several tips claiming that groups of examinees in certain countries had distributed exam questions in advance of testing. One tip, for example, alleged that test-takers in India and Nepal were relying on banks containing live USMLE questions to attain high scores. I'd. Another stated that, in those two countries, test takers were “purchasing last six months question papers.” Another, still, reported “concern” that “USMLE graduates from Nepal have been scoring really high scores . . . [because] almost all questions are out and [they get] repeated question[s] in their exam[s].” This tipster also reported that there were “preparation libraries/reading rooms in Nepal where students gather and go through these volumes of question[s].”
In response to this information and other anonymous tips, the USMLE program asked the Board’s Psychometrics and Data Analysis (“PADA”) department to “analyze examinee performance data for test centers in Jordan, Nepal, and Pakistan.” The results from Nepal were the most extreme. The country’s sole test center produced the highest average scores in the world on the 2021 Step One and 2022 Step Two exams.Individuals who attended medical school there also received top marks globally on all three steps in 2023—by a long shot. For Step One, for instance, which is scored on a 300-point scale, the average score for a student who attended medical school in Nepal was around 15 points higher than the average score of students from schools in the next best performing country. In other words, the home of Everest scaled equal heights when it came to exam results. And its students moved at turbo speed. In 2022, examinees who tested at the center in Nepal were among the fastest 5% for the Step One exam and 10% for Step Two, out of all test-takers worldwide. Further, the number of people taking the Step One and Step Two exams at the Nepal test center had more than doubled in the span of three years.
That analysis was designed to identify sets of exams that contained a “statistically improbable number of the same incorrect response options to the same questions,” which could be indicative of prior, shared access to those questions. The results—which focused on Step One and Step Two exam data from 7 2021 and 2022—showed that “the vast majority of examinees with statistically significant number of matching incorrect answers tested at the Nepal test center.” Re-run of that analysis in July 2023, which “focused on examinees who tested at the Nepal test center and/or were citizens of Nepal (based on information self-disclosed in their application to test),” yielded similar results. As did an analysis of Step Three exams completed by individuals who attended medical school in Nepal or self-reported as a citizen of Nepal.
Such criteria did not necessarily identify “irregular behavior” or intentional “cheating,” but it provided a basis to question whether the test results genuinely reflected the knowledge and skills of the examinees. 16. After applying this analysis to test-score data from the Nepal test center, self-reported citizens of Nepal, and graduates of Nepali medical schools, NBME identified 832 examinees (or roughly forty percent of the sample group) from 2021 through 2023 with at least one exam result of questionable validity. As a prophylactic measure—and in a departure from its usual procedures—the Board immediately invalidated the suspect scores and notified the affected examinees.
Why the Nepali USMLE Scandal is Different:
It’s different because there were 800 doctors involved, not one or two, and there is a suggestion that employees at the center were involved in giving the students questions and screenshots yeah, it's kind of a big deal.
Will it affect the future of Nepali doctors?
Well, till now 10/3/2024 there has yet to be a definitive answer. Some opinions on social media suggest that it will only affect the 800 students, some of whom are cheaters.
Possible consequences for those accused of cheating include potential bans from future exams and the implementation of special administrative procedures. The USMLE program reserves the right to take action, especially when cheating or irregular behavior is indicated in previous exams, aiming to ensure the examination's security. There are opinions indicating that the Nepal center might close this week, but the exact outcome remains uncertain. Regardless, a response is anticipated to prevent such acts from recurring in the future.
Conclusion:
The whole thing was a mess, and something bad happened so there will be a response. And the USMLE calculates its steps, surely knowing that it's watched.
Don’t give the issue more than it takes and for all who want to achieve their dreams don’t hesitate and don’t let anything put you down. We are here to help you on your journey, and you can find plenty of free resources to help you.
Tags
Usmle