The NBME self assessment test is another of those tools that I feel is responsible for the increasingly high scores in the USMLE. It is a great tool that allows the test-taker to assess his or her readiness for the exam. To a certain extent, if used properly, it is also a useful tool for the examinee to target a certain score, even 99′s and achieve it.
The questions for the NBME self assessment tests were taken from a pool originally designed for the shelf exams of American Medical Student. As such it covers the most important concepts that AMGs are required to know before passing to the next level. It covers the same topics that will be covered in the actual USMLE examination.
The NBME self assessment tests are very good at predicting the score you will get at the USMLE. In fact I read somewhere (unfortunately, I can’t seem to find the site now though) that at least for Step 1 the 1st exam set has a correlation as high as + 0.89, while the others range from + 0.72 to + 0.85. If you go to most of the forums, you will find that the correlation for most examinees is very good.
Although the topics covered in both the NBME and the USMLE is more or less the same, there is a tremendous difference between them.
First, the NBME questions are much, much more straightforward than the USMLE questions. The NBME has precious little tough questions. Therefore a low score in the NBME is more indicative of lack of knowledge of the topics covered in both exams rather than a lack of mastery of those same topics. Although the latter exam sets have tougher questions than the first sets, they still are not as tough as the tougher parts of the USMLE, plus, they actually have lower correlation with USMLE scores than the first exam set.
Second, the NBME questions total less than the actual USMLE exam and therefore will cover less lower-yield stuff than the actual USMLE exam.
Third, you can have up to 4 hours to answer the examination. Part of the toughness of the USMLE is the time constraint imposed on the examinee.
Fourth, you can take the blocks at a time of your own choosing, usually during periods where you are at your peak effectiveness. The actual examination does not give you such luxury.
Fifth, you have to take the USMLE blocks, 7 to 8 at one time with minimal breaks, which can take its toll, believe me. By the fifth or sixth block, your mind tends to stop functioning. You have only 4 blocks in the NBME and you can take it at your leisure.
So despite the obvious difference between the 2, why is the NBME such a good predictor of USMLE performance? The answer lies in the fact that the NBME has taken the time to correlate the results of hundreds of thousands of AMGs with their actual performance in the USMLE. This correlation has taken into account the difference in test conditions and actual content of the examination and that this difference although apparent is not very significant as can be shown by the correlation of + 0.72 to + 0.89 between the various NBME exam sets and the USMLE.
So the practice of using the “downloaded” version of the NBME tests effectively wipes out the predictability of the exam set itself. It’s effectiveness lies in the statistical analysis they’ve done for the results and not the results themselves.
Another ineffective practice, is studying the NBME test questions to improve your score. This will be effective only if your original review is so poor that you have not covered the required high yield topics tested in the USMLE properly. Otherwise you are better off studying the questions in USMLE world and Kaplan Q Bank to understand how to answer tough questions and low yield stuff that are more likely to appear in the USMLE.
Another common error is repeating the exact same exam set. The correlation holds only if you take the exam once and only once. Repeating it will raise your score in the NBME which will not be carried over to the USMLE. Therefore, I suggest reserving at least one set to be taken only if you are ready to do the USMLE.
Used properly, the NBME tests can be an effective tool for self-review. So do yourself a favor, use the NBME self assessment tests properly as an assessment tool rather than a study tool. And take the online form rather than downloading them, which is also subject to copyright issues. The NBME self assessment site is here.
*note: Part II deals with When and How to use the NBME self-assessment tests and whether it is wise to use USMLE World self-assessment tests instead.
Hi,
I am new to NBME but have heard a lot about it. Can you please tell me more about it , like – how do I subscribe to it? how many questions are there and do they come with the answers. I tried to google for it but was not able to get the questions that you have written about. I will be giving my step 1 next month so I will appreciate if you can help me out.
Thanks,
Kalpana
hi kalpana,,,,,
first of all i want to wish good luck for ur exam next month. try to got through the official website of NBME..www.nbme.org and there in the home page you will have details about the self assesment exam and the cost and purchase deatils. make sure that you use the modules u have purchased in 20 days as the validity peroid for this service is just a momth…
goodluck
regards,
veena.s.kumar
i am done with my 3 reading of kaplan. 1 reading thru 1st AID. and planning to appear for exam in april or may. will nbme help me in ny improvement?after all these study, i m still not that confident abt appearing for exam.what u say guys plz help me out…
Hi snehal,
The problem is that everyone read Kaplan and First aid. Some get 99′s other fails. It’s not what you studied but how you studied. NBME won’t improve your score. It just tells you if you studied effectively, or what you studied went nowhere. There are many people who studied for months and still fail. Take the NBME to know if anything you studied did stick in your head.
Askdoc
hai…thanks for the valuable suggestions, i would llike see the model question papers (practice papers) to practice for the exam.
thnak you
hi askdoc,
im done with kaplan and firstaid reading. almost done with usmle world ( my score is 50-60%). how should i acess my preparation? any other suggestion?
thanks
Hi Docjay,
First 50-60% in UW means average of 55% which means failing in the actual exam. 58-59% is needed to have a good chance of passing although not a sure pass. The question is how many times did you read kaplan and first aid? How much information did you absorb? Most people with good memory and comprehension needs at least 3 readings of Kaplan in order to pass this exam. This means they are able to retain at least 65 to 70% of what they’ve read. Some people may need to read through them at least 5 times and comprehend and retain the information to pass this exam. So you have to ask yourself first which one are you and how many times you have revised the material.
Askdoc
Hi askdoc,
What you are saying appears very ture for step 1 and 2ck, but for step 3 it seems that the NBME is not a very good tool of assessment.
do you agree with me ? what would you recommend ?
thanks
amer
hi askdoc,
im done with my usmleworldq bank I strtd with tutor mode but last 60% i solved mixed unused timed mode. my score is 68%. i have my exam next month. anythin else i need to do for CK prep.
btw! quick add… I took all the NBME’s purchased online except #5!
My bars on form 7 were all the way to the right and I had 3-4 stars on some of them….complete opposite of 6…which was all the way to the left!
Ok thanks
!
Hi docjay,
68% is not bad. you’ll be getting somewher between high 80′s to mid-90′s for CK. At this stage if you are happy with that score, I believe, just high yield review and more mixed, random, unused timed blocks will help.
Askdoc
Hi , I got b/w 75-77%in my nbme practice sample paper and getting arond60% in kaplan q bank for step 2 ck. I mostly focussed on questions this time rather than reading books… am i ready for step 2 ck?
hi ask doc,
i cleared step 1 with 237/99.will be getting ck results in this week.looking for internal medicine residency. i gruaduated last year and didnt get into practise and have no clinical experience or reserach. what are my chances?
Hi priya,
depends on what is your goal. If it is just to pass with a low score then I think you are OK. Again do the NBME online, not those downloaded edition to get a better gauge.
Askdoc
Hi docraj,
depends on where you are applying, Apply smartly and you will get interviews, lots of them. But interviews can make or break you so its important to do that well too and not just depend on your scores. Make sure you research the programs you are applying to. Applying to the wrong programs will actually do you a lot of harm
Askdoc
hi askdoc,
my score in step1 237/99 and step 2 ck 241/99. how do you find it for neuro and IM residency? but i dont have USCE or research papers.
Hi docjay,
If you are fresh grad, that should be no problem. Just make sure you research your programs carefully. Not all programs require USCE or research experience. Having both just means you can apply to more programs that is all. Find programs that do not really need either.
Askdoc
Hi askdoc,
I read in one of your answers above that at least 3 readings of kaplan are needed. I am finishing 2, but with a gap of 3 months between these two readings. Also I am yet to finish even the first reading of First Aid. I am scoring around 65 in uworld. I don’t have much time and doing a third reading of kaplan looks impossible. My progress on uworld is good, with recent tests showing 70,72,78… I aim for a 99..What do u suggest?
How can I contact the administrator via Email? I need to ask questions!!!
Hi, askdoc,
Hope you’re well. Just got my Step 1 score: 237/99. I am an SGU student born in New Jersey who will begin clinicals this May/Jun 2010. I am just wondering what my marketability is like for a general surgery, anesthesiology, or pathology residency. What are the “good” residencies that are attainable based on my Step 1 score? Very much look forward to hearing from you at your earliest convenience. . .
Hi smita,
First, you do not need to do 3 readings of Kaplan Notes. You just need to do 3 revisions and revisions does not involve only reading, but memorizing and integrating what you have read. The first 2 revisions may involve something as detailed as Kaplan notes, but the 3rd or subsequent revisions can be limited to higher yield materials like First Aid or any notes you have made when you were reading Kaplan Notes. 65 is USMLE world is high 80′s to low 90′s. your current scores is enough for high 90′s but not yet a 99. I suggest you concentrate on high yield material and see how high you go. You need to consistently score above 76 for last 10 blocks random, timed mixed in order to be sure that you will get a 99. Whether you use a new qbank or just study the material you have and not do any questions depends on how near you are to your goal at that time.
Askdoc.
Hi jgrew,
Actually very hard to assess individually on your chances since too many variables are involved. First is Step 2 CK scores are also very important in getting residencies specially for IMG’s. Anesthesiology is extremely competitive and you need both good scores, some “influence” and lots of luck to get in. GS is easier than anesthesiology and having USCE and no visa problems will help a lot. You still need a good Step 2 CK score though and you need to choose programs that like or fit your credentials. I do not know the competitiveness of pathology or what criteria is important. So I can’t help you there.
Askdoc
Hi askdoc,
Just took step 1 exam and I was shocked to see I had 8 blocks on my test. I was surprised because I always thought there were 7 blocks in the 8 hour time period. Am I missing something here? I know that the exam is constantly evolving, is this one of the changes for this year? Really need some answers
Sorry about that, just found out that the tutorial is considered 1 block even if you decide to do it or not
Hi yesme,
No Problem. Happens to everyone.
Askdoc
Hi askdoc,
I was wondering what is a good percentage to be in for UWorld that would correlate to passing Step 1? Thanks so much.
Hi TNL,
You would need about 58% random, timed, mixed unused blocks to have a chance of passing Step 1. If you want to make sure you pass, 60% would be better.
Askdoc.
iam studing for step1 over year, my first blck in usmle was 40% after that i reach 64% then i stp doing blocks and i did revesion for sme topic ,when i did blocks after this reveision i got low scores,why.please help me iam gona loos my mind
Hi mana,
If you listen to my introduction to the prep course. You will understand that studying too long is actually detrimental to doing well. That is due to the fact that we start forgetting what we have studied almost immediately. So long as our rate of learning is faster than our rate of forgetting, you are adding to your knowledge. But going too slow can result in the opposite effect. When rate of forgetting equals rate of learning you have reached what we call a plateau. Everyone plateaus eventually. Some plateau at 99, some at 90 some at 75. You don’t want to plateau at a failing score. If after plateauing you continue to delay your exam, you start going into decline and your actual scores become lower. For most people optimum study time is 6 to 9 months. Some of course can study longer before plateauing but they are the exception rather than the rule.
Askdoc.
so, what i have to do now,my scores is still go down and you rigth iam starting to forgot a lote. and i can not go to exam untill august 2010,and i want to get 99.
thank you so match
Hi
If i did another revesion for the kaplan notes ,first aid q bank kaplan and usmle world ,is my scores will increase ??
thank you
Hi mana,
Depends if you are declining. If you are then you need to take a short break before restarting your prep and do one more revision. Start with kaplan notes, then qbanks then first aid. As to getting a 99, that may not be possible given the maximum you achieved in q bank was a 64. You need about 72 to 75 to have a chance at a 99.
Askdoc
Hi
I’m preparing for my step1, i used kaplan video/notes, read first aid 2 times, did u-world on tutor mode subject by subject for all the unused questions. my average score is 55%.Then i started mixed, timed questions of the used questions. i have done 11 blocks and my average score is 76.63%. my exam date is in 2 weeks. i have not done NBME. Pls what do you suggest? I’m worried bicus i want to get in the 90-99 % score. thanks
this is how i did in the 11 blocks: %..70, 68, 72, 83, 87, 77, 75, 75, 72, 81, 83. ..time mode, mixed questions, but used questions…thanks
Hi Immanuel,
I am sorry to inform you that using used questions is completely useless in assessing your ability to pass this exam. With an average score of 55%, your chance of passing the USMLE is low. My average on qbank was 84. When I redid questions my average was 99%. I got 99/256 which is about where you would be if you got 82-84 in qbank. If 99% was my true score I might have gotten a 99/incredibly high-break all record score, right?
Askdoc
Hi
Thanks very much for the reply. So in this case what do you suggest I do? Thanks
Hi Immanuel,
You have two choices. Do an NBME to confirm the score you will get if you decide to continue with your exam. Or you postpone your exam. Restart your review this time do your prep properly. It is easy to tell by the way you prepared that your chances of passing this exam is very poor. If you read my posts, you know that the way you prepped was completely wrong.
Askdoc
Thank you very much. I have subscribed to the nbme form 1. i will take it tomorrow, 10th july, since the date of my exam is on the 20th July. if it doesn’t go well , i will postpone it to a later date. What is the best month/date to take the exam? thanks, I appreciate what you are doing. thanks
hi Askdoc
thanks for the good job you doing.
I am confused. I took both the usmle world assessment test form 1 and the NBME form 1 today. I got 490 ( a digit score of 216) on the usmleworld assessment , but a very low score of 200 on the NBME assessment score.
Honestly, I started studying for the exam from the 3rd of June 2010. I have scheduled my exam on the 20th of July 2010. However, looking at these scores, I guess I don’t have a chance of passing the exam. So I will postpone it. I was hoping of finishing the usmle exams in time so i could apply for residency this september. I have not written any of the exams( i have registered for all of them though)..
I can see my chances are very slim.
Please, Please,.. tell me how I should study for this exam step1. The only materials I have are KAPLAN VIDIO LECTURES, KAPLAN NOTES, FIRST AID2009, GODJAN AUDIO. USMLE WORLD QBANK, . Will I need special classes or I can study on my own?. AND DO I have a chance of applying for residency this september or I should just plan to apply next year and use the period between now and next year (2011) september to write the exam.
WHAT IS YOUR EXPECT ADVICE PLEASE. THANKS
Hi Immanuel,
You studied the right materials but you have problems about studying the right way. You need to get someone to help guide you in how to study properly. If you want to make it to 2012 match (September 2011) then you need to be starting your review now. Take Step 1 in January or February. Step 2 CK in August. And Step 2 CS somewhere in between around February or March. I don’t think you can study on your own at this stage. Whether you enroll in a course or not is your decision. But you obviously need help.
Askdoc
Thanks for the good advices. I finish uworld q bank with 50% 2 months ago , now im doing USMLE RX getting 60 % , but im thinking in buying qbank . Or maybe do uworld q bank again ( after do the unused i started doing used and incorrect and getting 87% 85% 90% ). What do you suggest buy a different qbank like kaplan or do again uworld? and sincerely what do you think about usmlrx?
thank you so much.
I needed some advice before i go and attemt my USMLE Step 1 exam, I hope you can help me. I started studying for the exam march and i have allready went through Kaplan Lec notes for (patho, pharm,biochem,immuno,micro) also done the Kaplan video to those subjects as well. Then i have completed Goljan rapid review for Patho as well, Also First Aid 2009 i went through it atleast twice and i added notes to as i went along. Then i finished UWORLD Q bank and Kaplan Qbank, as well as rapid review question banks and now NBME questions as well.
Even after all this i am still not at the level i should be i just dont know what i am doing wrong and now i am getting depressed cause i cant seem to bring my score up anyhigher than what is. I was planning on taking the actual exam beginning of AUG.
PLease give me some advice, please help me in some way. THANK YOU SO MUCH.
Hi Hi dr ask,
I suggest you use a new Qbank. Kaplan would do nicely. The problem with reusing qbanks is that what you have learned is the question and not the concept behind the question. Therefore that question cannot accurately assess your understanding of that particular concept. Although, I have not personally used USMLERX, I have seen some of the questions and they are not bad. However, both Kaplan and USMLE World still have the most statistical data to back their reliability for helping you get ready for the USMLE. I would still recommend you use either Kaplan or UW and use USMLERx only as additional material or resource. Same reason I recommend my own Step 2 CS course only as supplement even though I have taken pains to make it into really good prep material.
Best to rely on a proven resource first and use newer resource only as supplement.
Askdoc.
Hi Hi askdoc,
Before I can give you any clear advise, what was your scores in UW, Kaplan and NBME. And did you use the actual online materials or did you use the downloaded version. Plus, how many times did you go through the notes and lectures and in what order.
Askdoc.
Hi askdoc….
I ve read kaplan,fa, uwQbank,i ve done kaplan n usmlerx q bank,subject wise…now i did nbme form 1 offline ,but i got 50% of qs correct..wht can i do to improve my score. I ve now started reading goljan rr3rd ed,i also did his audios some time back.
wht can i do to improve my marks?? plz let me know,i m planning to take my step in aug end. thnaks
.
hi askdoc
just finished my studies with 64 in uworld,310(188) in nbme form 4 then 390(201) in nbme form 2
my exam on 29th july dont know if i can give USMLE.kindly help
Hi usmle100,
If you’ve read my posts in the blog, you would realize that you used all the study materials in exactly the way I said you should not. That is why you are having such problems. I do not think you can be ready to do the exam by August. Revising Kaplan notes alone will take at least 4 to 6 weeks. Basic mastery phase for step 1 involves at least 3 revisions. First revision you use a detailed study notes like Kaplan or my online Study notes. And revision does not mean to read. It means read, retain and recall at least 80% of the material. For some people that involves reading once (they have photographic memories) for most others it involves reading more than once. Second revision involves using high yield outline notes like BRS or FA but coupled with more detailed study notes in order to insure that you have not forgotten the more detailed material. Third revision involves concentrating on high yield outline notes like FA or BRS. Only then do you do qbanks, never subject wise but always, random, timed, mixed unused. This is the time period you identify weak points in your study and systematically take care of them. Then you do an NBME then sit for the exam 2 to 4 weeks later and pass it with at least an average score or even higher. As you can see, you need a lot of time to be able to do this. Students in my prep course follow this general outline of review and prep and most of them do get to get their desired scores. You need to reboot and do it right this time.
Askdoc
Hi nathan,
I need to know how you did uworld. Is it timed, mixed random unused. As a 64 in Uworld is usually correlated with a 215 to 218 in NBME. Based on your current NBME result you have a big chance of failing. If you happen to pass the exam your score will be at most high 70′s. Usually when this things happen, it is because you did something wrong in your prep. If you read my reply to USMLE100, you will see how to prep for this exam for maximum effectiveness.
Askdoc
Hi dr. askdok
Idid NBME 7,and for some reason i didnot finish all blocks ,i finsh just the first block and i got 200,200 in just 1 block is that good or it is not assesment
Hi mana,
200 is the lowest score you can get. Even if you get 0 questions right, your score will still be 200. So not assessment.
Askdoc