Find all School-related info fast with the new School-Specific MBA Forum

It is currently 23 Sep 2014, 10:54

Close

GMAT Club Daily Prep

Thank you for using the timer - this advanced tool can estimate your performance and suggest more practice questions. We have subscribed you to Daily Prep Questions via email.

Customized
for You

we will pick new questions that match your level based on your Timer History

Track
Your Progress

every week, we’ll send you an estimated GMAT score based on your performance

Practice
Pays

we will pick new questions that match your level based on your Timer History

Not interested in getting valuable practice questions and articles delivered to your email? No problem, unsubscribe here.

Events & Promotions

Events & Promotions in June
Open Detailed Calendar

Mock GMAT exp with Veritas - Surprised

  Question banks Downloads My Bookmarks Reviews Important topics  
Author Message
TAGS:
Intern
Intern
avatar
Joined: 21 Oct 2012
Posts: 3
Followers: 0

Kudos [?]: 0 [0], given: 0

Mock GMAT exp with Veritas - Surprised [#permalink] New post 13 Jul 2013, 06:24
I recently wrote a mock GMAT test with Veritas and for my surprise, I felt the scores were not resembling the total number of correct answers. I drafted a mail and sent it to Veritas Prep, but didn't get any reply. So, I felt I would post my mail here, if I could get a possible reply from the experienced people in this forum.


Dear Sir/ Madam,

I tried the free GMAT prep test in Veritas and got a 680/800, which has provided me a good moral boost. But when I started assessing the answers, I was quite surprised to find that there were a lot of wrong answers, but still the over-all score was high. This poses a fear to me, if the over-all score shown is right or not.

Here is the summary wrt verbal & Quants.

Verbal - Total no. of correct questions - 22/41; Score - 38 & 84 percentile
Correct questions - 1,5,6,8,9,10,12,14,15,17,19,20,21,22,24,25,26,30,32,34,37,38

Quants - Total no. of correct questions - 22/37; Score - 46 & 71 precentile.
Correct questions - 1,4,5,6,8,10,11,12,14,15,19,22,26,27,28,29,30,32,33,35,36,37

I learnt that if the first few questions are wrong, then the drop in overall score would be so high and this was also quite suprising in this case because in both Quant & Verbal the second 2 or 3 questions were wrong, but still getting a score of 680 appears as a shock.

Kindly comment.
Veritas Prep GMAT Discount CodesKnewton GMAT Discount CodesManhattan GMAT Discount Codes
Manager
Manager
avatar
Joined: 26 Dec 2011
Posts: 77
Location: United States
WE: Investment Banking (Investment Banking)
Followers: 2

Kudos [?]: 11 [0], given: 12

Re: Mock GMAT exp with Veritos - Surprised [#permalink] New post 14 Jul 2013, 14:51
The number of questions you get correct is not as important as the difficulty of the questions you get correct.

That said, it is very possible that the score is in fact accurate.
_________________

Please give KUDOS if this post was helpful!

Manager
Manager
avatar
Joined: 07 Feb 2012
Posts: 67
GMAT Date: 04-19-2012
Followers: 0

Kudos [?]: 11 [0], given: 0

Re: Mock GMAT exp with Veritos - Surprised [#permalink] New post 14 Jul 2013, 18:15
Do you mean Veritas? If so, no one takes that test seriously. The only reliable practice tests out there are GMAT Prep and Manhattan Gmat. Don't waste your time with others. I'll probably get bashed by some people working for Veritas but I think that's how most people see the practice tests..You can ask anyone.. theres no way your getting 22/41 on verbal and getting a 38... just not happening..
4 KUDOS received
Veritas Prep GMAT Instructor
User avatar
Joined: 26 Jul 2010
Posts: 207
Followers: 100

Kudos [?]: 217 [4] , given: 20

Re: Mock GMAT exp with Veritas - Surprised [#permalink] New post 15 Jul 2013, 11:43
4
This post received
KUDOS
Thank you for taking the new Veritas Prep Practice Test! And thanks, actually, for bringing up the scoring – we love talking about the scoring algorithm and how it works.

Our tests (beginning in about April of 2013; if you didn’t take the scoring as seriously under the previous tests I don’t blame you) are scored using Item Response Theory (http://en.wikipedia.org/wiki/Item_response_theory), the system used by the GMAT, GRE, and other computer adaptive tests. And it’s a difficult system to understand; it took our team (which included math majors from multiple continents, MIT grads, members of the International Association for Computerized Adaptive Testing….) a healthy year or more to fully understand and implement the system. So as I’ve long said, if you can either explain to Usain Bolt how electronic timing works or just letting let him go out and run faster than anyone else in the world, he’s better off training to run fast. Learning the nuances of IRT/CAT theory isn’t going to help you much on the GMAT, but understanding the basics can help you feel comfortable with the test administration and can help you avoid bad advice. So with that in mind…

Why “Percent Correct” Doesn’t Matter Nearly As Much As You Think

The IRT system has two main functions – item administration (which questions you see) and ability estimation (your score). And each system informs the other. Once the ability estimate feels confident that you’re above average, for example, it delivers questions that are most likely to help it determine “just how far above average?” – which means that you’ll miss several questions even if you’re in the 90th percentile, because it’s trying to determine whether you’re above that level and the only way to know is to continue testing your upper limit.
Now, the simplified explanation strips out a good amount of IRT nuance and basically says this: once the system has narrowed in on your ability you should theoretically get half the remaining questions wrong; if you’re 75th percentile, you should be getting all the 80th questions wrong and all the 70th questions right, and the system will keep pinballing you between those levels. That’s not 100% accurate but it’s close enough for a close-enough understanding of the scoring system. Almost everyone will miss a lot of questions once the system has started to figure out your threshold. And according to IRT theory it doesn’t take too long to get there – within 6-7 questions the system usually has a pretty good feel for your ability level.

What’s really happening with the ability estimation is that it’s calculating the probability of someone with your responses having each score. And here’s where conventional forum wisdom tends to miss the nuance of IRT – we see “you get a question right it gives you a harder question / you get it wrong it gives you an easier one”. What the system is really doing after each response is using all of your responses to date to estimate the probability of your having each score, and not all questions carry equal weight. Again, the IRT system heavily relies on probability – some questions are much more potent at determining whether you’re above or below a certain threshold and others are a little less telling. The system takes these weights into account, particularly as your score moves. These weights also have to account for content delivery – the system might want to ask you a “more potent” Sentence Correction question but need to deliver you another Reading Comprehension passage, and so those RC questions might not carry the same weight as the questions before it.

Which is all a long way of saying “it’s complicated” – so let’s take a look under the hood at your test so I can show you how the system worked.

Your Test

(BTW – since your GMATClub handle was also part of your login for your test this was relatively easy for me to find…hope you don’t mind my pulling it up)

You answered the first quant question correctly, and here’s where “conventional wisdom” may lead you to an incorrect conclusion about how the system should have treated your next two incorrect answers. After one question, the system only had one data point on you – you were correct. So at that point you had a high probability of being well above average – after all, if you answer a 50th percentile question right you’ll probably answer a 60th percentile question right, too – so the system wanted to ask you a hard question (and it did – only about 15% of people get that Venn Diagram problem right). When you got that wrong, the probability that you were above the 90th percentile decreased dramatically, but the probability that you were above the 60th percentile was still very high; the system had a data point in that range and you answered it correctly. Getting one right, then one wrong did not take you right back to the starting point – that’s not how the probability-based system works. So then you saw another substantially-above-average problem and got it wrong, so the system at this point saw that the highest likelihood was that your score was a little above average, but not that much.

So after three questions, the system saw you as around the 60th percentile, and gave you a subsequent question consistent with that estimate…and then you rattled off three straight correct answers on some relatively tough problems. And after you missed that 7th question, you went on a nice run of more-right-than-wrong before you hit your first real trouble patch of three straight wrong…and by that point the system had already pegged you as being around a standard deviation above average, so those wrong answers were all on hard questions. Had you free-fallen a little more you might have been in trouble, but you stemmed the tide nicely with a couple correct answers to break up those trouble patches and the system more gradually moved its estimate down. Then when you got back on track with a few runs of 4+ correct, you limited the damage – at your peak you would have gotten a Q49, so those rough patches came on some really tough problems.

Which I guess brings me back to why your correct percentage doesn’t tell the whole story – since your first question’s “most potent” point (where it gives the highest distinction between ability levels) is a tick above absolutely average, you never saw a “below-average” problem on the quant section. So you were supposed to get a lot of those questions wrong, as do most others who see 37 straight “difficult” problems. So when you’re graded based on your ability level compared with that of others your performance looks all the better – most people when seeing the run of questions you did in a test format would have performed worse.

On the verbal side, the setup was similar and I should also mention that two of your verbal mistakes came on unscored, experimental questions (we include those like the GMAT does and for the same reason – to get good statistics on questions for use in subsequent tests). So if you take those out your correct % goes even higher.

What you can learn from this

While I can’t guarantee that the official GMAT uses “stock” Item Response Theory (it may add in a few scaffolds or tweaks for its own purposes but I know it adheres very closely to, if not 100% to, IRT), you can learn from this experience with IRT that:

1) Getting “the first 10 questions right” isn’t what many say it is. You can miss 4-5 of the first 10 and still leave that set with the computer estimating you well above average.

2) The key is, instead, to make sure you don’t miss many easy questions. Doing so impacts the ability estimate (you’ve given the system a data point that you now have to overcome) and the item delivery (if you miss an easy question, the system is more apt to deliver you questions around that level to test your “floor” instead of your “ceiling”, so you give yourself a narrow margin of error and you don’t get as many opportunities to prove that you’re elite)

3) The IRT system is nearly impossible to game. Remember – your ability is calculated by your probability of certain scores and it takes into account all of your previous responses. Please don’t take from this “get the first one right and you’re golden!” or anything like that – the system has a lot more nuance than that. Like I said above, understanding electronic timing doesn’t make you a better sprinter, and understanding GMAT scoring won’t help you game it. The best advice you can take from this is “don’t make careless mistakes in the first 10 questions” (or really ever…but make sure you slow down and don’t let early jitters mess you up early) and “don’t be a perfectionist at the expense of having time for later questions”. A good start on the GMAT can easily be getting 6-7 of the first ten right.

As for our practice tests, I invite everyone to take them and see how the experience goes! Since the new test went live this spring we’ve heard from quite a few students that their scores on our new tests have been identical to those of their official test or their GMAT Prep test (you can see some of those reviews at http://gmatclub.com/forum/has-anyone-taken-the-veritas-prep-s-gmat-simulator-cat-exams-92320-20.html#p1227821), and as a teacher I’m even happier that people are getting an authentic experience.
_________________

Brian

Save $100 on live Veritas Prep GMAT Courses and Admissions Consulting

Enroll now. Pay later. Take advantage of Veritas Prep's flexible payment plan options.

Veritas Prep Reviews

Re: Mock GMAT exp with Veritas - Surprised   [#permalink] 15 Jul 2013, 11:43
    Similar topics Author Replies Last post
Similar
Topics:
Which is the best MOCK GMAT's module?Veritas Prep OR MGMAT Module? mvrravikanth 4 07 Sep 2014, 23:17
Veritas Prep Mock Exam Lisa81 0 28 Aug 2014, 12:50
GMAT VeritasPrep Two Mock Tests. nechets 0 23 Jan 2014, 08:50
Experts publish their posts in the topic Gmat Mock amrutagmat 2 07 Apr 2013, 20:33
Display posts from previous: Sort by

Mock GMAT exp with Veritas - Surprised

  Question banks Downloads My Bookmarks Reviews Important topics  

Moderators: m3equals333, TGC



GMAT Club MBA Forum Home| About| Privacy Policy| Terms and Conditions| GMAT Club Rules| Contact| Sitemap

Powered by phpBB © phpBB Group and phpBB SEO

Kindly note that the GMAT® test is a registered trademark of the Graduate Management Admission Council®, and this site has neither been reviewed nor endorsed by GMAC®.