It is currently 17 Oct 2017, 22:56

### GMAT Club Daily Prep

#### Thank you for using the timer - this advanced tool can estimate your performance and suggest more practice questions. We have subscribed you to Daily Prep Questions via email.

Customized
for You

we will pick new questions that match your level based on your Timer History

Track

every week, we’ll send you an estimated GMAT score based on your performance

Practice
Pays

we will pick new questions that match your level based on your Timer History

# Events & Promotions

###### Events & Promotions in June
Open Detailed Calendar

# Mock GMAT exp with Veritas - Surprised

Author Message
TAGS:

### Hide Tags

Intern
Joined: 21 Oct 2012
Posts: 3

Kudos [?]: [0], given: 0

Mock GMAT exp with Veritas - Surprised [#permalink]

### Show Tags

13 Jul 2013, 07:24
I recently wrote a mock GMAT test with Veritas and for my surprise, I felt the scores were not resembling the total number of correct answers. I drafted a mail and sent it to Veritas Prep, but didn't get any reply. So, I felt I would post my mail here, if I could get a possible reply from the experienced people in this forum.

I tried the free GMAT prep test in Veritas and got a 680/800, which has provided me a good moral boost. But when I started assessing the answers, I was quite surprised to find that there were a lot of wrong answers, but still the over-all score was high. This poses a fear to me, if the over-all score shown is right or not.

Here is the summary wrt verbal & Quants.

Verbal - Total no. of correct questions - 22/41; Score - 38 & 84 percentile
Correct questions - 1,5,6,8,9,10,12,14,15,17,19,20,21,22,24,25,26,30,32,34,37,38

Quants - Total no. of correct questions - 22/37; Score - 46 & 71 precentile.
Correct questions - 1,4,5,6,8,10,11,12,14,15,19,22,26,27,28,29,30,32,33,35,36,37

I learnt that if the first few questions are wrong, then the drop in overall score would be so high and this was also quite suprising in this case because in both Quant & Verbal the second 2 or 3 questions were wrong, but still getting a score of 680 appears as a shock.

Kindly comment.

Kudos [?]: [0], given: 0

 Veritas Prep GMAT Discount Codes Kaplan GMAT Prep Discount Codes e-GMAT Discount Codes
Manager
Joined: 26 Dec 2011
Posts: 152

Kudos [?]: 10 [0], given: 18

Location: United States (NY)
Concentration: Finance, Entrepreneurship
GPA: 3.42
WE: Investment Banking (Investment Banking)
Re: Mock GMAT exp with Veritos - Surprised [#permalink]

### Show Tags

14 Jul 2013, 15:51
The number of questions you get correct is not as important as the difficulty of the questions you get correct.

That said, it is very possible that the score is in fact accurate.
_________________

Kudos [?]: 10 [0], given: 18

Manager
Joined: 07 Feb 2012
Posts: 68

Kudos [?]: 11 [0], given: 0

GMAT Date: 04-19-2012
Re: Mock GMAT exp with Veritos - Surprised [#permalink]

### Show Tags

14 Jul 2013, 19:15
Do you mean Veritas? If so, no one takes that test seriously. The only reliable practice tests out there are GMAT Prep and Manhattan Gmat. Don't waste your time with others. I'll probably get bashed by some people working for Veritas but I think that's how most people see the practice tests..You can ask anyone.. theres no way your getting 22/41 on verbal and getting a 38... just not happening..

Kudos [?]: 11 [0], given: 0

Veritas Prep GMAT Instructor
Joined: 26 Jul 2010
Posts: 252

Kudos [?]: 574 [4], given: 32

Re: Mock GMAT exp with Veritas - Surprised [#permalink]

### Show Tags

15 Jul 2013, 12:43
4
KUDOS
Thank you for taking the new Veritas Prep Practice Test! And thanks, actually, for bringing up the scoring – we love talking about the scoring algorithm and how it works.

Why “Percent Correct” Doesn’t Matter Nearly As Much As You Think

The IRT system has two main functions – item administration (which questions you see) and ability estimation (your score). And each system informs the other. Once the ability estimate feels confident that you’re above average, for example, it delivers questions that are most likely to help it determine “just how far above average?” – which means that you’ll miss several questions even if you’re in the 90th percentile, because it’s trying to determine whether you’re above that level and the only way to know is to continue testing your upper limit.
Now, the simplified explanation strips out a good amount of IRT nuance and basically says this: once the system has narrowed in on your ability you should theoretically get half the remaining questions wrong; if you’re 75th percentile, you should be getting all the 80th questions wrong and all the 70th questions right, and the system will keep pinballing you between those levels. That’s not 100% accurate but it’s close enough for a close-enough understanding of the scoring system. Almost everyone will miss a lot of questions once the system has started to figure out your threshold. And according to IRT theory it doesn’t take too long to get there – within 6-7 questions the system usually has a pretty good feel for your ability level.

What’s really happening with the ability estimation is that it’s calculating the probability of someone with your responses having each score. And here’s where conventional forum wisdom tends to miss the nuance of IRT – we see “you get a question right it gives you a harder question / you get it wrong it gives you an easier one”. What the system is really doing after each response is using all of your responses to date to estimate the probability of your having each score, and not all questions carry equal weight. Again, the IRT system heavily relies on probability – some questions are much more potent at determining whether you’re above or below a certain threshold and others are a little less telling. The system takes these weights into account, particularly as your score moves. These weights also have to account for content delivery – the system might want to ask you a “more potent” Sentence Correction question but need to deliver you another Reading Comprehension passage, and so those RC questions might not carry the same weight as the questions before it.

Which is all a long way of saying “it’s complicated” – so let’s take a look under the hood at your test so I can show you how the system worked.

(BTW – since your GMATClub handle was also part of your login for your test this was relatively easy for me to find…hope you don’t mind my pulling it up)

So after three questions, the system saw you as around the 60th percentile, and gave you a subsequent question consistent with that estimate…and then you rattled off three straight correct answers on some relatively tough problems. And after you missed that 7th question, you went on a nice run of more-right-than-wrong before you hit your first real trouble patch of three straight wrong…and by that point the system had already pegged you as being around a standard deviation above average, so those wrong answers were all on hard questions. Had you free-fallen a little more you might have been in trouble, but you stemmed the tide nicely with a couple correct answers to break up those trouble patches and the system more gradually moved its estimate down. Then when you got back on track with a few runs of 4+ correct, you limited the damage – at your peak you would have gotten a Q49, so those rough patches came on some really tough problems.

Which I guess brings me back to why your correct percentage doesn’t tell the whole story – since your first question’s “most potent” point (where it gives the highest distinction between ability levels) is a tick above absolutely average, you never saw a “below-average” problem on the quant section. So you were supposed to get a lot of those questions wrong, as do most others who see 37 straight “difficult” problems. So when you’re graded based on your ability level compared with that of others your performance looks all the better – most people when seeing the run of questions you did in a test format would have performed worse.

On the verbal side, the setup was similar and I should also mention that two of your verbal mistakes came on unscored, experimental questions (we include those like the GMAT does and for the same reason – to get good statistics on questions for use in subsequent tests). So if you take those out your correct % goes even higher.

What you can learn from this

While I can’t guarantee that the official GMAT uses “stock” Item Response Theory (it may add in a few scaffolds or tweaks for its own purposes but I know it adheres very closely to, if not 100% to, IRT), you can learn from this experience with IRT that:

1) Getting “the first 10 questions right” isn’t what many say it is. You can miss 4-5 of the first 10 and still leave that set with the computer estimating you well above average.

2) The key is, instead, to make sure you don’t miss many easy questions. Doing so impacts the ability estimate (you’ve given the system a data point that you now have to overcome) and the item delivery (if you miss an easy question, the system is more apt to deliver you questions around that level to test your “floor” instead of your “ceiling”, so you give yourself a narrow margin of error and you don’t get as many opportunities to prove that you’re elite)

3) The IRT system is nearly impossible to game. Remember – your ability is calculated by your probability of certain scores and it takes into account all of your previous responses. Please don’t take from this “get the first one right and you’re golden!” or anything like that – the system has a lot more nuance than that. Like I said above, understanding electronic timing doesn’t make you a better sprinter, and understanding GMAT scoring won’t help you game it. The best advice you can take from this is “don’t make careless mistakes in the first 10 questions” (or really ever…but make sure you slow down and don’t let early jitters mess you up early) and “don’t be a perfectionist at the expense of having time for later questions”. A good start on the GMAT can easily be getting 6-7 of the first ten right.

As for our practice tests, I invite everyone to take them and see how the experience goes! Since the new test went live this spring we’ve heard from quite a few students that their scores on our new tests have been identical to those of their official test or their GMAT Prep test (you can see some of those reviews at http://gmatclub.com/forum/has-anyone-taken-the-veritas-prep-s-gmat-simulator-cat-exams-92320-20.html#p1227821), and as a teacher I’m even happier that people are getting an authentic experience.
_________________

Brian

Save \$100 on live Veritas Prep GMAT Courses and Admissions Consulting

Enroll now. Pay later. Take advantage of Veritas Prep's flexible payment plan options.

Veritas Prep Reviews

Kudos [?]: 574 [4], given: 32

Re: Mock GMAT exp with Veritas - Surprised   [#permalink] 15 Jul 2013, 12:43
Display posts from previous: Sort by

# Mock GMAT exp with Veritas - Surprised

Moderator: EMPOWERgmatRichC

 Powered by phpBB © phpBB Group | Emoji artwork provided by EmojiOne Kindly note that the GMAT® test is a registered trademark of the Graduate Management Admission Council®, and this site has neither been reviewed nor endorsed by GMAC®.