How accurate is the Manhattan CAT? (huge score diff on Quant)

Question

I took a GMATPrep CAT about 2 months ago and scored a 25Q and 21V. I was very distracted during the exam because I was at barnes and nobles and it wasn't exactly quiet - I also had to move several times. I skipped questions and didn't try my best for both sections, to be honest... even had paragraphs I didn't even bother reading. In the end, I received a 400 and it made me cry a little.

Because there are only 2 CATs available for GMATPrep, I am saving the 2nd attempt a week before I take the actual test and so I decided to take the Manhattan GMAT CAT just now. I attempted the Quant section under desirable conditions (quiet area) and gave it my all and received a 37. I skipped the V entirely and received a 3 because I just wanted to see my Quant score. My overall score (the 37Q and 3V) is 410.

I don't know what to think at this point. My Manhattan Quant score alone gives a higher score than the overall that I received on the GMATPrep. Just how accurate is the free Manhattan CAT offered on the website? Keep in mind, I studied very little during the two months time frame, and so my knowledge in math is pretty much the same. It's just that the testing conditions were different and I tried harder on Manhattan's exam.

Any input is appreciated!

Thanks!

EMPOWERgmatRichC · Answer

Hi hopelessgrad,

The MGMAT CATs are close-enough to the Official GMAT to be a reasonable way to measure your GMAT skills. However, the experience of taking a CAT is only as accurate as YOU make it. From what you described, you were only interested in seeing the Quant section, so I'm going to assume that you skipped the Essay and IR sections. THAT is not realistic. On Test Day, you're going to face the better part of 1.5 hours of activity BEFORE you start the Quant section, so you have to factor that into your practice.

Also, since you've admitted to not studying much over the course of the last 2 months, you could experience big "swings" in your practice scores in the short term since you haven't really honed your skills. This is all meant to say that the Q37 is probably not a reliable indicator of your skills YET, but that doesn't have anything to do with the CAT.

GMAT assassins aren't born, they're made,
Rich

hopelessgrad · Answer

Thanks for the reply, Rich. But why would I experience "big swings" if I havent really studied? I think the distractions I faced the first time versus the second time definitely would make a difference, but not that big of a score jump. I did work on an essay for a class prior to starting the exam so I figured I could skip the one on the practice exam and be fine.

I plan on taking another practice test today under the exact conditions on test day to see where I really stand. Not sure what I should use as my next practice CAT as I really want to save the remaining GMATPrep for when Im really ready.

EMPOWERgmatRichC · Answer

Hi hopelessgrad,

In your original post, you described how your first practice CAT was taken under 'less-than-ideal' circumstances (at a Barnes & Noble, noisy, lots of moving around, you didn't try your best), so the Q25 that you scored likely wasn't a true measure of your ability. Now you've taken the one section under more 'strict' circumstances (although still not in a completely realistic fashion), so the Q37 is probably at the 'high end' of your current skill level. My suspicion is if you took a FULL-LENGTH CAT in the next few days, you would probably score below a Q37. THAT's what I mean by 'swings' - so far, you haven't taken a FULL CAT under the proper conditions, so your scores are more likely to swing.

There are plenty of respectable CATs that you can purchase, so you're not in any danger of "running out" of CATs just yet.

GMAT assassins aren't born, they're made,
Rich

hopelessgrad · Answer

Thank you Rich, that makes sense. I guess I just needed some reassurance that the 37Q isn't a totally false score! It did make more sense to me as I've always scored around the 50th percentile or a little above on Quant when it came to the SAT/ACT... the 37Q is around the 40th percentile. I'm not aiming for a 700, I'd be thrilled to get above a 600 at this point (hoping for a 650). I've been studying for the verbal section more than math. I figured I can master the SC portion and really increase my score instead of just focusing on math (which quite frankly, is really a lot to cover). I'm not studying at all for the essay, IR, and CR.

dabral · Answer

hopelessgrad

There are several factors here that can cause huge disparities in score. I will list a bunch of them:
1) Taking GMATPrep for the first time is an extremely difficult experience, and just the shock of having to deal with the novelty and the pressure of the CAT can lead to low scores. I have seen this time and again with majority of my students. This is normal, and you should treat it as part of the game about getting to know the real GMAT.
2) If you didn't complete the entire section, meaning did not get to question#37, then that can also lead to a really low score. There is a huge penalty for not completing the test. 
3) Third part CATs are almost never accurate in how well they will predict your real GMAT performance. Use them to enhance your stamina and ability to deal with the draining computer adaptive tests. If you need accurate predictions, use the two free GMATprep tests and the additional two CATs that are called Exam Pack 1(these you do have to buy from mba.com).
4) Also, the fact that you took the Quant alone and under quiet conditions is another reason for a better performance. I have always advised students to not take the GMAT CATs in a cafe, they need to be in a quiet place such as the local library(those sound proof rooms are the best in my opinion). You need to zone out everything. Real GMAT demands a lot of concentration.

Cheers,
Dabral

hopelessgrad · Answer

Thank you Dabral! I wasn't aware that there were two extra ones available for purchase on the mba website. I guess the best thing I can do at this point is perhaps study for another week and take the 2nd GMATPrep under exact testing conditions to really accurately predict my score for test day. Will definitely be doing it in a library this time!

dabral · Answer

hopelessgrad

That sounds like a plan, this will give you a solid assessment of where you stand. If you need additional timed practice, one option would be to create practice sets using GMATPrep Question Pack 1 database of questions for both quant and verbal. You won't get a score but it is a good way to keep up the pressure of testing environment. See the attached image.

Dabral

DmitryFarberMPrep · Answer

I rarely hear anyone say that our quant is easier than the real thing!

Since any 3rd-party test will differ in some ways from the official product, naturally some people will do a little better or a little worse on GMATPrep (and the real thing) than they do on the CATs from MGMAT (or any other company). Having said that, it's not enough to create the kind of difference you're describing. Unless you had an improbably epic streak of lucky guesses, I'd say your GMATPrep score was just the result of a bad experience. Take a few weeks to study and then take another test--ours, MGMAT's, doesn't matter. Hopefully that score will confirm that you deserve to score higher than Q25!

How accurate is the Manhattan CAT? (huge score diff on Quant)

Prep Toolkit

Top 5 GMAT Debrief Videos

615 to 715 in 15 Days (Ria's Strategies)

More than Quant/Verbal Abilities: Speed vs. Accuracy

745 with Only Self-Prep and GMAT Club

From 555 to 765: 210-point Improvement

Perfect 805 Score Debrief by Julia

My Rewards