GMAT Question of the Day - Daily to your Mailbox; hard ones only

It is currently 14 Dec 2018, 23:32

Close

GMAT Club Daily Prep

Thank you for using the timer - this advanced tool can estimate your performance and suggest more practice questions. We have subscribed you to Daily Prep Questions via email.

Customized
for You

we will pick new questions that match your level based on your Timer History

Track
Your Progress

every week, we’ll send you an estimated GMAT score based on your performance

Practice
Pays

we will pick new questions that match your level based on your Timer History

Not interested in getting valuable practice questions and articles delivered to your email? No problem, unsubscribe here.

Close

Request Expert Reply

Confirm Cancel
Events & Promotions in December
PrevNext
SuMoTuWeThFrSa
2526272829301
2345678
9101112131415
16171819202122
23242526272829
303112345
Open Detailed Calendar
  • Free GMAT Strategy Webinar

     December 15, 2018

     December 15, 2018

     07:00 AM PST

     09:00 AM PST

    Aiming to score 760+? Attend this FREE session to learn how to Define your GMAT Strategy, Create your Study Plan and Master the Core Skills to excel on the GMAT.
  • $450 Tuition Credit & Official CAT Packs FREE

     December 15, 2018

     December 15, 2018

     10:00 PM PST

     11:00 PM PST

    Get the complete Official GMAT Exam Pack collection worth $100 with the 3 Month Pack ($299)

Data: GMAT even adaptive? Same no of questions/diffic level

  new topic post reply Question banks Downloads My Bookmarks Reviews Important topics  
Author Message
Intern
Intern
avatar
B
Status: Applying for R1
Joined: 22 Jul 2018
Posts: 8
Concentration: Finance, Marketing
GMAT 1: 680 Q49 V32
GPA: 3.45
WE: Information Technology (Computer Software)
Reviews Badge
Data: GMAT even adaptive? Same no of questions/diffic level  [#permalink]

Show Tags

New post Updated on: 12 Aug 2018, 23:56
3
1
UPDATE: As requested, I've uploaded finer charts showing how the test seems to adapt. The questions are sorted by order of appearance- I've done a bubble chart for the correct/wrong analysis, and a general trendline : You can see the way the test 'adapts' in terms of difficulty to a V28 scorer and a V47 scorer is just about the same weirdly!

https://imgur .com/a/wfeD1UY
https://imgur.com/a/wfeD1UY

ORIGINAL POST

Sorry for the click bait header, but this is an analysis that I just did. Apologies I couldn't come up with a better looking chart, but here you go.

https://imgur.com/a/YpiwtLe

I took each question from the gmatprep tests, found the link on gmatclub and sourced the difficulty level reported there - This is the interesting pattern that I found

Three different scores, from low to stellar: but almost the same number of 25% difficulty questions to 75%+ difficulty questions.

So is the GMAT, just in essence, a flat paper, that adapts the order of questions to a test taker?

Data from 3 GMAT Prep tests-Verbal Section

Test 1 - gmatprep1: V28 (left 5 questions in the end)
Test 2 - gmatprep2 :V47 (friends score)
Test 3 - gmatprep2: V36 (my score)

Lot of assumptions here, but in effect I've taken the difficulty reported on the forum at face value - and correlated data to it.

P.S: Would help if more of you folks share this, I can send my spreadsheet to you if you need to get started. It's as simple as copy pasting questions and noting down difficulty levels.

How it helped me : I read on Manhattan's book that the scoring algorithm looks at all your answers and finds which difficulty area you get around 50-60% of questions right. I noticed that I got around half the 35-45% difficulty wrong. But my accuracy was weirdly a little better in higher difficulty areas. Based on the hypothesis I'm predicting that is the zone keeping me away from V40. So I'm working on improving my accuracy there, I'll update here how this plan goes!

Posted from my mobile device
Attachments

XIv82gL.png
XIv82gL.png [ 71.77 KiB | Viewed 569 times ]


Originally posted by sudharshan931 on 12 Aug 2018, 14:40.
Last edited by sudharshan931 on 12 Aug 2018, 23:56, edited 2 times in total.
Founder
Founder
User avatar
V
Joined: 04 Dec 2002
Posts: 16984
Location: United States (WA)
GMAT 1: 750 Q49 V42
GPA: 3.5
GMAT ToolKit User Premium Member CAT Tests
Re: Data: GMAT even adaptive? Same no of questions/diffic level  [#permalink]

Show Tags

New post 12 Aug 2018, 14:56
Hi! Interesting analysis. Very cool! That took quite a bit of work to look up difficulty! Very Cool!!!

I am pretty sure GMAT is adaptive but I am not going to defend GMAC either :-)

There are a few things that come into play with the algorithm and that's progression of questions, experimental questions, and how many you get in a row right/wrong. You can learn a bit more here: https://gmatclub.com/forum/how-does-the ... 20297.html
_________________

Founder of GMAT Club

Just starting out with GMAT? Start here...
OG2019 Directory is here!
Want to know application stats & Profiles from last year? Check the Decision Tracker

Co-author of the GMAT Club tests

Intern
Intern
avatar
B
Status: Applying for R1
Joined: 22 Jul 2018
Posts: 8
Concentration: Finance, Marketing
GMAT 1: 680 Q49 V32
GPA: 3.45
WE: Information Technology (Computer Software)
Reviews Badge
Re: Data: GMAT even adaptive? Same no of questions/diffic level  [#permalink]

Show Tags

New post 12 Aug 2018, 15:07
bb wrote:
Hi! Interesting analysis. Very cool! That took quite a bit of work to look up difficulty! Very Cool!!!

I am pretty sure GMAT is adaptive but I am not going to defend GMAC either :-)

There are a few things that come into play with the algorithm and that's progression of questions, experimental questions, and how many you get in a row right/wrong. You can learn a bit more here: https://gmatclub.com/forum/how-does-the ... 20297.html


Ah a reply from the MR.BB himself!

The header was a bit of a click bait haha, but my point was to show GMAT as a relatively flat test than what people think it is - which the data corroborates kind of. And of course I totally believe that some of the factors like not finishing the test, answering wrong in a row are all heavily penalized

It all started with a small excerpt I read from Manhattan's free book :

—----------------

The GMAT Scoring Algorithm for the Quantitative and Verbal Sections
Tests you took in school were generally based on the percentage of questions correct: the
more you got right, the higher the score you received. As a result, you have been trained to take
your time and try to get everything right when you take a test. This general strategy does not
work on computer-adaptive sections of the GMAT. The Quant and Verbal scores are not based
on the percentage of questions answered correctly. On the GMAT, most people actually answer
similar percentages of questions correctly, typically in the 50% to 70% range (even at higher
scoring levels).
If test-takers all get a similar percentage correct, how does the GMAT distinguish among differ-
ent performance levels? “Regular” school tests gave everyone the same questions and perfor-
mance was determined based upon who could answer more of those same questions correctly.
On the Quant and Verbal sections of the GMAT, everybody answers different questions, some
easier, some harder. You can think of the GMAT as a test that searches for each person’s “60%
level,” or the difficulty range in which the person is able to answer approximately 60% of the
questions correctly. (This is not exactly what happens, but it’s a good way to think of the differ-
ence between “regular” tests and computer-adaptive tests.) Your score will be determined by
the difficulty of the questions that you answer correctly versus the difficulty of those that you
answer incorrectly.

-----------------------------

Thus this kind of analysis is helping me find out whether this works out as a good hypothesis and also most importantly find out which level of difficulty I should be focusing on in the forum questions on a much finer level!

Posted from my mobile device
Director
Director
User avatar
P
Joined: 14 Dec 2017
Posts: 518
Location: India
Premium Member
Re: Data: GMAT even adaptive? Same no of questions/diffic level  [#permalink]

Show Tags

New post 12 Aug 2018, 21:45
Hey sudharshan931

Very interesting analysis.

Correct me if i am wrong, from your chart it seems like the test has a fixed number of questions for each difficulty level that it throws at the test taker, irrespective of whether the question is answered correctly or incorrectly. Hence the deduction that it is a flat test.

Curious to know how the chart will look, if we arrange the questions in the order they appeared on the test. Also highlighting each dot with a color code for Correct/Incorrect answer. Then you can super impose all the three charts in a single chart. It should be good to correlate the progression.

Regards,
GyM
_________________

New to GMAT Club - https://gmatclub.com/forum/new-to-gmat-club-need-help-271131.html#p2098335

Intern
Intern
avatar
B
Status: Applying for R1
Joined: 22 Jul 2018
Posts: 8
Concentration: Finance, Marketing
GMAT 1: 680 Q49 V32
GPA: 3.45
WE: Information Technology (Computer Software)
Reviews Badge
Data: GMAT even adaptive? Same no of questions/diffic level  [#permalink]

Show Tags

New post 12 Aug 2018, 23:54
2
GyMrAT wrote:
Hey sudharshan931

Very interesting analysis.

Correct me if i am wrong, from your chart it seems like the test has a fixed number of questions for each difficulty level that it throws at the test taker, irrespective of whether the question is answered correctly or incorrectly. Hence the deduction that it is a flat test.

Curious to know how the chart will look, if we arrange the questions in the order they appeared on the test. Also highlighting each dot with a color code for Correct/Incorrect answer. Then you can super impose all the three charts in a single chart. It should be good to correlate the progression.

Regards,
GyM


Done! Here you go - the questions are sorted by order
I've done a bubble chart for the correct/wrong analysis, and a general trendline : You can see the way the test 'adapts' in terms of difficulty to a V28 scorer and a V47 scorer is just about the same weirdly!

Attachment:
7h78SxW.jpg
7h78SxW.jpg [ 28.96 KiB | Viewed 316 times ]

Attachment:
MJP5TLS.jpg
MJP5TLS.jpg [ 32.32 KiB | Viewed 316 times ]

Attachment:
F1GXX6J.jpg
F1GXX6J.jpg [ 29.07 KiB | Viewed 319 times ]



https://imgur.com/a/wfeD1UY
Founder
Founder
User avatar
V
Joined: 04 Dec 2002
Posts: 16984
Location: United States (WA)
GMAT 1: 750 Q49 V42
GPA: 3.5
GMAT ToolKit User Premium Member CAT Tests
Re: Data: GMAT even adaptive? Same no of questions/diffic level  [#permalink]

Show Tags

New post 13 Aug 2018, 07:48
Hi. Thanks for updating this project! It is starting to look more like a pattern.

Usually we say that the GMAT Score depends on the number of hard questions you answer correctly. I see in your first list/diagram you have the total number of questions by percentile, not just the ones that were answered correctly. I would suggest that you consider re-doing/re-working the very first chart with incorrect questions removed from it and you will see the difference. You can also do the same first chart with plotting only incorrect questions. I have no idea if it will be helpful - i am guessing less helpful than the mapping of correct questions only.
_________________

Founder of GMAT Club

Just starting out with GMAT? Start here...
OG2019 Directory is here!
Want to know application stats & Profiles from last year? Check the Decision Tracker

Co-author of the GMAT Club tests

Director
Director
User avatar
P
Joined: 14 Dec 2017
Posts: 518
Location: India
Premium Member
Re: Data: GMAT even adaptive? Same no of questions/diffic level  [#permalink]

Show Tags

New post 13 Aug 2018, 09:29
Hi sudharshan931

Awesome job bud! Definite pattern in there, wondering why the test throws a easier question than the previous one which was answered correctly or similarly throws a tougher question than the previous one which was answered incorrectly. I think it is because the questions are from a single RC passage. However if they are not RC questions & if it is a string of SC or CR questions, going down or up in difficulty, then that does put a big question mark on the adaptability of the test.

The first quarter & last quarter of V28 is really weird, questions are going down in difficulty even after answering correctly & going up in difficulty after getting answered incorrectly. I can understand if they go up in difficulty, which basically gives the test taker a chance to up the baseline. Not sure about the going down part though.

In the second quarter of V47, i wonder why the test lowered its difficulty, unless ofcourse that was an RC, it seems like the test robbed the test taker of the opportunity to score higher than V47, if instead those questions were of higher difficulty & were answered correctly, the base line could have been raised. Well your friend scoring a V47, needless to say, is going to rock the GMAT.

Thanks for doing this, bud! its good fun! Would love to see what more you come up with.


Cheers,
GyM
_________________

New to GMAT Club - https://gmatclub.com/forum/new-to-gmat-club-need-help-271131.html#p2098335

GMAT Club Bot
Re: Data: GMAT even adaptive? Same no of questions/diffic level &nbs [#permalink] 13 Aug 2018, 09:29
Display posts from previous: Sort by

Data: GMAT even adaptive? Same no of questions/diffic level

  new topic post reply Question banks Downloads My Bookmarks Reviews Important topics  

Moderator: HKD1710



Copyright

GMAT Club MBA Forum Home| About| Terms and Conditions and Privacy Policy| GMAT Club Rules| Contact| Sitemap

Powered by phpBB © phpBB Group | Emoji artwork provided by EmojiOne

Kindly note that the GMAT® test is a registered trademark of the Graduate Management Admission Council®, and this site has neither been reviewed nor endorsed by GMAC®.