GMAT Question of the Day - Daily to your Mailbox; hard ones only

It is currently 14 Oct 2019, 01:58

Close

GMAT Club Daily Prep

Thank you for using the timer - this advanced tool can estimate your performance and suggest more practice questions. We have subscribed you to Daily Prep Questions via email.

Customized
for You

we will pick new questions that match your level based on your Timer History

Track
Your Progress

every week, we’ll send you an estimated GMAT score based on your performance

Practice
Pays

we will pick new questions that match your level based on your Timer History

Not interested in getting valuable practice questions and articles delivered to your email? No problem, unsubscribe here.

Close

Request Expert Reply

Confirm Cancel

Data: GMAT even adaptive? Same no of questions/diffic level

  new topic post reply Question banks Downloads My Bookmarks Reviews Important topics  
Author Message
Intern
Intern
avatar
B
Status: Applying for R1
Joined: 22 Jul 2018
Posts: 8
Concentration: Finance, Marketing
GMAT 1: 680 Q49 V32
GPA: 3.45
WE: Information Technology (Computer Software)
Reviews Badge
Data: GMAT even adaptive? Same no of questions/diffic level  [#permalink]

Show Tags

New post Updated on: 13 Aug 2018, 00:56
3
1
UPDATE: As requested, I've uploaded finer charts showing how the test seems to adapt. The questions are sorted by order of appearance- I've done a bubble chart for the correct/wrong analysis, and a general trendline : You can see the way the test 'adapts' in terms of difficulty to a V28 scorer and a V47 scorer is just about the same weirdly!

https://imgur .com/a/wfeD1UY
https://imgur.com/a/wfeD1UY

ORIGINAL POST

Sorry for the click bait header, but this is an analysis that I just did. Apologies I couldn't come up with a better looking chart, but here you go.

https://imgur.com/a/YpiwtLe

I took each question from the gmatprep tests, found the link on gmatclub and sourced the difficulty level reported there - This is the interesting pattern that I found

Three different scores, from low to stellar: but almost the same number of 25% difficulty questions to 75%+ difficulty questions.

So is the GMAT, just in essence, a flat paper, that adapts the order of questions to a test taker?

Data from 3 GMAT Prep tests-Verbal Section

Test 1 - gmatprep1: V28 (left 5 questions in the end)
Test 2 - gmatprep2 :V47 (friends score)
Test 3 - gmatprep2: V36 (my score)

Lot of assumptions here, but in effect I've taken the difficulty reported on the forum at face value - and correlated data to it.

P.S: Would help if more of you folks share this, I can send my spreadsheet to you if you need to get started. It's as simple as copy pasting questions and noting down difficulty levels.

How it helped me : I read on Manhattan's book that the scoring algorithm looks at all your answers and finds which difficulty area you get around 50-60% of questions right. I noticed that I got around half the 35-45% difficulty wrong. But my accuracy was weirdly a little better in higher difficulty areas. Based on the hypothesis I'm predicting that is the zone keeping me away from V40. So I'm working on improving my accuracy there, I'll update here how this plan goes!

Posted from my mobile device
Attachments

XIv82gL.png
XIv82gL.png [ 71.77 KiB | Viewed 722 times ]


Originally posted by sudharshan931 on 12 Aug 2018, 15:40.
Last edited by sudharshan931 on 13 Aug 2018, 00:56, edited 2 times in total.
Founder
Founder
User avatar
V
Joined: 04 Dec 2002
Posts: 18193
Location: United States (WA)
GMAT 1: 750 Q49 V42
GPA: 3.5
GMAT ToolKit User Premium Member CAT Tests
Re: Data: GMAT even adaptive? Same no of questions/diffic level  [#permalink]

Show Tags

New post 12 Aug 2018, 15:56
Hi! Interesting analysis. Very cool! That took quite a bit of work to look up difficulty! Very Cool!!!

I am pretty sure GMAT is adaptive but I am not going to defend GMAC either :-)

There are a few things that come into play with the algorithm and that's progression of questions, experimental questions, and how many you get in a row right/wrong. You can learn a bit more here: https://gmatclub.com/forum/how-does-the ... 20297.html
_________________
Founder of GMAT Club

Just starting out with GMAT? Start here...

Discover Your Admit Options with Decision Tracker Filters!
Intern
Intern
avatar
B
Status: Applying for R1
Joined: 22 Jul 2018
Posts: 8
Concentration: Finance, Marketing
GMAT 1: 680 Q49 V32
GPA: 3.45
WE: Information Technology (Computer Software)
Reviews Badge
Re: Data: GMAT even adaptive? Same no of questions/diffic level  [#permalink]

Show Tags

New post 12 Aug 2018, 16:07
bb wrote:
Hi! Interesting analysis. Very cool! That took quite a bit of work to look up difficulty! Very Cool!!!

I am pretty sure GMAT is adaptive but I am not going to defend GMAC either :-)

There are a few things that come into play with the algorithm and that's progression of questions, experimental questions, and how many you get in a row right/wrong. You can learn a bit more here: https://gmatclub.com/forum/how-does-the ... 20297.html


Ah a reply from the MR.BB himself!

The header was a bit of a click bait haha, but my point was to show GMAT as a relatively flat test than what people think it is - which the data corroborates kind of. And of course I totally believe that some of the factors like not finishing the test, answering wrong in a row are all heavily penalized

It all started with a small excerpt I read from Manhattan's free book :

—----------------

The GMAT Scoring Algorithm for the Quantitative and Verbal Sections
Tests you took in school were generally based on the percentage of questions correct: the
more you got right, the higher the score you received. As a result, you have been trained to take
your time and try to get everything right when you take a test. This general strategy does not
work on computer-adaptive sections of the GMAT. The Quant and Verbal scores are not based
on the percentage of questions answered correctly. On the GMAT, most people actually answer
similar percentages of questions correctly, typically in the 50% to 70% range (even at higher
scoring levels).
If test-takers all get a similar percentage correct, how does the GMAT distinguish among differ-
ent performance levels? “Regular” school tests gave everyone the same questions and perfor-
mance was determined based upon who could answer more of those same questions correctly.
On the Quant and Verbal sections of the GMAT, everybody answers different questions, some
easier, some harder. You can think of the GMAT as a test that searches for each person’s “60%
level,” or the difficulty range in which the person is able to answer approximately 60% of the
questions correctly. (This is not exactly what happens, but it’s a good way to think of the differ-
ence between “regular” tests and computer-adaptive tests.) Your score will be determined by
the difficulty of the questions that you answer correctly versus the difficulty of those that you
answer incorrectly.

-----------------------------

Thus this kind of analysis is helping me find out whether this works out as a good hypothesis and also most importantly find out which level of difficulty I should be focusing on in the forum questions on a much finer level!

Posted from my mobile device
Director
Director
User avatar
P
Joined: 14 Dec 2017
Posts: 516
Location: India
Premium Member
Re: Data: GMAT even adaptive? Same no of questions/diffic level  [#permalink]

Show Tags

New post 12 Aug 2018, 22:45
Hey sudharshan931

Very interesting analysis.

Correct me if i am wrong, from your chart it seems like the test has a fixed number of questions for each difficulty level that it throws at the test taker, irrespective of whether the question is answered correctly or incorrectly. Hence the deduction that it is a flat test.

Curious to know how the chart will look, if we arrange the questions in the order they appeared on the test. Also highlighting each dot with a color code for Correct/Incorrect answer. Then you can super impose all the three charts in a single chart. It should be good to correlate the progression.

Regards,
GyM
_________________
Intern
Intern
avatar
B
Status: Applying for R1
Joined: 22 Jul 2018
Posts: 8
Concentration: Finance, Marketing
GMAT 1: 680 Q49 V32
GPA: 3.45
WE: Information Technology (Computer Software)
Reviews Badge
Data: GMAT even adaptive? Same no of questions/diffic level  [#permalink]

Show Tags

New post 13 Aug 2018, 00:54
2
GyMrAT wrote:
Hey sudharshan931

Very interesting analysis.

Correct me if i am wrong, from your chart it seems like the test has a fixed number of questions for each difficulty level that it throws at the test taker, irrespective of whether the question is answered correctly or incorrectly. Hence the deduction that it is a flat test.

Curious to know how the chart will look, if we arrange the questions in the order they appeared on the test. Also highlighting each dot with a color code for Correct/Incorrect answer. Then you can super impose all the three charts in a single chart. It should be good to correlate the progression.

Regards,
GyM


Done! Here you go - the questions are sorted by order
I've done a bubble chart for the correct/wrong analysis, and a general trendline : You can see the way the test 'adapts' in terms of difficulty to a V28 scorer and a V47 scorer is just about the same weirdly!

Attachment:
7h78SxW.jpg
7h78SxW.jpg [ 28.96 KiB | Viewed 469 times ]

Attachment:
MJP5TLS.jpg
MJP5TLS.jpg [ 32.32 KiB | Viewed 469 times ]

Attachment:
F1GXX6J.jpg
F1GXX6J.jpg [ 29.07 KiB | Viewed 472 times ]



https://imgur.com/a/wfeD1UY
Founder
Founder
User avatar
V
Joined: 04 Dec 2002
Posts: 18193
Location: United States (WA)
GMAT 1: 750 Q49 V42
GPA: 3.5
GMAT ToolKit User Premium Member CAT Tests
Re: Data: GMAT even adaptive? Same no of questions/diffic level  [#permalink]

Show Tags

New post 13 Aug 2018, 08:48
Hi. Thanks for updating this project! It is starting to look more like a pattern.

Usually we say that the GMAT Score depends on the number of hard questions you answer correctly. I see in your first list/diagram you have the total number of questions by percentile, not just the ones that were answered correctly. I would suggest that you consider re-doing/re-working the very first chart with incorrect questions removed from it and you will see the difference. You can also do the same first chart with plotting only incorrect questions. I have no idea if it will be helpful - i am guessing less helpful than the mapping of correct questions only.
_________________
Founder of GMAT Club

Just starting out with GMAT? Start here...

Discover Your Admit Options with Decision Tracker Filters!
Director
Director
User avatar
P
Joined: 14 Dec 2017
Posts: 516
Location: India
Premium Member
Re: Data: GMAT even adaptive? Same no of questions/diffic level  [#permalink]

Show Tags

New post 13 Aug 2018, 10:29
Hi sudharshan931

Awesome job bud! Definite pattern in there, wondering why the test throws a easier question than the previous one which was answered correctly or similarly throws a tougher question than the previous one which was answered incorrectly. I think it is because the questions are from a single RC passage. However if they are not RC questions & if it is a string of SC or CR questions, going down or up in difficulty, then that does put a big question mark on the adaptability of the test.

The first quarter & last quarter of V28 is really weird, questions are going down in difficulty even after answering correctly & going up in difficulty after getting answered incorrectly. I can understand if they go up in difficulty, which basically gives the test taker a chance to up the baseline. Not sure about the going down part though.

In the second quarter of V47, i wonder why the test lowered its difficulty, unless ofcourse that was an RC, it seems like the test robbed the test taker of the opportunity to score higher than V47, if instead those questions were of higher difficulty & were answered correctly, the base line could have been raised. Well your friend scoring a V47, needless to say, is going to rock the GMAT.

Thanks for doing this, bud! its good fun! Would love to see what more you come up with.


Cheers,
GyM
_________________
GMAT Club Bot
Re: Data: GMAT even adaptive? Same no of questions/diffic level   [#permalink] 13 Aug 2018, 10:29
Display posts from previous: Sort by

Data: GMAT even adaptive? Same no of questions/diffic level

  new topic post reply Question banks Downloads My Bookmarks Reviews Important topics  

Moderator: DisciplinedPrep






Powered by phpBB © phpBB Group | Emoji artwork provided by EmojiOne