Last visit was: 14 Dec 2024, 06:37 It is currently 14 Dec 2024, 06:37
Close
GMAT Club Daily Prep
Thank you for using the timer - this advanced tool can estimate your performance and suggest more practice questions. We have subscribed you to Daily Prep Questions via email.

Customized
for You

we will pick new questions that match your level based on your Timer History

Track
Your Progress

every week, we’ll send you an estimated GMAT score based on your performance

Practice
Pays

we will pick new questions that match your level based on your Timer History
Not interested in getting valuable practice questions and articles delivered to your email? No problem, unsubscribe here.
Close
Request Expert Reply
Confirm Cancel
avatar
SynPo800
Joined: 15 Apr 2018
Last visit: 12 Nov 2019
Posts: 17
Own Kudos:
3
 []
Given Kudos: 26
Posts: 17
Kudos: 3
 []
1
Kudos
Add Kudos
Bookmarks
Bookmark this Post
User avatar
bb
User avatar
Founder
Joined: 04 Dec 2002
Last visit: 13 Dec 2024
Posts: 39,370
Own Kudos:
76,728
 []
Given Kudos: 21,581
Location: United States (WA)
GMAT 1: 750 Q49 V42
GPA: 3
Products:
Expert reply
Active GMAT Club Expert! Tag them with @ followed by their username for a faster response.
GMAT 1: 750 Q49 V42
Posts: 39,370
Kudos: 76,728
 []
2
Kudos
Add Kudos
Bookmarks
Bookmark this Post
avatar
SynPo800
Joined: 15 Apr 2018
Last visit: 12 Nov 2019
Posts: 17
Own Kudos:
Given Kudos: 26
Posts: 17
Kudos: 3
Kudos
Add Kudos
Bookmarks
Bookmark this Post
User avatar
ScottTargetTestPrep
User avatar
Target Test Prep Representative
Joined: 14 Oct 2015
Last visit: 13 Dec 2024
Posts: 19,869
Own Kudos:
24,292
 []
Given Kudos: 288
Status:Founder & CEO
Affiliations: Target Test Prep
Location: United States (CA)
Expert reply
Active GMAT Club Expert! Tag them with @ followed by their username for a faster response.
Posts: 19,869
Kudos: 24,292
 []
1
Kudos
Add Kudos
Bookmarks
Bookmark this Post
Hi SynPo800,

The good news is that V44 is a VERY GOOD verbal score. Also, as BB mentioned, it’s difficult to know the specifics of the GMAC algorithm, so you can never know for sure why those two incorrect questions resulted in V44. Have you taken any other official GMAC practice exams?
User avatar
Hovkial
Joined: 23 Apr 2019
Last visit: 24 Nov 2022
Posts: 805
Own Kudos:
Given Kudos: 203
Status:PhD trained. Education research, management.
Posts: 805
Kudos: 2,086
Kudos
Add Kudos
Bookmarks
Bookmark this Post
bb

Tests one and two have a large database of questions but test 3, 4, 5, and 6 have Barely enough questions for one test and generally are not of high difficulty.

We had a user who got every single question correct and he still got IV 48 or something like that on the real test. He appealed and his sectional score was revised up to the 51.



Need additional insights on the above two points:

1. The assertion about variable quantities of questions in tests 1 through 6. First, is it confirmed (by whom?) that tests 1 and 2 have large pools, while the others barely enough. Would this mean that resetting tests 3-6 would result in many repeated questions?

I understand from some posts here that tests 1 and 2, and perhaps the others - please confirm - can be reset multiple times with some new and repeated questions. Is this correct?

2. Appeal to investigate score of V48 with all correct answers and subsequent revision of score: Did GMAC provide official explanations for how such a situation occurred? Were there errors or something else?

Curious to know these stories in more detail. Yes I have read some of the posts pertaining to these two points, but I remain unclear about them.

Thanks.

Posted from my mobile device
avatar
Sammysat
Joined: 30 Nov 2017
Last visit: 09 Nov 2022
Posts: 119
Own Kudos:
Given Kudos: 25
WE:Consulting (Consulting)
Posts: 119
Kudos: 109
Kudos
Add Kudos
Bookmarks
Bookmark this Post
Congratulations on your great score. In my opinion, I think failing 2 questions should have given you a better verbal score. Anyway, all the best.

Posted from my mobile device
User avatar
TestPrepUnlimited
Joined: 17 Sep 2014
Last visit: 30 Jun 2022
Posts: 1,239
Own Kudos:
Given Kudos: 6
Location: United States
GMAT 1: 780 Q51 V45
GRE 1: Q170 V167
Expert reply
GMAT 1: 780 Q51 V45
GRE 1: Q170 V167
Posts: 1,239
Kudos: 1,015
Kudos
Add Kudos
Bookmarks
Bookmark this Post
SynPo800
I'm having a bit of trouble understanding how the verbal scoring works.

I got 2 questions wrong in verbal:
Question #23 and question #25 - how does that equate to a V44?

The two questions could have been at a lower difficulty level. Congrats on your score!
User avatar
IanStewart
User avatar
GMAT Tutor
Joined: 24 Jun 2008
Last visit: 13 Dec 2024
Posts: 4,126
Own Kudos:
9,921
 []
Given Kudos: 97
 Q51  V47
Expert reply
Posts: 4,126
Kudos: 9,921
 []
1
Kudos
Add Kudos
Bookmarks
Bookmark this Post
There have been one or two test takers with no wrong answers who have gotten V50 scores, not V48 scores (or at least not that I've seen, and that seems extremely unlike to me). On appeal, GMAC revised the scores upwards to V51. You can understand why this could happen - if a test taker gets every question right, the algorithm can be very confident the test taker is above a certain level, but can't say exactly how far above. If a test doesn't contain a lot of extremely hard questions, then with entirely correct answers, the test might only be nearly certain the test taker is at least a V50, but might not have enough information to be confident the test taker is a V51. But it's not the test taker's fault her test did not contain enough hard questions, so it makes sense they'd revise those scores to V51. The test isn't really designed to distinguish between test takers at those levels anyway, since anyone at that level is miles above the level of the test in general.

If you have only two wrong answers in Verbal, most of the time you'd expect a V47-V48 score. If you only got a V44, then the two wrong answers must have been on easier questions (and it might also be true that your test was a bit easier than normal overall, so your right answers didn't demonstrate quite as high an ability level as on a normal test). On the real test, you'll likely see more hard questions than on some of the diagnostic tests, and if you only get two questions wrong, you'll probably get at least a V46.
User avatar
Hovkial
Joined: 23 Apr 2019
Last visit: 24 Nov 2022
Posts: 805
Own Kudos:
Given Kudos: 203
Status:PhD trained. Education research, management.
Posts: 805
Kudos: 2,086
Kudos
Add Kudos
Bookmarks
Bookmark this Post
IanStewart
There have been one or two test takers with no wrong answers who have gotten V50 scores, not V48 scores (or at least not that I've seen, and that seems extremely unlike to me). On appeal, GMAC revised the scores upwards to V51. You can understand why this could happen - if a test taker gets every question right, the algorithm can be very confident the test taker is above a certain level, but can't say exactly how far above. If a test doesn't contain a lot of extremely hard questions, then with entirely correct answers, the test might only be nearly certain the test taker is at least a V50, but might not have enough information to be confident the test taker is a V51. But it's not the test taker's fault her test did not contain enough hard questions, so it makes sense they'd revise those scores to V51. The test isn't really designed to distinguish between test takers at those levels anyway, since anyone at that level is miles above the level of the test in general.

If you have only two wrong answers in Verbal, most of the time you'd expect a V47-V48 score. If you only got a V44, then the two wrong answers must have been on easier questions (and it might also be true that your test was a bit easier than normal overall, so your right answers didn't demonstrate quite as high an ability level as on a normal test). On the real test, you'll likely see more hard questions than on some of the diagnostic tests, and if you only get two questions wrong, you'll probably get at least a V46.

Manual intervention is an extremely unusual case. Usually GMAC (and other test agencies) publish their findings in research papers. I wonder if this was the case here.

Although I understand the direction of the quoted argument above, it may not be entirely accurate.

It is understood that a test which is designed to measure abilities of a large number of test takers, most of whom will fall within a few standard deviations of a mean score, may not be accurate with scoring at the edges - i.e., extremely low or high scores. This is fundamentally due to the fact that the algorithm may not possess sufficient data in those regions to make accurate estimates.

In these cases, researchers usually assign an arbitrary value, say V51 or V(some extreme number) to denote the extreme upper value. This is done with the caveat that the range of confidence of this value is quite large, i.e., the value is less certain. An assignment of an arbitrary value is not generally an issue here because we the test is designed to measure abilities within broader (lower) ranges.

Researchers will not generally go in after-the-fact and manually assign a new value to the upper score. Such post-hoc tweaking of data is discouraged.

I would be interested in seeing an actual GMAC research paper that more fully described the events. Generally, the test agencies will proactively publish such reports to head off any concerns that may arise over their actions.

The situation favored the testtaker who had the time, money and sense to request a review upon which the agency changed their score. Some other testtakers might not be so fortunate.

In my view, this is a highly unusual occurrence.
User avatar
IanStewart
User avatar
GMAT Tutor
Joined: 24 Jun 2008
Last visit: 13 Dec 2024
Posts: 4,126
Own Kudos:
Given Kudos: 97
 Q51  V47
Expert reply
Posts: 4,126
Kudos: 9,921
Kudos
Add Kudos
Bookmarks
Bookmark this Post
Hovkial
Manual intervention is an extremely unusual case. Usually GMAC (and other test agencies) publish their findings in research papers. I wonder if this was the case here.

Although I understand the direction of the quoted argument above, it may not be entirely accurate.

It is understood that a test which is designed to measure abilities of a large number of test takers, most of whom will fall within a few standard deviations of a mean score, may not be accurate with scoring at the edges - i.e., extremely low or high scores. This is fundamentally due to the fact that the algorithm may not possess sufficient data in those regions to make accurate estimates.

In these cases, researchers usually assign an arbitrary value, say V51 or V(some extreme number) to denote the extreme upper value.

The details are all here - a test taker who answered every Verbal question correctly received a V50, that was later revised to a V51 after the test taker asked GMAC to look at the scoring:

https://gmatclub.com/forum/q51-v50-253258.html

Internally, when you proceed through the GMAT, your score is not measured on the V6-V51 scale. Instead it's measured in standard deviations above or below average. So initially, a test taker starts with a score of 0, and after answering a few questions correctly, might climb to a score of 1 (one standard deviation above average), and so on. At the end of the test, that standard deviation score is translated to a score on the familiar V6-V51 scale. If the test does not deliver enough hard questions, the test taker might not quite reach a standard deviation score high enough to translate to a V51. That's the only way I can explain what happened to this test taker (and the other one linked to in that thread) - if you look at the difficulty level of their Verbal questions, as reported in their ESRs, their questions weren't as hard as you'd expect, based on their performance.

It would be unsurprising if the test designers hadn't accounted for this possibility before it happened, since it would be rare that the question selection algorithm would fail to deliver a lot of hard questions to a well-performing test taker. They may have since corrected that behaviour, but it would be, as you say, a very rare occurrence, if only because flawless Verbal performances are extremely rare (probably achieved by 1 in 5000 test takers or thereabouts), and rarer still would be the flawless performance that only produces the V50 because of a quirk in the question bank on the day of the test (an insufficient supply of hard questions).
User avatar
Arro44
Joined: 04 Jun 2018
Last visit: 14 Aug 2022
Posts: 662
Own Kudos:
Given Kudos: 362
Location: United States
Concentration: General Management, Finance
GMAT 1: 730 Q47 V44
GPA: 3.4
Products:
GMAT 1: 730 Q47 V44
Posts: 662
Kudos: 740
Kudos
Add Kudos
Bookmarks
Bookmark this Post
SynPo800
I'm having a bit of trouble understanding how the verbal scoring works.

I got 2 questions wrong in verbal:
Question #23 and question #25 - how does that equate to a V44?

It really depends on the questions, e.g. I had a v46 in one practice test with 3 errors and a v40 with 5 errors.

Its a helpful gauge for your verbal abilities, but it is not useful to assess which amount of errors will result in which final score.

Cheers,
Chris
Moderator:
General GMAT Forum Moderator
141 posts