GMATClub attends 2011 GMAC Test Prep Summit (NYC)

Question

GMATClub attends 2011 GMAC Test Prep Summit (NYC) Sept 15, 2011 GMATClub was invited by the GMAC to attend this year's TestPrep Summit. It was in NYC on Sept 15. As I attended the conference in 2009 , there were many familiar faces (folks from Princeton, Kaplan, MGMAT, Manhattan Review, etc.) and some new faces from the various prep companies. The conference was from 8am-5pm. There are handouts, but they are color. I need to find a color scanner to make sure I take advantage of the quality of the handouts. They will be added at a later date. One aspect of the conference was a repeat: The myths about the GMAT (same handouts at 2009). Dr Lawrence Rudner (psychometrician, head of R&D at GMAC) said he felt these repeats were necessary given how some myths refuse to die (and cause people a great deal of anguish in the prep process (why did I do so poorly)). The first presentation was by Puck Fernsten of Pearson (specifically Pearson Test of English). This was mostly a rehash of the 2009 presentation with some new information (more schools accepting of PTE, some countries (Australia and UK) using PTE as a mechanism to grant student visas, etc.). The take away was PTE is first to market and first to technology. It's not IF PTE will over take IELTS or TOEFL, but when. Puck mentioned Pearson has not push the marketing too hard (yet), but is expecting a high swing in the coming years. Dr Rudner presented next with some R&D updates. This mostly dealt with statistics of # of tests administered, score skewing (math scores still skewing upwards, 50 is now a 98 percentile). He also presented a really neat tool the GMAC rolled out on score statistics. You can see the tool here: https://www.gmac.com/gmac/researchandtre ... search.htm A survey was recently completed by test takers and Dr Rudner presented the North American statistics. See the attachment for this for more details (once attached). Global responses: 3,300 North American: 330 Interesting answers: More than half of the respondents did NOT use a diagnostic test to begin his/her study plan (studied blindly). People also wished he/she had more detailed explanations in the prep process when doing study problems and many relied on the prep company/consultant/prep resource to be the expert in the GMAT (content, questions, timing, etc.). Next, Dr Rudner present updates on his stats with the schools. Schools in general are becoming more selective. We used to see a normal distribution (the top schools were very selective and things followed a general bell curve). We see the same overall distribution (averages), but the line has shifted greatly (see attachment once attached). The GMAC is still focused on increasing membership to other advanced degree programs outside of the MBA (master's in management, hospitality, etc.), and is receiving favorable feedback on this. Part of the presentation focused on retakes. The data stops with 3rd retake. After 3rd, the data is either consistent (not much improvement), or questionable. A question came up on a reminder tool about open slots for scheduling as many people here have mentioned that (something to send you a note when someone cancels a spot). An attempt was made at this, but it was discovered the technology did not match the need for such a tool. Two things were said here: 1. Keep your eye on the test day and keep checking. Seats are canceled all the time (Dr Rudner said the finance dept thanks those who make optional donations to the GMAC

) 2. When you only see one set of time slots (only mornings or only afternoons), it's likely the remaining seats have not been released to the test centers yet. The GMAC does validation on demand and attempts to accommodate by batch releasing seats for tests. One BIG note: As of now, official results are out within 5 days, and the GMAC is aware of this. Once IR comes out, results WILL, yes WILL take the full 20 business days for a time (until the GMAC has a firm grip on scoring). Once there is solid data on scoring IR, the results will come out in a more timely fashion (how long until 5 days again, no idea). For those folks taking the test next year (or for late admits into programs taking apps until the spring/summer), please be aware of this. Dr Rudner expanded on this, saying adcom at the schools have a big task on its hands. To quote Dr Rudner: "There is a problem of people who will be successful but can't get in (admission bias). Validity is the utility of the exam, for the adcom, this means proper decision vs improper decision. " Next, Andy Martelli presented some new informaiton on productions (Andy is VP of new products at the GMAC). Hightlights: New GMATPrep will come out next spring to showcase IR. The following improvements were made: You can reset your tests (instead of manually doing it) Your score is saved (was a big item GMAT Club was lobbying for) The program will track scores The program will track your progress on the test (time per problem, strengths, weaknesses, etc.). It will have IR You can opt in for GMAC research tracking OG 13 will be out March 2012. It will have IR and you will have the option for purchasing 150 new problems (not in any other source). A mobile app will come (when is the question) and Android for the current OG 12 is in the works. 35% of OG 13 is brand new material. Finally: NextGen GMAT Dr Rudner took us through a few bullet points. Analysis of an issue is being dropped for IR. The GMAC has been doing a big push to clean up question pools (see here for verbal SC clean up: attention-gmat-takers-very-important-120728.html). It will take some time to clean everything out. Expect some information to be released in November of this year on GMAC.com and MBA.com The user interface for NextGen will be unchanged. The difference will be in the feel of some questions and IR. The scale for IR is currently unknown. The goal is to have scalability on questions (i.e. how well will IR differentiate between test takers). One specific goal: item analysis is to have the same curve on all population types (if you have not seen IR, that won't make any sense, so don't worry about it). Other Related Links Idiom and SC changes create panic among applicants GMAC official response on SC changes Knewton Debrief of the summit MGMAT Debrief about the summit GMAT Club Debrief from the 2009 event 27 OG 10 questions on altered intent changes in meaning Attachments posted. Thanks, Mohater

mohater · Answer

Questions people asked me to specifically ask the GMAC:

1. Question one: Misconducts. These are a scarlet letter on a score report. I posed the question to Dr Rudner as some people reported not being told the drill (no cell phone, no notes, etc.) when checking in for the test. His reply: The GMAC has no way to differentiate between mistakes/people who were not given the check list and people who are actively trying to circumvent controls. Nothing can be done here

2. GMATPrep functionality: Addressed in the above post with the next version.

3. IR, weighed, scale, etc.: See above. This is all unknown or the GMAC can not reply (yet).

4. Product development: Outside of the above, the folks from the GMAC did say they are interested in more user feedback on what it can provide. Submit an email to the general contact (under contact us) and your email should be routed to the right group.

5. Licensing content: This is a flat out no. At the last conference, this was stated as a possibility, but given the GMAC's desire to ensure only the best content is used for prep products, it will not license anything. Andy (VP new products) said the next version of GMATPrep will NOT have explanations and Dr Rudner followed up the same policy is in place for discussing questions: "We don't mind discussion assuming folks have access to the content (no one is provides unlicensed content to others)"

6. GMATPrep overlap with other content: We were told it *should* be generally new, but there will be overlap. This is a reality given how many questions the GMAC never releases, even to tests (questions made for nothing).

7. GMAT restrictions by country: I was told the restrictions are published (on mba.com). The restrictions are based on trade embargo and US foreign policy. See this bulletin for more info:
https://www.mba.com/the-gmat/gmat-inform ... dates.aspx

jeprince112 · Answer

interesting information. thanks for post

rjkaufman21 · Answer

A 50 q is the 98th percentile? Didn't it used to be like the 94th percentile? I'm surprised it would change so much.

mohater · Answer

Office reply on SC: attention-gmat-takers-very-important-120728-80.html#p980662

mohater · Answer

Added first batch of attachments

(yes, I'm super late here...)

mohater · Answer

All conference handouts scanned high quality PDFs and attached. Lots of interesting data folks. I highly recommend going through it.

Yekrut · Answer

Great post! Do you know if the new GMATPrep will be out before May? This will give me som great additional CAT tests to practice before I take the exam. Some very useful information here thanks.

mohater · Answer

It should be out in March/April (per the GMAC) to give folks some lead time before the new test is rolled out.

Yekrut · Answer

Thanks for the information. Look forward to getting it.

	Magoosh increases your score, guaranteed - 15% off ALL Magoosh GMAT plans with code GMATCLUB15 + Free GMAT Club Tests.
	Manhattan Prep: $79 Bonus Score Higher on Your GMAT Exam. Guaranteed.
	Target Test Prep - Save up to $325 $200 Discount + $79 Bonus GMAT Club Tests
	e-GMAT: 60% Off on GMAT Focus Get to 735+ from any starting point
	Experts' Global - ~~$1720~~ $960 End-to-End GMAT Prep + App Support: 150+ Videos, 2000+ Questions, 15 FLTs +
	GMATWhiz - $299 ~~$499~~ Experience the course through a free trial.
	GMAT Club Tests - Free Included with every course purchase of $149+ View all deals

GMATClub attends 2011 GMAC Test Prep Summit (NYC)

Prep Toolkit

Top 5 GMAT Debrief Videos

615 to 715 in 15 Days (Ria's Strategies)

More than Quant/Verbal Abilities: Speed vs. Accuracy

745 with Only Self-Prep and GMAT Club

From 555 to 765: 210-point Improvement

Perfect 805 Score Debrief by Julia

My Rewards