{"id":153,"date":"2014-03-28T15:47:49","date_gmt":"2014-03-28T22:47:49","guid":{"rendered":"http:\/\/www.gmat-genius.com\/blog\/?p=153"},"modified":"2015-05-28T20:27:04","modified_gmt":"2015-05-29T03:27:04","slug":"question-difficulty-gmat-official-guides","status":"publish","type":"post","link":"https:\/\/www.gmatgenius.com\/blog\/question-difficulty-gmat-official-guides\/","title":{"rendered":"Question Difficulty in GMAT Official Guides"},"content":{"rendered":"

\"GMATStarting with the 11th Edition of the Official Guides, the Graduate Management Admission Council placed questions in order of difficulty<\/strong>. This is a welcome change from prior editions, because students can now choose practice questions at the appropriate difficulty level. Beginning students need not tackle difficult questions that may cause them to feel overwhelmed and frustrated, nor do advanced students need to waste time on questions that are well below their capabilities.<\/p>\n

Mysterious Methodology<\/h2>\n

The methodology that the GMAC uses to assign difficulty ratings to questions remains a mystery<\/strong>, however. Although there is a clear overall correlation between question placement and GMAT Genius\u2019 assessment of difficulty, the correlation is far from perfect and there are many outliers, particularly with math. Let\u2019s consider the Problem Solving section of the GMAT Official Guide<\/a> (13th Ed.).<\/p>\n

Problem Solving Analysis<\/h2>\n

There are 230 questions in this section, excluding questions in the Diagnostic Test chapter of the book. GMAT Genius assigns difficulty at five different levels: Super Easy, Easy, Moderate, Hard, and Very Hard. To translate this into numbers, we can assign points of 1, 2, 3, 4, and 5 to each of these levels, respectively. With perfect correlation and distribution, we should see the first 46 questions (230 divided by 5) all at a Super Easy level (average difficulty 1.0), the next 46 questions all at an Easy level (average difficulty 2.0), and so on. Instead, here is how we would rank question difficulty:<\/p>\n

\n\n\n\n\n\n\n\n\n\n\n
OG 13E PS<\/strong><\/th>\nSuper
Easy<\/strong><\/th>\n		Easy<\/strong><\/th>\nModerate<\/strong><\/th>\nHard<\/strong><\/th>\nVery
Hard<\/strong><\/th>\n		Average
Difficulty<\/strong><\/th>\n<\/tr>\n<\/thead>\n
1 – 46<\/strong><\/td>\n11<\/td>\n29<\/td>\n6<\/td>\n0<\/td>\n0<\/td>\n1.9<\/td>\n<\/tr>\n
47 – 92<\/strong><\/td>\n3<\/td>\n18<\/td>\n23<\/td>\n2<\/td>\n0<\/td>\n2.5<\/td>\n<\/tr>\n
93 – 138<\/strong><\/td>\n1<\/td>\n10<\/td>\n21<\/td>\n13<\/td>\n1<\/td>\n3.1<\/td>\n<\/tr>\n
139 – 184<\/strong><\/td>\n0<\/td>\n12<\/td>\n26<\/td>\n4<\/td>\n4<\/td>\n3.0<\/td>\n<\/tr>\n
185 – 230<\/strong><\/td>\n0<\/td>\n5<\/td>\n25<\/td>\n11<\/td>\n5<\/td>\n3.5<\/td>\n<\/tr>\n
Total<\/strong><\/td>\n15<\/td>\n74<\/td>\n101<\/td>\n30<\/td>\n10<\/td>\n2.8<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<\/div>\n

As shown in the table, average question difficulty<\/strong> (based on our assessment) does not increase much<\/strong> in the last three quintiles. In fact, the middle quintile is actually slightly harder than the fourth quintile. Surprisingly, we consider five of the top quintile questions \u201cEasy,\u201d<\/strong> including #220, which is supposed to be one of the hardest questions in the entire set. We also consider question #117 in the third quintile \u201cVery Hard,\u201d even though it barely passes the halfway mark. Yet the GMAC considers this question easier than #130, which we rate as \u201cSuper Easy.\u201d<\/p>\n

Disparity Among Similar Questions<\/h2>\n

We see this disparity even among similar questions<\/strong>. Questions #178 and #186 both entail overlapping sets, and based on the ordering, the GMAC considers #186 slightly harder than #178. Yet we rate #178 as \u201cVery Hard\u201d and #186 as \u201cModerate\u201d because the former is a complex application with three groups whereas the latter is a straightforward application with two groups. As another example, consider #137 and #203 that we described in our prior post about repetitive math questions. These two questions are very similar, yet the GMAC considers the latter much harder than the former. By contrast, we rate both these questions as \u201cHard\u201d and actually consider the latter slightly easier because the numbers are much easier.<\/p>\n

Our assessment of difficulty is admittedly somewhat subjective, but probably more realistic than how the GMAC assigns difficulty. Our difficulty ratings take into account our observations of how students tend to find the questions in term of difficulty, the ease of the calculations involved, and the length of the Official Guide explanation, except when the explanation is inefficient or misses a shortcut. For verbal questions, we also take into account the difficulty of the incorrect answers, since process of elimination can be particularly helpful on verbal. Note that our assessment of difficulty skews towards the center<\/strong>; a question would need to be incredibly easy or incredibly difficult to qualify as \u201cSuper Easy\u201d or \u201cVery Hard\u201d, respectively. The GMAC most likely has a much greater distribution in its difficulty assignments. <\/p>\n

Conclusions<\/h2>\n

A key takeaway from this analysis is that you should not assume that the Official Guides are an objective measure of question difficulty<\/strong>. Although we don\u2019t know how the GMAC assigns difficulty and would expect a few differences of opinion, we can confidently claim that quite a few questions are ordered incorrectly. So if you encounter a few questions in the Official Guides that are hard for you, it does not necessarily mean that all subsequent questions are beyond your reach. Another implication of this analysis is that the Official Guides do not contain enough difficult practice questions<\/strong>, a complaint we often hear from our advanced students. The GMAC has released two relatively new study products (Exam Pack 1 and Question Pack 1), so let\u2019s hope that Difficult Pack 1 is in the works.<\/p>\n","protected":false},"excerpt":{"rendered":"

The GMAT Official Guides present questions in order of difficulty; we evaluate the accuracy of the difficulty rankings.<\/p>

Continue reading<\/a><\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[9,20,10],"tags":[25],"yoast_head":"\nQuestion Difficulty in GMAT Official Guides - GMAT Genius<\/title>\n<meta name=\"description\" content=\"The GMAT Official Guides present questions in order of difficulty; we evaluate the accuracy of the difficulty rankings.\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/www.gmatgenius.com\/blog\/question-difficulty-gmat-official-guides\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Question Difficulty in GMAT Official Guides\" \/>\n<meta property=\"og:description\" content=\"The GMAT Official Guides present questions in order of difficulty; we evaluate the accuracy of the difficulty rankings.\" \/>\n<meta property=\"og:url\" content=\"https:\/\/www.gmatgenius.com\/blog\/question-difficulty-gmat-official-guides\/\" \/>\n<meta property=\"og:site_name\" content=\"GMAT Genius\" \/>\n<meta property=\"article:published_time\" content=\"2014-03-28T22:47:49+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2015-05-29T03:27:04+00:00\" \/>\n<meta property=\"og:image\" content=\"http:\/\/www.gmat-genius.com\/blog\/wp-content\/uploads\/2014\/03\/Question-Difficulty-300x280.jpg\" \/>\n<meta name=\"author\" content=\"Chief Genius\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Chief Genius\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"4 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\/\/www.gmatgenius.com\/blog\/question-difficulty-gmat-official-guides\/\",\"url\":\"https:\/\/www.gmatgenius.com\/blog\/question-difficulty-gmat-official-guides\/\",\"name\":\"Question Difficulty in GMAT Official Guides - GMAT Genius\",\"isPartOf\":{\"@id\":\"https:\/\/www.gmatgenius.com\/blog\/#website\"},\"datePublished\":\"2014-03-28T22:47:49+00:00\",\"dateModified\":\"2015-05-29T03:27:04+00:00\",\"author\":{\"@id\":\"https:\/\/www.gmatgenius.com\/blog\/#\/schema\/person\/a88f14526c9f59262a2d6ee07165d1fa\"},\"description\":\"The GMAT Official Guides present questions in order of difficulty; we evaluate the accuracy of the difficulty rankings.\",\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/www.gmatgenius.com\/blog\/question-difficulty-gmat-official-guides\/\"]}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/www.gmatgenius.com\/blog\/#website\",\"url\":\"https:\/\/www.gmatgenius.com\/blog\/\",\"name\":\"GMAT Genius\",\"description\":\"Helping You Achieve GMAT Success\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/www.gmatgenius.com\/blog\/?s={search_term_string}\"},\"query-input\":\"required name=search_term_string\"}],\"inLanguage\":\"en-US\"},{\"@type\":\"Person\",\"@id\":\"https:\/\/www.gmatgenius.com\/blog\/#\/schema\/person\/a88f14526c9f59262a2d6ee07165d1fa\",\"name\":\"Chief Genius\",\"url\":\"https:\/\/www.gmatgenius.com\/blog\/author\/gmatpower8577\/\"}]}<\/script>\n<!-- \/ Yoast SEO Premium plugin. -->","yoast_head_json":{"title":"Question Difficulty in GMAT Official Guides - GMAT Genius","description":"The GMAT Official Guides present questions in order of difficulty; we evaluate the accuracy of the difficulty rankings.","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/www.gmatgenius.com\/blog\/question-difficulty-gmat-official-guides\/","og_locale":"en_US","og_type":"article","og_title":"Question Difficulty in GMAT Official Guides","og_description":"The GMAT Official Guides present questions in order of difficulty; we evaluate the accuracy of the difficulty rankings.","og_url":"https:\/\/www.gmatgenius.com\/blog\/question-difficulty-gmat-official-guides\/","og_site_name":"GMAT Genius","article_published_time":"2014-03-28T22:47:49+00:00","article_modified_time":"2015-05-29T03:27:04+00:00","og_image":[{"url":"http:\/\/www.gmat-genius.com\/blog\/wp-content\/uploads\/2014\/03\/Question-Difficulty-300x280.jpg"}],"author":"Chief Genius","twitter_misc":{"Written by":"Chief Genius","Est. reading time":"4 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/www.gmatgenius.com\/blog\/question-difficulty-gmat-official-guides\/","url":"https:\/\/www.gmatgenius.com\/blog\/question-difficulty-gmat-official-guides\/","name":"Question Difficulty in GMAT Official Guides - GMAT Genius","isPartOf":{"@id":"https:\/\/www.gmatgenius.com\/blog\/#website"},"datePublished":"2014-03-28T22:47:49+00:00","dateModified":"2015-05-29T03:27:04+00:00","author":{"@id":"https:\/\/www.gmatgenius.com\/blog\/#\/schema\/person\/a88f14526c9f59262a2d6ee07165d1fa"},"description":"The GMAT Official Guides present questions in order of difficulty; we evaluate the accuracy of the difficulty rankings.","inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/www.gmatgenius.com\/blog\/question-difficulty-gmat-official-guides\/"]}]},{"@type":"WebSite","@id":"https:\/\/www.gmatgenius.com\/blog\/#website","url":"https:\/\/www.gmatgenius.com\/blog\/","name":"GMAT Genius","description":"Helping You Achieve GMAT Success","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/www.gmatgenius.com\/blog\/?s={search_term_string}"},"query-input":"required name=search_term_string"}],"inLanguage":"en-US"},{"@type":"Person","@id":"https:\/\/www.gmatgenius.com\/blog\/#\/schema\/person\/a88f14526c9f59262a2d6ee07165d1fa","name":"Chief Genius","url":"https:\/\/www.gmatgenius.com\/blog\/author\/gmatpower8577\/"}]}},"jetpack_sharing_enabled":true,"jetpack_featured_media_url":"","_links":{"self":[{"href":"https:\/\/www.gmatgenius.com\/blog\/wp-json\/wp\/v2\/posts\/153"}],"collection":[{"href":"https:\/\/www.gmatgenius.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.gmatgenius.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.gmatgenius.com\/blog\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/www.gmatgenius.com\/blog\/wp-json\/wp\/v2\/comments?post=153"}],"version-history":[{"count":22,"href":"https:\/\/www.gmatgenius.com\/blog\/wp-json\/wp\/v2\/posts\/153\/revisions"}],"predecessor-version":[{"id":249,"href":"https:\/\/www.gmatgenius.com\/blog\/wp-json\/wp\/v2\/posts\/153\/revisions\/249"}],"wp:attachment":[{"href":"https:\/\/www.gmatgenius.com\/blog\/wp-json\/wp\/v2\/media?parent=153"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.gmatgenius.com\/blog\/wp-json\/wp\/v2\/categories?post=153"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.gmatgenius.com\/blog\/wp-json\/wp\/v2\/tags?post=153"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}