{"id":17,"date":"2016-09-29T16:49:00","date_gmt":"2016-09-29T16:49:00","guid":{"rendered":"http:\/\/ethanlewis.org\/cap\/2016\/09\/29\/nacac-2016-observations-on-presentations-about-the-sat-and-act\/"},"modified":"2019-04-20T12:40:07","modified_gmt":"2019-04-20T17:40:07","slug":"nacac-2016-observations-on-presentations-about-the-sat-and-act","status":"publish","type":"post","link":"https:\/\/ethanlewis.org\/cap\/nacac-2016-observations-on-presentations-about-the-sat-and-act\/","title":{"rendered":"NACAC 2016: Observations On Presentations About the SAT and ACT"},"content":{"rendered":"
<\/span><\/a><\/div>\n
Every year in September the National Association for College Admission Counseling (NACAC)<\/a> has its annual conference. NACAC is a great organization made up of high school counselors, independent educational consultants and college and university admission officers and I’m proud to have been a member for years. Along with 6,000 other professionals I attended this year’s event in Columbus, Ohio as part of the Method Test Prep<\/a> team, and as always I enjoyed making new friends and renewing old acquaintances during my four days in the Buckeye State.\u00a0<\/span><\/div>\n
\u00a0<\/span><\/div>\n
Going into the conference, two of the sessions I looked forward to most were the separate presentations from David Coleman and Marten Roorda, respectively the chief executives of the College Board (owners of the SAT) and the ACT. \u00a0After so many changes<\/a>, so much anxiety<\/a>, and extensive confusion <\/a>regarding the two tests, I thought that there would be great interest in hearing directly from these two leaders just what they thought of the current state of college admissions testing. \u00a0I’ve uploaded my notes from the session<\/a> (typed as quickly as I could while the men were speaking) for your reading pleasure; what follows are some observations after having a few days to think about what I heard.<\/span><\/div>\n
<\/div>\n
\u00a0<\/span><\/div>\n
While many people doubtless wanted to see a heavyweight showdown with the two men on stage at the same time, it wasn’t to be. David Coleman spoke on Thursday afternoon, and Marten Roorda spoke in the same room the next day. Coleman’s session was formatted as a “Q&A”, and Roorda’s being more of a prepared speech.\u00a0The room was gigantic, with hundreds of seats, a large screen and microphones scattered throughout the audience for questions.\u00a0<\/span><\/div>\n
<\/div>\n
\u00a0<\/span><\/div>\n
The first thing that was evident to me was how many empty seats there were for Coleman’s session. At NACAC 2015 I was totally shut out of the one session I really wanted to see, which featured admissions data guru Jon Boeckenstedt<\/a> of DePaul University<\/a>–even the overflow crowd was too much for the fire marshal’s taste. Fearing a similar situation, I arrived extra early for Coleman, but more than half of the seats were empty. Interestingly, this session was counter-programmed with another presentation by Boeckenstedt–perhaps that’s where everyone was? Or it could be that people are frustrated by the poor communication from the College Board<\/a> over the last year; as one\u00a0of my friends said \u201cI\u2019ve left too many College Board presentations angry to want to go to this one\u201d. That said, at least 300-400 people were present to hear from the usually quiet Mr. Coleman.<\/span><\/div>\n

<\/p>\n

\u00a0<\/span><\/div>\n
<\/span><\/a><\/div>\n
Coleman, who took over the reins of the College Board four years ago after leading the effort to promulgate the Common Core standards seemed to go into the session with a plan, and the plan was to admit responsibility early and often for the College Board’s failures in implementing 2015’s many changes<\/a>. The first question set the tone: “So David, it hasn\u2019t been a good year…” Coleman gave a great answer that was clearly well planned: “Thanks to all of you who do this hard work. Frankly, we made your work a lot harder last year and I’m sorry about that…This was not ok….When the College Board betrays your ability to help kids it’s a harm. It has real impact on people’s lives.”\u00a0<\/span><\/div>\n

\u00a0<\/span><\/p>\n

I thought that was a strong response, but the audience was unmoved–in fact a noteworthy phenomenon throughout Coleman’s talk was the many times that he said things that in almost any other setting should have received applause but in this case were met with silence. For instance, see some of the answers and imagine how badly the College Board must have burned people for all of these to be met with comparative silence:<\/span><\/div>\n
<\/div>\n

Q: Why no fee waivers for the CSS Profile (an extra, fee-based tool some colleges use for financial aid decisions)?<\/b> “It’s not fair. But I can announce that all students who qualify will automatically get CSS Profile waivers. It’s wrong to keep asking families to say they are poor and to prove it for small amounts of money. We will do better. This is effective now.” \u00a0This was a wonderful remark that showed Coleman’s fundamental humanity, and it’s a shame that the audience treated it so skeptically.<\/span><\/p><\/blockquote>\n

Q. Regarding the ACT’s disavowal of the concordance tables<\/a> between the new SAT, old SAT and ACT, how should we counsel our <\/b>kids?<\/b> “Concordance is necessary, but a necessary evil….I have good news for you. We and ACT have come to an agreement, and we will work together with all deliberate speed to have a new concordance for 2018.\u201d \u00a0I’m not sure if anyone else noticed the quote from the slightly less famous Brown v. Board of Education II<\/i>\u00a0opinion, but to me “all deliberate speed” is the classic example of an oxymoron; I can only hope this time it works better than it did in the fifties<\/a>.<\/span><\/span><\/p><\/blockquote>\n

\n
Q. He was asked if he’d read an article in The Atlantic<\/i>\u00a0about school counselors<\/a>. His response should have been a great example of solidarity with the audience, but it seemed to ring hollow:<\/b><\/span>\u201cHalf of what we do is to help students grow and show their work to get ready for college. The other half is to propel kids to opportunities. If we leave futures up to chance, we have lost…When we get our problems under control, I want to become a central spokesman for the role of counseling.”<\/span><\/span><\/span><\/div>\n

 <\/p>\n

<\/div>\n

 <\/p><\/blockquote>\n

With about a half hour left in the session, we were told that Coleman would take 15 minutes of questions. Quite a few people lined up at the microphones. At the end of 15 minutes, after we were told the session was over, Coleman (magnanimously?) agreed to another 15 minutes. Whether this was staged or just simple confusion I can’t say. The questions from the audience were a bit more pointed and the responses generated a little bit of news, and demonstrated a bit more evasion than in the prior examples.<\/span><\/div>\n
<\/div>\n
One very abrasive questioner, for instance, expressed her frustration with the process to grant students with disabilities accommodations (extra time, scribes, readers, etc.); “why does it take so frigging long? \u00a0It’s ridiculous! What the hell?!” \u00a0Coleman was calm and empathetic, saying “you’re right, by the end of the year we will announce substantive and significant simplifications of the appeal process”. \u00a0He also noted that accommodations for English Language Learners will be available soon, at least for the School Day Testing sites. That was good to hear, and somewhat newsworthy. Along the same lines, James Murphy of the Princeton Review (who wrote the Atlantic<\/i> article mentioned above) asked when the SAT Subject tests will go to 4 choices per question with no guessing penalty (like the revise SAT) if it is so much better. Coleman said that was a “good point. The future of the subject tests is non-trivial” to the College Board, and he speculated that they might be redundant due to Advanced Placement tests.\u00a0<\/span><\/div>\n


<\/p>\n

The possible elimination of the subject tests is, to me, quite newsworthy. According to Adam Ingersoll of Compass Prep, currently very few (you can count them on one hand) schools explicitly require these tests (down from nearly 100 earlier in the decade), though many “recommend” them, which serves only to enrich the College Board, in my opinion. Dropping these tests from the to do lists of over-burdened, over-tested and over-stressed high schoolers would be a good idea, but not if the idea is to replace them with Advanced Placement tests, since not every student has access to AP curricula at their schools.\u00a0<\/span><\/div>\n


<\/p>\n

Coleman was more evasive on the topic of standardized test bias. An independent consultant from South Florida asked about the latest article from Reuters about SAT and ACT problems<\/a>\u00a0that says that the designers of the new SAT knew in advance that there was a racial bias in the new math questions<\/a>. The article is worth a read, and it notes that the vocabulary in the much wordier math questions on the new test may cause problems for racial minorities, English language learners and economically disadvantaged students. Coleman only talked about the second group: “We have found that ELL students who might have trouble\u00a0with wordier questions have no\u00a0measurable\u00a0problem completing the test. We will do everything we can to simplify the math section. Superfluous words are superfluous. But we will not go back to useless math questions. We will have elegant, brief, easily accessible math questions.” \u00a0I was disappointed that he didn’t take the chance to give a forceful defense of why the new SAT fixes the racial biases in the old test. Maybe it’s because he can’t?<\/span><\/span><\/div>\n

<\/p>\n

<\/div>\n

 <\/p>\n

the final question that was posed seemed to be an outgrowth of the writing of my friend Jim Jump<\/a>. Coleman was asked why there is no “ethical, moral or philosophical dimension” to standardized testing. He replied by saying that the exam isn’t an ethics test, but that “the ethics of admission is a core issue of our time”. He said that College Board research (you know what I think of that<\/a>) shows that devotion to just one activity correlates most directly to future success. He thinks that the College Board is “partly culpable” in the “activities arms race” and wondered if the Common Application would be better off listing only three slots for extra-curricular activities instead of 10.<\/span><\/div>\n
\u00a0<\/span><\/div>\n
******************<\/span>
\n
\n<\/span><\/div>\n
<\/div>\n
<\/span><\/a><\/div>\n

 <\/p>\n

\n

After Coleman’s talk, speculation was rampant about what kind of approach Marten Roorda would take. Coleman seemed SO contrite and empathetic that some wondered how the ACT boss would approach the recent failures and confusions his company had perpetrated. I arrived early again, but definitely didn’t have to rush; there were less than 100 people in the very large room at the outset of the event, and as it went on people kept leaving in frustration, to the point that I counted 71 people at the end. \u00a0<\/span>
\n
\n<\/span>Marten Roorda took over the helm of the ACT in 2015 after previously running one of Europe’s largest testing firms in his native Netherlands. His presentation struck this former public speaking teacher as one of the weakest I’ve ever seen. Roorda has a deep, soothing voice with an accent that isn’t hard to understand, but that definitely takes concentration to fully understand. He employed a PowerPoint slide show, but the text was far too small for me to read in my seat at the rear of the room. Worst of all, Roorda made next to no eye contact and simply read a speech. Joyce Smith, the CEO of NACAC introduced the speaker and tried to set the tone: “It’s Marten’s first NACAC, so please be gentle to him” she implored. Unfortunately, he does not seem to have done any research into NACAC before coming, as his speech ignored the fact that the audience was made up of people who work with students and families who want to go to college. Instead, he focused on the growth of the ACT’s market share, and the development of even more tests.<\/span>
\n
\n<\/span>“You don’t know about me,” he began “but if you know anything about ACT, you know we like numbers. Let me tell you a new number….64%. That is the percentage of 2016 seniors who took the ACT. For the 12th straight year an increase in users, and for the 5th straight year we are the most popular test.”<\/span>
\n
\n<\/span>That seemed like an interesting start. He said that the ACT was created in 1958 not as an aptitude test (a dig at what the A used to stand for in SAT) but as one to help with placement. “To include, not exclude”. Sadly, he didn’t really return to this theme again. He spent the next 20 minutes describing companies that ACT has recently purchased and spun off into the new “ACT Assessment Technologies”, recent experts in psychometrics<\/a>\u00a0that he has hired as part of his goal to “build a team of world-class scientists”, and new tests that the ACT will be rolling out soon. Over a dozen people walked out during this session, one grumbling under her breath “I’ve never had a bigger waste of time in my life”.\u00a0<\/span>
\n
\n<\/span>Roorda did take questions at the end, and while he demonstrated more empathy in this part of the program, it may have been a case of too little, too late. When a teacher from a Native American school in Washington described her students driving 90 miles to a test center only to have their (ACT approved) calculators disqualified by the proctor, Roorda was genuinely disturbed and promised that his team would look into the situation. \u00a0On the other hand, when a college counselor from New Hampshire asked a follow up question about increasing the number of test centers so rural students wouldn’t have to travel so far, he was told “America is a big place, we have 6 to 7 thousand test centers across the country and more centers will increase costs. We want to keep prices lower. But if we get a signal that in an area there is too much travel we could look at [it]. Students should communicate with us about this.” I can\u2019t imagine how much more costly it could be to have more schools host the ACT, and if it makes life easier for the test takers, it seems desirable, but what do I know?\u00a0<\/span>
\n
\n<\/span>While keeping costs lower may be a concern, when he was asked if the ASPIRE and PreACT tests are “a price grab”, all he said was “the ASPIRE and PreACT are totally different and not comparable” but implied that schools should administer both to students (along with a new set of assessments that start as early as 3rd grade).\u00a0<\/span>
\n
\n<\/span>Roorda may not be a cold technocrat, but it was definitely how he came across to the audience. Especially in contrast with Coleman’s almost uncomfortable levels of empathy, Roorda seemed to be distant and unconcerned with nuance. I’ll give an example. When Coleman was asked about\u00a0the growth of “test optional” colleges and universities<\/a>, his answer was warm, human and thoughtful:\u00a0<\/span>
\n
\n<\/span><\/p>\n

“I don’t want to seem to disparage schools that choose to be test optional. I understand the \u201chumanity\u201d to not force kids to take a test that they won\u2019t do well on. But the SAT today measures the few things that are impossible to catch up on in college if you don\u2019t know them (literacy, reading, certain math). It is very rare for a remedial student to catch up in college. Less than 1 of 10 without basic math can do college chemistry. We can make the test optional, but don\u2019t make the skill assessment optional.”<\/span><\/p><\/blockquote>\n


\n<\/span>That’s a good answer. Roorda merely said “We think colleges are missing an opportunity by going test optional. More, objective information is good and badly needed, both for schools and students. Grades may not translate into readiness.” Considering that\u00a0many colleges that make submission of standardized tests optional do so because they find a student’s transcript to be the best predictor of college success<\/a>, this seems to be a needless insult to the audience. Along the same lines, he also criticized grade inflation at the college and high school levels and predicted that the ACT score might someday serve as the proxy for “bright, engaged and aware” that a college degree “used to signal” but no longer does.\u00a0<\/span>
\n
\n<\/span>One further question about test optional admissions came from Jay Rosner, another Princeton Review staffer. He asked “regarding your statement that ‘more information is better’, more information that shows the same disparities in race and economics isn’t more useful, is it?” Roorda’s answer was, if not surprising coming from a researcher, definitely jarring to my ears:<\/span><\/p>\n

“I feel strongly about this. We must be thankful that a test can expose what is wrong with society. We are not trying to kill the messenger. Standardized tests should not be blamed, we should keep highlighting gaps. It is statistically not sound to say that our tests are biased.”\u00a0<\/span><\/p><\/blockquote>\n

He’s right that exposing societal ills is beneficial, but millions of students don’t take the ACT to diagnose America’s racial and economic problems, they take them to go to college (or, increasingly, as a measure of their public high school’s success in preparing students for “college and careers”). If the makers of the ACT are aware of disparities among different groups in the population, why don’t they try to equalize for that in their tests?<\/span>
\n
\n<\/span><\/p>\n

******************<\/span><\/div>\n
\u00a0<\/span><\/div>\n
I was glad to be able to attend these sessions. I felt that I learned a lot about the state of standardized testing, and while neither Coleman nor Roorda chose to focus much on what Coleman called the “bloodsport” between SAT and ACT, it was pretty clear to me that these very large companies, while “non-profit” for tax purposes, have a great economic imperative to increase sales and market share at the expense of the other. Coleman said “We made the new SAT to be much better than anything else. I urge you to take a fresh look at the SAT”, while Roorda noted that the ACT gives a specific STEM (Science, Technology, Engineering and Math) score, and that “we don’t sell different subject tests like some others”. \u00a0I hope that the leaders of the College Board and the ACT will continue to make themselves available to questions, comments and suggestions from the college admissions counseling community to make sure that they keep refining their products so that they best serve the students who spend so much time, effort and money on college admissions tests.\u00a0<\/span><\/div>\n

\u00a0<\/span><\/p>\n<\/div>\n

<\/p>\n

<\/div>\n

<\/p>\n","protected":false},"excerpt":{"rendered":"

Every year in September the National Association for College Admission Counseling (NACAC) has its annual conference. NACAC is a great organization made up of high school counselors, independent educational consultants and college and university admission officers and I’m proud to have been a member for years. Along with 6,000 other professionals I attended this year’s […]<\/p>\n","protected":false},"author":2,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[18,7,65,17,64,11,62,3,41,63,25,2,5],"tags":[],"class_list":["post-17","post","type-post","status-publish","format-standard","hentry","category-act","category-college-admissions","category-david-coleman","category-fairtest-org","category-jim-jump","category-jon-boeckenstedt","category-marten-roorda","category-method-test-prep","category-nacac","category-nacac2016","category-new-sat","category-standardized-testing","category-test-optional","wpbf-post"],"_links":{"self":[{"href":"https:\/\/ethanlewis.org\/cap\/wp-json\/wp\/v2\/posts\/17","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/ethanlewis.org\/cap\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/ethanlewis.org\/cap\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/ethanlewis.org\/cap\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/ethanlewis.org\/cap\/wp-json\/wp\/v2\/comments?post=17"}],"version-history":[{"count":4,"href":"https:\/\/ethanlewis.org\/cap\/wp-json\/wp\/v2\/posts\/17\/revisions"}],"predecessor-version":[{"id":452,"href":"https:\/\/ethanlewis.org\/cap\/wp-json\/wp\/v2\/posts\/17\/revisions\/452"}],"wp:attachment":[{"href":"https:\/\/ethanlewis.org\/cap\/wp-json\/wp\/v2\/media?parent=17"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/ethanlewis.org\/cap\/wp-json\/wp\/v2\/categories?post=17"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/ethanlewis.org\/cap\/wp-json\/wp\/v2\/tags?post=17"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}