College and Career Readiness

The Case Against Exit Exams

  • By
  • Anne Hyslop,
  • New America Foundation
July 15, 2014
In the 2013-14 school year, twenty-four states required students to be proficient on standardized tests in order to graduate from high school. But starting next year, and in the years to come, states will launch more rigorous, college- and career-ready assessments aligned to the Common Core. As they do so, they should revisit the stakes on these tests for students and consider eliminating, or modifying, their exit exam policies.

What We Know About Accelerated Developmental Education

May 15, 2014
A recent report from the Community College Research Center (CCRC) examined accelerated developmental education at four community colleges to compare the success of students who were placed in accelerated developmental sequences verses students who were placed in standard developmental sequence. Because the majority of developmental students drop out before completing assigned sequences, some colleges have developed accelerated developmental sequences to help students complete remediation within a shorter time frame so they can enroll more quickly in college-level math and English.

The accelerated sequences studied are designed to limit the opportunities for students to drop out of developmental coursework and ensure courses are better aligned with college-level curricula.  There is concern among faculty members and administrators that accelerated sequences do not provide ample time for adequate academic remediation, leading to an increased risk of students dropping out

The following are the Community Colleges that participated in the study and their results:
  • Community College of Denver – offered an accelerated math sequence that could be completed in one semester rather than two and assigned students to a case manager who encouraged them to take a student success course. Pass rates were the same for students in the accelerated program and the standard developmental program.
  • Chabot College – offered accelerated developmental English aligned with college-level English requirements that was one semester rather than two .  Accelerated students were more likely to complete the gatekeeper English but the pass rates were the same for both groups.  Accelerated students accrued more college-level credits.
  • Community College of Baltimore County – offered an upper level developmental writing course that was given while the students took English 101.  By offering concurrent enrollment, the college eliminated exit points and ensured better alignment with skills taught in the college-level class.  The program caused a boost in gatekeeper enrollment and completion rates, which was not surprising since the students were concurrently enrolled in college level English.
  • City University of New York’s (CUNY) Community Colleges – due to the nature of the CUNY system, each college could develop its own sequence.  The findings varied by sequence offered, but they found that students enrolled in shorter sequences were more likely to enroll in and complete gatekeeper courses.  In math, the pass rates were the same but in writing, students in the shorter sequences were less likely to pass the gatekeeper English but accrued more college-level credits.
From these cases we can see that there is no “one size fits all” accelerated developmental sequence that addresses all the challenges of underprepared students.  The findings suggest that programs with student supports increase student success rates  demonstrate the need to limit exit points from courses of study, and highlight the need for developmental courses to be aligned with college-level curricula.

Trading Transparency and Accountability Today for Better Testing Tomorrow

September 23, 2013
Publication Image

2013-14: the school year all American students, in all public schools, were expected to be proficient in reading and math. It’s finally here. But don’t kid yourself – nobody expects American schools to meet that goal this spring. And thanks to the U.S. Department of Education’s ESEA waivers (and waivers of waivers), most won’t have to.

Instead, 41 states, Washington, D.C. and eight California school districts have different goals for student performance. Goals that cut achievement gaps, or delay the universal proficiency deadline, or lead to college and career readiness, or something else. In some states, failing to meet these goals – like failing to make AYP – triggers interventions as a priority or focus school. But in others, there isn’t any meaningful accountability attached to the new targets. Moreover, many states won’t name any new priority or focus schools this year.

While states don’t have a clean record when it comes to gaming accountability systems, that isn’t necessarily what’s happening here. Holding priority and focus lists constant from 2013 to 2014 is a pragmatic decision on states’ parts, because school performance goals aren’t the only thing changing. Across the country, in waiver and non-waiver states alike, students will also be field testing the new Common Core-aligned tests developed by SmarterBalanced and PARCC. And the Department is letting all states apply for additional flexibility so that some students, in some schools, would take the field test and wouldn’t take state standardized tests in at least one subject. In other words, states won’t have to “double test.”

This creates a problem for the continuity of school accountability systems. How can you judge school performance fairly and accurately when the data aren’t comparable between schools? That’s like determining the faster runner when one competitor has hurdles in their lane and the other doesn’t. Further, the field tests aren’t designed to be used for making school accountability determinations, or frankly, measuring student performance. As Tom Kane notes in his incredibly smart take on the issue, the field test is meant to test the validity of individual test items, not produce a valid score for an individual student. Making a trade-off between high-stakes consequences for school accountability and a valid field test seems like a relatively easy choice. Hold accountability determinations steady and continue all current school improvement efforts, but make sure the field test is conducted to the highest possible standard so that the tests are ready for primetime in 2015.

But it isn’t quite that simple. After all, accountability is about more than being labeled a “failing” school or a priority one. Accountability relies first and foremost on transparent, accurate reporting of student achievement data. And this is where the field test creates a much more harmful trade-off. The U.S. Department of Education will still require all students to be assessed in both reading and math, but states will not be required to publicly announce the results for students taking a field test. For the first time in the NCLB era, there will not be achievement data available for a significant number of students and public schools.

This is a big deal. These data (should) inform nearly every decision made in education – for families, for educators, and for policymakers. Should we send our child to the neighborhood school, or try to enroll her in a charter school nearby? How effective was our new 7th grade math curriculum? Did our new professional development program improve teaching quality? Are the interventions in our focus schools working? All of these questions will be much more difficult to answer without student assessment data. Further, as Bellwether’s Chad Aldeman and Andy Smarick write, this compromises efforts to measure student achievement and growth as required in Race to the Top, ESEA waivers, and a host of other Obama education reforms. Yes, states could continue to administer their current tests during the field test, as they have during previous assessment revisions. But many will not. While the Department was clearly trying to appease (or even subtly encourage) states to participate in the field test, would states have really balked at field testing if every student was also given the state assessment?

Giving up a year of meaningful school accountability is a high price for getting better, more rigorous assessments that reflect what truly matters: whether students are ready for college and career. But the Department didn’t just give up meaningful accountability. They’re also giving up public reporting of test results at the same time. Does that make the price too high?

While it’s too late to reverse the Department’s decision, states participating in the field test should take a prudent and limited approach to it. Let field tests be field tests. They weren’t designed to be used as measures of individual student achievement or school performance. And the more students and schools participating in field testing, the larger the effect on transparency and accountability will be. Unfortunately, a few states – most notably California – are already gearing up to scrap their state assessments entirely this year and only administer the field test.

2014 was never going to be the year we saw universal proficiency. Unfortunately, it could shape up to be the year we see universal missing data. Let’s hope other states don’t follow California’s lead.

Enhancing GED Instruction to Prepare Students for College and Careers

July 29, 2013

Nearly 40 million adults in the United States lack a high school diploma or GED.  Although employment and economic outcomes for individuals with only a high school diploma are poor, the outcomes for those with only a GED are worse. Such poor results for GED recipients have led some to redesign their GED programs in hopes of better outcomes.   A new report from MDRC reports the findings from a recent random assignment study of a redesigned GED program at LaGuardia Community College of the City University of New York. The report shows the impact of LaGuardia Community College’s GED Bridge to Health and Business program, an initiative designed to prepare students to pass the GED exam and encourage them to continue on to college and training programs. Initial results show that students enrolled in the Bridge program were more likely to complete the GED prep course, more likely to pass the GED exam, and more likely to enroll in college than students enrolled in a traditional GED prep program.

Among the report’s other findings:

  • 68% of Bridge students completed the GED preparation course, compared to 47% of students in the traditional GED prep program.
  • Bridge students were twice as likely to pass the GED exam as students in the traditional program (52.8% compared to 22.4%).
  • Bridge students enrolled in college at much higher rates than students in the traditional GED prep program.
    • 24.7% of Bridge students enrolled in a CUNY community college compared to 7.2% of GED prep students.
    • Additionally, Bridge students persisted at higher rates; 12% continued into the second semester while only 3% of GED prep students returned for another semester.
  • The report’s authors attribute the positive outcomes of  success of the Bridge program to key design features of the Bridge program:
    • An original curriculum that emphasizes concepts from the fields of business and health care, relates to students’ aspirations, and helps them work through real-life problems.
    • Individual and group advising and full time master’s-level educators who made themselves available outside of class time.
    • Additional in-class hours to prepare for the exam and receive personal attention from instructors.
    • In-depth transition advising helps students make a plan for a college or career program and stay on top of assignments and deadlines. 

Aspirations Versus Assets in Children's Savings Accounts

July 15, 2013
Publication Image

This post originally appeared on our sister blog, Higher Ed Watch.

This morning, our colleagues in the Assets Building Program at New America hosted an event around the release of Building Expectations, Delivering Results--a comprehensive bi-annual report that lays out the state of reserach around college savings accounts and presents interesting ideas around how these instruments could be used to help lower-income students. (You can read the whole report and see nice graphical representations of some of the findings at Save4Ed.com and go here to watch the video of the event.) It was an engaging conversation around what research already tells us about accounts, as well as where we still have some tough questions to answer. I particularly recommend listening to Dana Goldstein's discussion of talking to two students who made differing use of accounts and how it framed their behavior, as well as William Elliott's challenging assumptions around whether low income families can actually save or not. 

Our Assets Building colleagues also kindly invited me to participate on the panel, where I talked about how the structure for accounts would differ a lot from a government perspective based upon whether or not you wanted to maximize asset accumulation or drive increased expectations. I also laid out an idea for how better leveraging state funds through an account-like structure could be a promising way to achieve the latter goal. I've posted my remarks after the jump, but I highly recommend giving the report a read.

Prepared remarks for the event

It strikes me that the discussion around accounts focuses on two big benefits: (1) as a tool to help build aspirations so students are better prepared for college and (2) as a way to accumulate assets to help cover costs.

But those two goals are actually quite different and accounts designed to achieve each of them would not look the same. I’d argue that creative use of the account structure would be very effective at building aspirations, but actually seeding them with Federal dollars entails some very significant policy hurdles.

So I wanted to take a couple of minutes to discuss some of the difficulties that would apply in actually tapping into Federal dollars to fund accounts and then suggest an alternative way to consider the account structure that could help with the aspirational goals.

There are three big impediments to a Federal-based account system: cost, infrastructure, and conditions.

Cost is probably the biggest impediment because the largest source of higher ed support for postsecondary education, Pell Grants, are mostly funded through the discretionary process. That means that each year Congress has to come up with sufficient funds to cover the majority of the program’s cost.

What this means is that if you spend Federal dollars today that a kid would otherwise have gotten in the future, you don’t get credit for reduced future spending. It’s treated as a cost. And seeding accounts for millions of kids throughout their elementary and secondary education would probably add billions in additional spending that woudl have to compete with finding dollars to close significant shortfalls in the Pell Grant program over over the coming years.  

The next consideration would be infrastructure. The Pell Grant program also provides cash benefits to students, but as a just-in-time voucher when they go to college. But running that program is streamlined because the Federal government relies upon 7,500 middlemen in the form of colleges and universities to actually award the funds, make sure they are properly accounted for, etc. 

So a Federal-based account system would require either finding a way to set up accounts with millions of kids on an individual basis or you’d need to find ways to encourage states or someone else to set up their own structures to work with. That’s achievable, but would be very complicated to do.

Finally, Federal dollars come with more strings attached than a marionette. When I was at the Department of Education we worked to set up a savings account demonstration project through GEAR UP, which is a college access program that works with students in middle and high school. But for that structure to work with federal dollars required a series of complicated rules, such as having federal funds be properly maintained in their own separate account, limiting their investment into essentially riskless government assets, not to mention lots of restrictions around withdrawals and oversight. I think these challenges were among the main reasons why no one ultimately applied for the project.

But let’s say instead of being focused on an actual cash transfer, you wanted to optimize accounts to build students’ aspirations and behavior. If that’s your goal, then you could modify what some states are already doing to include accounts and avoid a lot of the challenges I just discussed.

The emphasis here would be less on moving actual dollars and more on having students understand the path that it takes to get to college and telling them about available college resources sooner.

This would be based on what’s known as “promise programs,” which a few states and localities are experimenting with. In these programs, the state signs agreements with low-income middle school students where in exchange for free tuition students agree to do things like take a college prep curriculum maintain a reasonable GPA—like a 2.0—fill out the FAFSA and apply to colleges.

But those programs don’t give students an intermediate sense of building to their goals—you either get the benefit at the end of four years or you don’t.

This is where accounts could help improve these programs. Rather than waiting until the end of four years to receive either all or none of the benefit, states could reward intermediate progress toward the goals by giving students “shares” of a college education. Such a structure strongly indicates how striving and doing well in earlier grades really is directly related to the end goal of college. And could include benefits for major benchmarks on the way to college--such as passing Algebra II.

This structure would be easier to set up, since states could control the details and make use of the funds they already put toward financial aid (especially so-called merit aid) and operating subsidies to cover the costs. You could even leverage the ill-targeted Federal education tax benefits if you were looking for some extra cash to encourage states to act.

Adding a Pell-related role to this structure could also be done through an expansion of existing unused flexibilities. Right now, low-income families find out about Pell eligibility more or less in the spring semester of senior year when they fill out the FAFSA.  But that’s really too late to guide aspirations or deal with college cost anxiety that could shape earlier behavior.

So why not expand an existing authorized but never used demonstration program to guarantee Pell awards for students based upon their eighth grade income? This would send a strong message to kids about a significant source of aid availability without needing to stand up a new system. Extra Pell costs would likely be minimal but could be addressed with a few design tweaks.

Again, it’s about what you see as the most important role for accounts. An account funded by state and federal college “shares” would send strong behavioral signals, but lacks the asset accumulation that comes with seeding actual Federal dollars. But that strategy carries a great degree of complications. And so are you think about design and goals its worth keeping in mind what the end result you are hoping for is and the challenges to getting there.

Update: A New NCLB Reauthorization Cheat Sheet

June 19, 2013

After the partisan markup in the Senate Health, Education, Labor, and Pensions Committee, it is the House of Representatives' turn to debate reauthorization of No Child Left Behind. The Student Success Act, offered by Rep. John Kline (R-MN), is set for a markup Wednesday morning in the House Education and Workforce Committee. Accordingly, we’ve updated our Senate markup cheat sheet to provide a comprehensive, side-by-side comparison of current law, the Obama administration’s waiver policy, and the current legislative proposals in the Senate and House. You can download the new cheat sheet here.

Here are a few of the highlights from the Kline proposal:

  • The Student Success Act would eliminate over 70 programs and consolidate many stand-alone programs (for instance, Title III for English Language Learners) into Title I, with flexibility for states and districts to shift money between them. The bill would also eliminate maintenance of effort requirements, meaning states and local school districts would not be penalized for spending less on required education programs.
  • Kline would not require states to adopt college- and career-ready standards, but they would have to maintain academic content standards – and aligned assessments – in reading, math, and science. And the bill includes really specific language, over and above the Alexander proposal, to prohibit the federal government from promoting participation in the Common Core State Standards initiative in any way.
  • The bill, similar to the Alexander proposal, would allow states to design whatever school accountability and improvement systems they want, including setting performance targets (if any). Kline would also clamp down on the Secretary of Education’s authority to offer waivers to states and districts in exchange for external conditions.
  • Kline, however, would be more prescriptive than either Harkin or Alexander in one area: teacher evaluations, with states required not only to develop them, but also to use the results to make personnel decisions.
  • Kline would not allow Title I funding to follow the child to other public or private schools, but there is speculation that a backpack funding provision could be added to the Student Success Act at a later point. House Majority Leader Eric Cantor (R-VA), for example, has expressed an interest in some sort of portability provision.

Stay tuned to Ed Money Watch and Early Ed Watch for continuing coverage of these bills and the markup, as well as any alternative proposal from Rep. George Miller (D-CA), the Ranking Member on the House committee. And be sure to follow the markup on Twitter with me, @afhyslop, and my colleagues @LauraBornfreund and @ConorPWilliams

Waivers (of Waivers) Watch: If It Looks Like a Pause, and It Sounds Like a Pause…

June 18, 2013
Publication Image

Earlier today, U.S. Secretary of Education Arne Duncan weighed in on the question of whether states can delay their timeline for using Common Core assessments in accountability systems for schools and teachers. The tests are set to be fully deployed during the 2014-15 school year, and according to the original policy for offering No Child Left Behind waivers, the results from the assessments would also be used for school accountability and educator evaluations that year (except in states that applied for waivers after August 2012 – see this nifty chart for a full breakdown). Under the new policy, however, states would be able to apply to hold off using the evaluation results for personnel decisions for an extra year – meaning that, in some states, the results from the 2014-15 year would be used to provide feedback and inform professional development only.

The question of whether to “pause” or place a “moratorium” on Common Core implementation has divided education stakeholders. Fifteen organizations, including the American Federation of Teachers and National Education Association, support a moratorium on high-stakes accountability (including student promotion and graduation policies, personnel decisions, and school improvement designations) associated with the Common Core. Instead, these groups - the Learning First Alliance - would like to focus all immediate efforts on improving the supports teachers have to adopt the Common Core, including professional development, curriculum, technology infrastructure, and other resources. On the other hand, Chiefs for Change – a group of eleven reform-minded chief state school officers – urged Secretary Duncan to maintain the Common Core implementation timeline, even for high-stakes decisions, noting that states made these commitments years ago and should not backtrack on accountability.

Others took a slightly more measured approach, but still supported a pause on some components of implementation. The Council of Chief State School Officers asked for state flexibility in three areas: school ratings, teacher evaluations, and which assessments to use for accountability during 2013-14. Some states could maintain the rigorous timelines laid out in their waiver plans, while others could choose to slow down on one or all of these components.

And it appears that Secretary Duncan chose to take the CCSSO route, more or less. States could apply – if they want – to delay the most serious consequences for teachers, like decisions to award tenure or dismiss staff, for one year. Additionally, states would have new flexibility for implementing assessments and school accountability systems. They could apply to use either existing state assessments or Common Core field test results for accountability in the 2013-14 school year (to avoid the so-called “double testing” problem).

While Secretary Duncan insisted the new policy is not a “pause” or a “moratorium” on Common Core, it’s hard to distinguish between an “extension” – the language used by the Department – and a “pause.” No matter what you call it, the requirement for waiver states to use evaluations for personnel decisions can be shelved for a year. And there is no question that states have had a lot of time to fully transition to the Common Core – in most cases, over four years, longer than they had to implement all of the components of No Child Left Behind. In the words of Chad Aldeman, “If this isn’t enough time, what would be?” Will opposition to using teacher evaluations for personnel decisions really die down by the time 2016 rolls around? Further, the new policy could create additional confusion in an already confusing waiver process. It says something that the Department has to release a four-page, state-by-state chart just to explain the timeline for implementing the waiver components (still waiting for a state-by-state chart explaining what they’re actually doing – a far more complicated question).

Still, the Secretary’s decision is a fair compromise between the competing advocacy groups’ positions. And I give credit to the Department for one thing: holding firm on the most critical component of accountability, continuous improvement. More so than the punitive consequences, like school closures and teacher dismissals, accountability really serves to provide meaningful and transparent feedback to schools and educators and give them a roadmap to improve. During the transition to college- and career-ready standards, it is imperative for both schools and teachers to be evaluated on their progress and to use information from evaluations to improve the implementation process. If accountability and other incentives for educators are not aligned to the standards, what kind of signal does that send about the value of implementing them well?

So yes, there will be a pause. And members of Congress can now wave binders full of waivers, and then waivers of waivers, during hearings. But at least the Department is not pressing pause on what’s most important: its expectations for higher standards, better assessments, and continuous improvement.

The Reality of College Readiness 2013

June 14, 2013

In a companion report to The Condition of College & Career Readiness, a recent paper from ACT traces enrollment, retention, re-enrollment, and migration patterns of 2011 ACT-tested high school graduates. Since 1983, there has been little change in retention and persistence rates at U.S. colleges and universities. The report seeks to raise awareness that many students do not take a direct path to completion, and in fact, 41% of graduates attended more than one institution, 38% enrolled part time, and over 40% of students transferred during their college experience in 2011.

Among the report’s findings:

  • According to the report, a direct relationship exists between scores on ACT subject tests and retention, persistence, and degree completion.
    • Additionally, students who earn minimum (benchmark) scores in more than one subject area are more likely to enroll in a four-year institution.
  • Between 22 and 43 percent of ACT-tested high-school graduates across the country who enrolled in higher education in 2011 either did not re-enroll or had unverifiable enrollment statuses.
    • In addition, student mobility between colleges indicates a need for policies supporting a seamless transition from institution to institution.
  • Of 2011 ACT-tested high school graduates, most are retained in the state of their original enrollment.
    • Most students who initially enroll in state re-enroll in state for their second year.
    • Most students who enroll out of state re-enroll out of state for their second year.
    • The rates of students who are retained in state and those who enroll and re-enroll out of state for two-year colleges are lower than rates for public four-year colleges.

Syllabus: Week of June 10, 2013

June 14, 2013
Publication Image

Welcome to the Syllabus, a guide that provides insight into what’s happening in higher education.

Read:

Going to College is Worth it – Even if You Drop Out, Dylan Matthews
The Washington Post

There was a time when high school was rare and college was reserved for the elite. In today’s world, the value of education is vastly different. Some sort of postsecondary education is an expectation for most. It seems that one must attend and graduate college for entrée into the middle class. Due to stagnating wages and rising college prices, however, many have questioned whether attending college is a financially sound decision. According to researchers at The Hamilton Project the answer is “yes.” Their recent study shows that only 58 percent of college students enrolled in 2004 received a degree by 2010. Nevertheless, those students who did not graduate still earned more income than those who never enrolled in college. In addition, college dropouts make $8,000 more than high school graduates. This figure includes factoring in the cost of the student’s additional education. Matthews concludes by stating, “Dropping out of college is unquestionably a worse economic bet than finishing it. But the evidence suggests that starting and not finishing is much better than never starting at all.”

Listen:

Are There Jobs Out There for Recent Grads?
NPR Tell Me More

One of the biggest concerns for recent college graduates is whether or not they will obtain a fair paying job after spending countless hours and thousands of dollars on higher education. Recent numbers indicate 175,000 new jobs were obtained last month. However, the number of unemployed individuals increased by 7.6 percent. This is because more people entered the labor force. If you’re a recent college grad, you’re still in better shape than those who do not hold a college degree. Surveys show that the salaries of offers for new graduates are up about 5 percent. Additionally, college grads have an unemployment rate of 3.8 percent as compared with high school dropouts who have an unemployment rate of over 11 percent.

Discuss:

Minn. Program Will Offer a Tuition Break Based on Scores on a Standardized Test, Dan Berrett
The Chronicle of Higher Education

In order to motivate students Minnesota State University at Moorhead created a program called “Up2U” that encourages their students to academically achieve and complete college by providing financial incentives through a transfer tuition reduction. In order to receive this deduction the following conditions must be met: 1) The student must enroll full-time in the fall at the college and maintain a GPA of 2.0 for their first four semesters; and 2) During their fourth semester the student will take the new version of the Collegiate Learning Assessment or CLA, which is a standardized test of critical thinking. If students have the same GPA and score well on the assessments they will see their tuition reduced by three-quarters of the full cost. Those opposed to “Up2U” are concerned the program will encourage “teaching to the test” and will alter the current curriculum.

Higher Ed Watch readers, what do you think? Is one test a good predictor of a student’s understanding of the material and critical thinking abilities? Given that the Collegiate Learning Assessment is a test of critical thinking, how could it alter curriculum? Would it even be possible to teach to this test?

Storify: Senate HELP Committee ESEA Markup

June 12, 2013

Syndicate content