Tag: TVAAS

Thoughts on Testing

by JC Bowman, posted in Advocacy, JC Bowman, Leadership, Professional Educators of Tennessee, Tennessee Education, Testing, Unions

tnready1

In April, 2018, Professional Educators of Tennessee raised the issue on Testing, with a hard-hitting editorial called the Trouble with Testing. Now the Superintendents of two low performing districts, Shelby County and Metro-Nashville Public Schools are eliciting media attention by challenging testing across the state. Welcome to the club.

Testing has taken a wrong turn in public education. I have always tried to keep it simple: testing is like your school picture; it is what you look like on that particular day. Kids go in to take a test. Teachers show up to make sure kids are taking their own test. Parents encourage their children to do their best. However, like Ozzie & Harriet, Leave it to Beaver, and the Lone Ranger, those days are gone.

With an infusion of $501 million federal dollars of Race to the Top money we hurried to increase standards by adopting Common Core, which was soon corrected by moving back to state standards. We then increased testing, changing both format and frequency. Tennessee also adopted new evaluation methods. The teachers’ union supported the incorporation of TVAAS data into the state’s teacher evaluations, which landed Tennessee $501 million from the federal Race to the Top grant in 2010. Professional Educators of Tennessee did NOT support the use of that data on teacher evaluations, nor did they sign a support letter on the original grant submission.

Not everything Tennessee tried was damaging, but it is not debatable that, thus far, the Age of Accountability has failed students, teachers, parents and taxpayers. Since 2012, Tennessee has had one misstep after another in testing. In 2013, our tests were not aligned to our standards. In 2014, the issue was transparency, notably quick scores and test score waivers for final semester grades were the major issue. In 2015, the new TNReady online tests had issues in the post equating formula. In 2016, we fired the vendor, Measurement, Inc. because after the online platform was botched, they were unable to get out a paper version of the test. In 2017, we were again plagued by issues due to scoring discrepancies. This year 2018, had issues related to testing, including the belief by the testing vendor, Questar, that the Questar data center was under attack from an external source, although it is never thought that any student data was compromised.

At no point since 2012 were any of the testing issues the fault of students or educators. However, for educators, they are often the ones who bear the brunt, quite unfairly, of parental anger. Students also suffer, with everything from loss of instruction time to not understanding their educational progress. When we make education decisions on the basis of unreliable or invalid test results, we place students at risk and harm educators professionally. This is especially unfair to the hardworking teachers in our state. To policymakers and stakeholders alike we must ask these questions:

  • Why are we relying so heavily on test scores to make important educational decisions about students, teachers or schools, especially when the process is flawed? For example, when officials thought the Questar data center was under attack from an external source, there should have been no greater priority by the Tennessee Bureau of Investigation to identify and prosecute those individuals guilty of this activity and confirm that no student data was compromised. Fortunately, there was no attack.

  • Should we question the reliability, validity, and accuracy of testing in Tennessee since 2013? Especially when shifting between online to paper tests? Note: Reliability relates to the accuracy of their data. Reliability problems in education often arise when researchers overstate the importance of data drawn from too small or too restricted a sample. Validity refers to the essential truthfulness of a piece of data. By asserting validity, do the data actually measure or reflect what is claimed?

In Tennessee we appreciate straight talk and candor. We unquestionably detest hypocrisy. We understand mistakes are made by individuals, by companies and even by our government. We are not pointing fingers, just stating a fact. Clearly there is a problem with testing in Tennessee. It isn’t our students or our educators. It is a flawed testing system.

Shawn Joseph and Dorsey Hopkins timed the announcement of their joint press release well. A sitting group of mostly outgoing legislators were at the Capitol at the time to discuss education. It is also political season. Their joint letter will momentarily take the attention away from their own issues. However, we welcome the discussion. Unfortunately, simply offering the much-ballyhooed solution of another “blue ribbon” panel to discuss the testing issue is a mere diversion. For teachers, thank Race to the Top which was supported by the previous Superintendents of Shelby County and Metro-Nashville Public Schools and the teachers’ union. I wish both men had offered a solution. We will help you out- Eliminate TVAAS data from teacher evaluations. That would an enormous leap forward.

##

JC Bowman is the Executive Director of Professional Educators of Tennessee, a non-partisan teacher association headquartered in Nashville, Tennessee. Permission to reprint in whole or in part is hereby granted, provided that the author and the association are properly cited. For more information on this subject or any education issue please contact Professional Educators of Tennessee.

A Few Thoughts on Educational Assessment and Evaluation

by JC Bowman, posted in JC Bowman, Leadership, Professional Educators of Tennessee, Testing

jc ed background

At Professional Educators of Tennessee we view assessment of students much like a school picture.  It may not be an accurate depiction, but it is what the student looks like on that day.  Our position has always been that the fewer tests administered to students would equal less disruptions for students and teachers. We have worked with the Tennessee Department of Education toward this objective.  We feel like progress has been made and will continue to work with them and the next governor toward this sensible objective.

The 2018 TNReady student assessment results showed mixed results, but state leaders saw encouraging areas of progress, and we celebrate that success.  The majority of the 650,000 students who took the assessment this year did so on paper, but about 300,000 students took the test online.  Students improved most in early grades reading, and narrowed achievement gaps.  In addition, the results show a need for deeper, more sustained work to support improvement.  The release of the results of the latest statewide assessment, while flawed, do provide a data point for educators to consider.  We encourage them to look at the results, take the result seriously and consider the steps they need to take to help all students and schools succeed.

In general, we must always be careful in determining teacher performance based strictly on the test scores of students to whom the teacher is assigned during a school year. The risk of misidentifying and mislabeling teacher performance based on test scores is too high for it to be the major indicator of teacher performance, especially when you look at issues such as student demographic characteristics. A number of states, including Michigan, have since taken steps to lessen the impact test scores have on teacher evaluations, repeatedly mentioning factors outside an educator’s control which can influence a student’s academic performance.  The interaction between teacher and student is the primary determinant of student success.

Moving forward, it is worth noting that Dr. Bill Sanders, the creator of value added assessment, warned of the misuse of TVAAS for individual teacher data because of its volatility.  We would certainly remind policymakers of this detail. In fact, classroom observations by trained personnel, along with teacher and principal input, would likely produce far more consistent and reliable data for assessing the quality of teaching than scores on an annual assessment. Assessment outcomes cannot be viewed as a reliable or significant indicator of Tennessee student proficiency until we have consecutive years of stable test delivery in which students and educators are confident.

We look forward to continuing the dialogue with policymakers and working with all stakeholders toward creating a better framework for both educator evaluation and student assessment in Tennessee.  We have proven as a state that we are willing to be innovative and now we have the opportunity to get it right. We are committed to working with stakeholders to improve implementation of state assessment so that parents, educators, and policymakers can continue to know how our students are faring each year.  As we build on our success, and we need to move forward together.

– – –

JC Bowman is the Executive Director of Professional Educators of Tennessee, a non-partisan teacher association headquartered in Nashville, Tennessee.  Permission to reprint in whole or in part is hereby granted, provided that the author and the association are properly cited. For more information on this subject or any education issue please contact Professional Educators of Tennessee. 

TNReady Results 2018

by JC Bowman, posted in JC Bowman, Professional Development, Professional Educators of Tennessee, Professional Learning, Testing

tnready1

We view assessment of students much like a school picture. It may not be an accurate depiction, but it is what the student looks like on that day. Our position at Professional Educators of Tennessee has always been that the fewer tests administered to students would equal less disruptions for students and teachers. We have worked with the Tennessee Department of Education toward this objective. We feel like progress has been made and will continue to work with them and the next governor toward this sensible objective.

The 2018 TNReady student assessment results showed mixed results, but state leaders saw encouraging areas of progress, and we celebrate that success. The majority of the 650,000 students who took the assessment this year did so on paper, but about 300,000 students took the test online. Students improved most in early grades reading, and narrowed achievement gaps. In addition, the results show a need for deeper, more sustained work to support improvement. The release of the results of the latest statewide assessment, while flawed, do provide a data point for educators to consider. We encourage them to look at the results, take the result seriously and consider the steps they need to take to help all students and schools succeed.

In general, we must always be careful in determining teacher performance based strictly on the test scores of students to whom the teacher is assigned during a school year. The risk of misidentifying and mislabeling teacher performance based on test scores is too high for it to be the major indicator of teacher performance, especially when you look at issues such as student demographic characteristics. A number of states, including Michigan, have since taken steps to lessen the impact test scores have on teacher evaluations, repeatedly mentioning factors outside an educator’s control which can influence a student’s academic performance. The interaction between teacher and student is the primary determinant of student success.

Moving forward, it is worth noting that Dr. Bill Sanders, the creator of value added assessment, warned of the misuse of TVAAS for individual teacher data because of its volatility. We would certainly remind policymakers of this detail. In fact, classroom observations by trained personnel, along with teacher and principal input, would likely produce far more consistent and reliable data for assessing the quality of teaching than scores on an annual assessment. Assessment outcomes cannot be viewed as a reliable or significant indicator of Tennessee student proficiency until we have consecutive years of stable test delivery in which students and educators are confident.

We look forward to continuing the dialogue with policymakers and working with all stakeholders toward creating a better framework for both educator evaluation and student assessment in Tennessee. We have proven as a state that we are willing to be innovative and now we have the opportunity to get it right. We are committed to working with stakeholders to improve implementation of state assessment so that parents, educators, and policymakers can continue to know how our students are faring each year. As we build on our success, and we need to move forward together.

###

Professional Educators of Tennessee is a non-partisan teacher association headquartered in Nashville, Tennessee. Permission to reprint in whole or in part is hereby granted, provided that the author and the association are properly cited.