WWW.DISSERTATION.XLIBX.INFO
FREE ELECTRONIC LIBRARY - Dissertations, online materials
 
<< HOME
CONTACTS



«Spring 2015 Georgia Milestones EOG/EOC Erasure Analysis Desktop Audit Results February 2016 Spring 2015 Georgia Milestones EOG/EOC Erasure Analysis ...»

Spring 2015 Georgia Milestones EOG/EOC Erasure Analysis

Desktop Audit Results

February 2016

Spring 2015 Georgia Milestones EOG/EOC Erasure Analysis Desktop Audit Results

Executive Summary

The Governor’s Office of Student Achievement serves as the reporting and accountability agency for

education in Georgia. As such, GOSA is charged by law with inspecting academic records of schools to

ensure that education institutions are faithful to performance accountability requirements. Through an academic audit, GOSA reviews student assessment data and other school records reported to the State to confirm accuracy and explore the effectiveness of local school initiatives in improving achievement.

The erasure analysis focuses on identifying classrooms and schools where the number of wrong answers that have been changed to right answers on individual student answer sheets is well above the state average. It is conducted in English-Language Arts, Mathematics, Science, and Social Studies in grades 3 through 8 and following eight high school courses: Ninth Grade Literature and Composition, American Literature and Composition, Coordinate Algebra, Analytic Geometry, Physical Science, Biology, U.S.

History, and Economics. It is important to note that the results of the erasure analysis are used as an initial flag to spur further investigation of many indicators to determine if any cheating occurred. The results do not indicate that cheating necessarily occurred.

To conduct this analysis, the State’s testing vendor, Data Recognition Corporation (DRC) had psychometricians scan answer documents to identify total erasures and wrong-to-right erasures per classroom.1 Using the DRC Erasure Analysis and accompanying data file, GOSA flagged schools for an internal desktop audit based on the following criteria: 2 EOG Flagging Criteria (Grades 3-8)  Five percent or more of classrooms in a school are flagged at four standard deviations or greater, OR  One classroom is flagged at seven standard deviations or greater.

EOC Flagging Criterion (Grades 7-12)  One classroom is flagged at five standard deviations or greater.

Results Summary For the EOG, 94 classrooms in 40 schools in 23 LEAs were identified for an initial desktop audit. After the audit, 19 schools in 12 LEAs require further inquiry. For the EOC, 32 classrooms in 23 schools in 12 LEAs were identified for an initial desktop audit. After the audit, 14 schools in 10 LEAs require further inquiry.

Currently, the analysis only includes paper-and-pencil tests. As part of its FY16 contract, DRC is developing pilot analysis of wrong-to-right answer changes from online testing. In addition, due to the technology in online testing, it is also providing pilot response similarity and response time analyses that may strengthen GOSA’s auditing efforts in future years.

In prior years, GOSA placed schools into four categories based on the percentage of classrooms flagged within each school: Clear of concern; Minimal concern; Moderate concern; and Severe concern. As a result, schools with a classroom flagged with a high standard deviation were not identified for a desktop audit if less than 5% of the classrooms in a school were flagged. With this in mind, GOSA has adjusted the standard deviation levels for EOG and EOC and added a criterion that automatically flags classrooms with greater than 7 standard deviations.

i Spring 2015 Georgia Milestones EOG/EOC Erasure Analysis Desktop Audit Results Schools requiring further inquiry are included in recommendations to the SBOE for inquiry, monitoring, teacher rotation during testing, and on-site audits. The following report contains the results of GOSA’s desktop audit and recommendations to the State Board of Education for actions to be taken in schools requiring further inquiry by the State.

–  –  –

Table of Contents EXECUTIVE SUMMARY

TABLE OF ABBREVIATIONS

EOG DESKTOP AUDIT

EOC DESKTOP AUDIT

GOSA RECOMMENDATIONS IN SCHOOLS REQUIRING FURTHER INQUIRY.......... 3 APPENDIX A: DESKTOP AUDIT INDICATORS

APPENDIX B: EOG/EOC SCHOOLS REQUIRING FURTHER INQUIRY

APPENDIX C: 2015 DRC EOG EXECUTIVE REPORT

APPENDIX D: 2015 DRC EOC EXECUTIVE REPORT

–  –  –

EOG Desktop Audit Analysis Overview GOSA identified schools for a desktop audit when five percent or more of classrooms in a school was flagged at four standard deviations or greater, or one classroom was flagged at seven standard deviations or greater. In total, 94 classrooms in 40 schools in 23 LEAs were identified for an initial desktop audit to determine a possible explanation for the flag that would remove the need for further inquiry.

In the desktop audit analysis, many school-level factors, outlined in detail in Appendix A, were reviewed holistically and discussed as a team before any determinations were made. GOSA placed schools in one of two categories: “further inquiry needed,” or “no further inquiry needed.” After the desktop audit, 19 schools in 12 LEAs, listed below, require further inquiry. Appendix B lists the number of classrooms at each school requiring further inquiry for both EOG and EOC.

Desktop Audit Schools Schools Requiring Further Inquiry  Scott Elementary School (Atlanta Public Schools)  Miles Intermediate School (Atlanta Public Schools)  Cleveland Elementary School (Atlanta Public Schools)  Sequoyah Middle School (DeKalb)  Stephenson Middle School (DeKalb)  Stone Mountain Middle School (DeKalb)  Montgomery Elementary School (DeKalb)  Huddleston Elementary School (Fayette)  Taylor Road Middle School (Fulton)  Fulton Sunshine Academy Charter School (Fulton)  Risley Middle School (Glynn)  Greensboro Elementary School (Greene)  Harmony Elementary School (Gwinnett)  Friendship Elementary School (Hall)  Langston Road Elementary (Houston)  Blackburn Elementary School (Lumpkin)  Rosemont Elementary School (Troup) Spring 2015 Georgia Milestones EOG/EOC Erasure Analysis Desktop Audit Results EOC Desktop Audit Schools were identified for a desktop audit when one classroom was flagged at five standard deviations or greater within the school. Thirty-two classrooms in 23 schools in 12 LEAs were identified for an initial desktop audit to determine a possible explanation for the flag that would remove the need for further inquiry.





In this analysis, many school-level factors were reviewed holistically and discussed as a team before any determinations were made. GOSA placed schools in one of two categories: “further inquiry needed,” or “no further inquiry needed.” After the desktop audit, 14 schools in 10 LEAs, listed below, require further inquiry. Appendix B lists the number of classrooms at each school requiring further inquiry for both EOG and EOC.

EOC Desktop Audit Schools Schools Requiring Further Inquiry  Early College High School at Carver (Atlanta Public Schools)  Charles R Drew High School (Clayton)  Sprayberry High School (Cobb)  Clarkston High School (DeKalb)  Peachtree Middle School (DeKalb)  Tucker High School (DeKalb)  Tucker Middle School (DeKalb)  Chapel Hill High School (Douglas)  Alpharetta High School (Fulton)  North Springs High School (Fulton)  West Hall High School (Hall)  Jefferson High School (Jefferson City)  Jordan Vocational High School (Muscogee)  Southeast Whitfield High School (Whitfield) Spring 2015 Georgia Milestones EOG/EOC Erasure Analysis Desktop Audit Results GOSA Recommendations in Schools Requiring Further Inquiry Overall, 85 classrooms in 33 schools in 18 LEAs require further inquiry. GOSA recommends the

following actions to the SBOE in these schools:

• State monitors will observe and inspect schools requiring further inquiry for the 2016 Georgia Milestones test administration (EOG and EOC tests).

• Schools must rotate teachers in schools requiring further inquiry for the 2016 Georgia Milestones (EOG tests).

• GOSA will share data files with superintendents to facilitate:

• LEA investigation of reason(s) for flags

• Submission of online inquiry form to GOSA with results of investigation and an explanation of testing protocols in place.

• GOSA will conduct on-site audits as necessary.

No further action should be taken for flagged schools that require no further inquiry after the desktop audit.

Spring 2015 Georgia Milestones EOG/EOC Erasure Analysis Desktop Audit Results Appendix A: Desktop Audit Indicators Desktop Audit Indicators Reviewed Number of classrooms flagged in each school and whether the flagged classrooms had different test administrators.

Total erasures and number of wrong-to-right (w-t-r) at the classroom level, including student-level data to determine whether erasures are concentrated in a small number of students. Classrooms where more than 50% of students in a classroom have zero erasures and/or w-t-r erasures reduce the likelihood of systematic or widespread changes in answers from wrong to right.

The severity of the individual flagged classroom (i.e. the standard deviation value or how far from what is considered normal behavior is the class positioned). EOC flags between 5.0 and 6.0 SDs are of less concern than those over 6.0 SDs.

Percentage of total classroom erasures changed from w-t-r. Generally, classrooms with greater than 65% of erasures being w-t-r are of concern, unless a classroom with multiple students had one student with many w-t-r erasures, suggesting that systematic cheating was unlikely.

The number of students in each classroom. (Example: Extremes in classroom populations on both ends of the distribution can skew post-calculation metrics and in turn cause flagged classrooms.).

Classroom percentile ranks of wrong-to-right erasures by student to observe the distribution of erasures in a classroom and compare that distribution to the state distribution. For example, comparing a classroom’s 50th and 90th percentile with the state 50th and 90th percentiles can identify whether abnormal distributions and/or outliers.

The type of school (i.e. state charter school, high transient population, alternative education program, residential treatment facilities, etc.).

School demographics and groups (ELL population, gifted, magnet, students with disabilities, etc.).

Variance in performance level data from previous years (not applicable in 2014-2015 due to Georgia Milestones transition).

History as a school of concern.

Prior test monitoring and/or an on-site audit by state personnel.

District personnel and/or policies currently implemented to support test security.

Review of state monitor notes and/or forms.

Spring 2015 Georgia Milestones EOG/EOC Erasure Analysis Desktop Audit Results Appendix B: EOG/EOC Schools Requiring Further Inquiry The following list includes the number of classrooms flagged in the 33 schools requiring further inquiry after the desktop audit.

–  –  –

Spring 2015 Georgia Milestones EOG/EOC Erasure Analysis Desktop Audit Results Appendix C: 2015 DRC EOG Executive Report Spring 2015 Georgia Milestones EOG/EOC Erasure Analysis Desktop Audit Results Spring 2015 Georgia Milestones EOG/EOC Erasure Analysis Desktop Audit Results Spring 2015 Georgia Milestones EOG/EOC Erasure Analysis Desktop Audit Results Spring 2015 Georgia Milestones EOG/EOC Erasure Analysis Desktop Audit Results Spring 2015 Georgia Milestones EOG/EOC Erasure Analysis Desktop Audit Results Spring 2015 Georgia Milestones EOG/EOC Erasure Analysis Desktop Audit Results Spring 2015 Georgia Milestones EOG/EOC Erasure Analysis Desktop Audit Results Appendix D: 2015 DRC EOC Executive Report Spring 2015 Georgia Milestones EOG/EOC Erasure Analysis Desktop Audit Results Spring 2015 Georgia Milestones EOG/EOC Erasure Analysis Desktop Audit Results Spring 2015 Georgia Milestones EOG/EOC Erasure Analysis Desktop Audit Results



Similar works:

«3s_gestión 03 Guía básica para la gestión económico-financiera en organizaciones no lucrativas Equipo del Observatorio del Tercer Sector de Bizkaia 8 0 re 20 tiemb p Se 3s_gestión Guía básica para la gestión económico-financiera en organizaciones no lucrativas Equipo del Observatorio del Tercer Sector de Bizkaia Septiembre 2008 Autores: Begoña Gavilán, Nerea Guezuraga y Pedro Beitia Diseño gráfico: ST3 Elkartea Imprenta: Berekintza ISBN-13: 978-84-936634-0-7 Depósito...»

«List of Contributors Brian J. Arnold List of Contributors Brian J. Arnold is Senior Adviser, Canadian Tax Foundation, Toronto. He has been a consultant to various governments, the OECD, and the United Nations. He is the co-editor of the Bulletin for International Taxation and the author of several books and articles on tax issues. Philip Baker Philip Baker is a barrister and Queen’s Counsel practising from Field Court Tax Chambers in Gray’s Inn. He was called to the bar in 1979, began...»

«                                   ! ∀#  ∃ %      &   ∋(((()((()!∗!)++, &(+!, − ∃    −.∋    /    %. 0       +1 !)+1  −223 (+1∗)(4∗(             5           Common Market Law Review 50: 1643–1684, 2013. © 2013 Kluwer Law International. Printed in the United Kingdom. I TRADE, THEREFORE I AM: LEGAL PERSONHOOD IN THE...»

«Kennedy, Michael J.—July 2016 1 Michael J. Kennedy University of Virginia Phone: 434.924.0827 Curry School of Education MKennedy@Virginia.edu Department of Curriculum, Instruction, and Special Education Bavaro Hall, Room 327 Charlottesville, VA 22904 Education 2011 – University of Kansas, Lawrence, Kansas, Ph.D., Special Education 2007 – University of Delaware, Newark, Delaware, M.Ed., Exceptional Children and Youth 2004 – Michigan State University, East Lansing, Michigan, M.A.,...»

«RECOMMENDED FOR FULL-TEXT PUBLICATION Pursuant to Sixth Circuit Rule 206 File Name: 11a0168p.06 UNITED STATES COURT OF APPEALS FOR THE SIXTH CIRCUIT _ X THOMAS MORE LAW CENTER; JANN DEMARS;JOHN CECI; STEVEN HYDER; SALINA HYDER, Plaintiffs-Appellants, No. 10-2388, v. BARACK HUSSEIN OBAMA, in his official capacity as President of the United States; KATHLEEN SEBELIUS, in her official capacity as Secretary, United States Department of Health and Human Services; ERIC H. HOLDER, JR., in his official...»

«Free Schools Proposal Form The Proposal Form asks you for details on the educational aims and objectives, parental demand and premises of the proposed Free School. It also asks questions about the suitability of the provider(s) involved. All new Free Schools will be opened with the same legal status as Academies, in a binding agreement with the Secretary of State. Please note, all information provided in this form will be published on the Department for Education website. INITIAL DETAILS Name...»

«IOSR Journal Of Humanities And Social Science (IOSR-JHSS) Volume 20, Issue 10, Ver. III (Oct. 2015) PP 75-80 e-ISSN: 2279-0837, p-ISSN: 2279-0845. www.iosrjournals.org Applying the Law to Tackle the Menace of Revenge Porn in Nigeria: Lessons from the United Kingdom Augustine E. Arimoro* Abstract: The use of the internet and social media in the modern era is wide spread across the globe. By the mere click of a mouse or the push of a button on computers, mobile phone devices or electronic tablets...»

«Comptroller General of the United States United States Government Accountability Office DOCUMENT FOR PUBLIC RELEASE Washington, DC 20548 The decision issued on the date below was subject to a GAO Protective Order. This redacted version has been approved for public release. Decision Matter of: Bannum Inc. File: B-412045 Date: November 25, 2015 Nancy M. Camardo, Esq., Joseph A. Camardo, Jr., Esq., and Justin T. Huffman, Esq., Camardo Law Firm, PC, for the protester. Sarah Bloom, Esq., and William...»

«To: Columbia Law School Community From: Office of Registration Services (854-2668 or registrar@law.columbia.edu) Subject: Fall 2015 Final Examination Schedule Date: November 3, 2015 Please review carefully the revised schedule for Fall 2015 final exams. We would appreciate your bringing any discrepancies or errors to our attention. We do not expect changes to the day or time of a scheduled exam, but will notify you promptly should any adjustments become necessary. Exams are scheduled at either...»

«CITY COUNCIL, CITY OF ROCKFORD JOURNAL OF PROCEEDINGS JULY 16, 2007 COUNCIL CONVENED AT 6:09 P.M.1. The invocation was given by Pastor Jerry Demond, Halsted Road Baptist Church/Police Chaplain, and the Pledge of Allegiance was led by Page Karla Centeno.2. Roll Call: Mayor Lawrence J. Morrissey Aldermen: Sosnowski, Curran, Mark, Wasco, Bell, Jacobson, Thompson-Kelly, Johnson, Timm, Beach, Holt, Beck, McNeely, Conness –14Absent: -03. Alderman Beach moved to accept the Journal of Proceedings of...»

«An ASPIC-based legal argumentation framework for deontic reasoning Leendert VAN DER TORRE a, Serena VILLATA b,1 a University of Luxembourg, Luxembourg b INRIA Sophia Antipolis, France Abstract. In the last years, argumentation theory has been exploited to reason about norms, argue about enforced obligations and permissions, and establish the validity of norms seen as argumentative claims. In this paper, we start from the dynamic legal argumentation framework recently proposed by Prakken and...»

«QUT Digital Repository: http://eprints.qut.edu.au/13264 Electronic Contract Administration – Legal and Security Issues CRC for Construction Innovation, Brisbane. The Participants of the CRC for Construction Innovation have delegated authority to the CEO of the CRC to give Participants permission to publish material created by the CRC for Construction Innovation. This delegation is contained in Clause 30 of the Agreement for the Establishment and Operation of the Cooperative Research Centre...»





 
<<  HOME   |    CONTACTS
2016 www.dissertation.xlibx.info - Dissertations, online materials

Materials of this site are available for review, all rights belong to their respective owners.
If you do not agree with the fact that your material is placed on this site, please, email us, we will within 1-2 business days delete him.