INEE Curso UIMP 2016 - Evaluación educativa: Carmen Peña Jaramillo
INEE Curso UIMP 2016 - Evaluación educativa: Maciej Jakubowski
-
Upload
instituto-nacional-de-evaluacion-educativa -
Category
Education
-
view
107 -
download
0
Transcript of INEE Curso UIMP 2016 - Evaluación educativa: Maciej Jakubowski
![Page 1: INEE Curso UIMP 2016 - Evaluación educativa: Maciej Jakubowski](https://reader034.fdocuments.co/reader034/viewer/2022051318/587a45df1a28ab00148b53bf/html5/thumbnails/1.jpg)
Education Reforms in Poland: what lessons for other countries?
Maciej JakubowskiEvidence Institute
Santander, July 2016
![Page 2: INEE Curso UIMP 2016 - Evaluación educativa: Maciej Jakubowski](https://reader034.fdocuments.co/reader034/viewer/2022051318/587a45df1a28ab00148b53bf/html5/thumbnails/2.jpg)
Outline
• Main policies and outcomes of the reforms
• The 1999 reform
• 2007/2008 Curriculum reform
• 2009 School evaluation reform
• Early education reform
• Further challenges
![Page 3: INEE Curso UIMP 2016 - Evaluación educativa: Maciej Jakubowski](https://reader034.fdocuments.co/reader034/viewer/2022051318/587a45df1a28ab00148b53bf/html5/thumbnails/3.jpg)
PISA cycles and the Polish reforms
PISA2012PISA2009PISA2006PISA2003PISA2000
![Page 4: INEE Curso UIMP 2016 - Evaluación educativa: Maciej Jakubowski](https://reader034.fdocuments.co/reader034/viewer/2022051318/587a45df1a28ab00148b53bf/html5/thumbnails/4.jpg)
PISA cycles and the Polish reforms
PISA2012PISA2009PISA2006PISA2003PISA2000
1999
• Change of the school structure• Longer comprehensive education• School autonomy
REFORM
• External examination system• Decentralisation• New scheme for teachers promotion and remuneration
![Page 5: INEE Curso UIMP 2016 - Evaluación educativa: Maciej Jakubowski](https://reader034.fdocuments.co/reader034/viewer/2022051318/587a45df1a28ab00148b53bf/html5/thumbnails/5.jpg)
PISA cycles and the Polish reforms
PISA2012PISA2009PISA2006PISA2003PISA2000
1999
REFORM
2008
• New core curriculum
• New exams
REFORM
• Learning outcomes
• Problem-solving
![Page 6: INEE Curso UIMP 2016 - Evaluación educativa: Maciej Jakubowski](https://reader034.fdocuments.co/reader034/viewer/2022051318/587a45df1a28ab00148b53bf/html5/thumbnails/6.jpg)
The 1999 school reform goals
• to improve teaching quality
• to increase educational opportunities
• to improve efficiency
![Page 7: INEE Curso UIMP 2016 - Evaluación educativa: Maciej Jakubowski](https://reader034.fdocuments.co/reader034/viewer/2022051318/587a45df1a28ab00148b53bf/html5/thumbnails/7.jpg)
The 1999 reform major components
• Change of the school structure• Further decentralization• New financing scheme• School and teacher autonomy• National exams• New professional scheme for teachers
![Page 8: INEE Curso UIMP 2016 - Evaluación educativa: Maciej Jakubowski](https://reader034.fdocuments.co/reader034/viewer/2022051318/587a45df1a28ab00148b53bf/html5/thumbnails/8.jpg)
change of the school structure• The eight-year basic primary education was replaced by
six years primary school and three years comprehensive lower secondary school.
• Students were offered the opportunity to follow the same curriculum for nine instead of eight years.
• The selection of students into academic and vocational tracks was therefore postponed by one year until the age of 16.
• Upper secondary education was shortened by one year and education remained obligatory until the age of 18.
![Page 9: INEE Curso UIMP 2016 - Evaluación educativa: Maciej Jakubowski](https://reader034.fdocuments.co/reader034/viewer/2022051318/587a45df1a28ab00148b53bf/html5/thumbnails/9.jpg)
Decentralization
• School ownership and governance given to local governments.
• Most of the financing still comes from the central budget, but the local governments distribute them among schools in their area.
• Local governments employ school principals and accept teaching plans, but school principals employ teachers and run schools independently.
![Page 10: INEE Curso UIMP 2016 - Evaluación educativa: Maciej Jakubowski](https://reader034.fdocuments.co/reader034/viewer/2022051318/587a45df1a28ab00148b53bf/html5/thumbnails/10.jpg)
School Financing• The new financing scheme based on a per pupil formula replaced the old
system of financing schools based on historical costs.• It improved overall efficiency and began a large transition of school
network. • These changes were necessary as due to demographic decline funding of
smaller schools became truly problematic. • Poland has now one of the most efficient school systems • Administered at the local level with important regulatory powers left to the
central government. • For example, although most of the financing still comes from the central
budget, the local governments distribute them among schools in their area. • Teacher salaries are still centrally regulated, however, local governments
have some margin to differentiate them according to locally set criteria.
![Page 11: INEE Curso UIMP 2016 - Evaluación educativa: Maciej Jakubowski](https://reader034.fdocuments.co/reader034/viewer/2022051318/587a45df1a28ab00148b53bf/html5/thumbnails/11.jpg)
School and Teacher Autonomy
• Textbook market was freed and the right to chose learning materials was given to teachers.
• Teachers independently decide what materials and what methods to use in their classrooms.
• Teachers are evaluated independently from local governments.
![Page 12: INEE Curso UIMP 2016 - Evaluación educativa: Maciej Jakubowski](https://reader034.fdocuments.co/reader034/viewer/2022051318/587a45df1a28ab00148b53bf/html5/thumbnails/12.jpg)
External Exams• With increased decentralization and school autonomy, it
was necessary to introduce a new accountability system to monitor student outcomes.
• The new standardized national exams were launched in 2002 with all students in the final grades of the primary and the lower secondary school taking obligatory exams in core subjects.
• Later, standardized exams were introduced at the upper secondary level (serving also as entrance exams to tertiary education) and in vocational schools (now providing a final exam to obtain professional qualifications).
![Page 13: INEE Curso UIMP 2016 - Evaluación educativa: Maciej Jakubowski](https://reader034.fdocuments.co/reader034/viewer/2022051318/587a45df1a28ab00148b53bf/html5/thumbnails/13.jpg)
new professional scheme for teachers
• To motivate teachers professional development a new professional scheme was introduced.
• Four professional levels are now linked to different salary levels. • Currently, nearly all Polish teachers have masters degrees in
relevant subjects with around 50% at the highest professional level.
• The system is criticized for not measuring real teacher effort it motivated teachers to improve their qualifications.
• Today, teachers are among the most active professional groups when it comes to post-graduate studies and professional training.
![Page 14: INEE Curso UIMP 2016 - Evaluación educativa: Maciej Jakubowski](https://reader034.fdocuments.co/reader034/viewer/2022051318/587a45df1a28ab00148b53bf/html5/thumbnails/14.jpg)
PISA 2000: country average and between school differences
14
01000200030004000500060007000400
420
440
460
480
500
520
540
560
Between-school variance
Coun
try
aver
age
in re
adin
g
Low scoresHigh differences
High scoresLow DifferencesHigh scores
Large differences
Low scoresLow differences
![Page 15: INEE Curso UIMP 2016 - Evaluación educativa: Maciej Jakubowski](https://reader034.fdocuments.co/reader034/viewer/2022051318/587a45df1a28ab00148b53bf/html5/thumbnails/15.jpg)
Poland in PISA 2000
15
01000200030004000500060007000400
420
440
460
480
500
520
540
560
Between-school variance
Coun
try
aver
age
in re
adin
g
Low scoresLarge differences
![Page 16: INEE Curso UIMP 2016 - Evaluación educativa: Maciej Jakubowski](https://reader034.fdocuments.co/reader034/viewer/2022051318/587a45df1a28ab00148b53bf/html5/thumbnails/16.jpg)
Poland in PISA 2009
16
01000200030004000500060007000400
420
440
460
480
500
520
540
560
Between-school variance
Coun
try
aver
age
in re
adin
gHigh scores
Low differences
![Page 17: INEE Curso UIMP 2016 - Evaluación educativa: Maciej Jakubowski](https://reader034.fdocuments.co/reader034/viewer/2022051318/587a45df1a28ab00148b53bf/html5/thumbnails/17.jpg)
Poland in PISA 2009
![Page 18: INEE Curso UIMP 2016 - Evaluación educativa: Maciej Jakubowski](https://reader034.fdocuments.co/reader034/viewer/2022051318/587a45df1a28ab00148b53bf/html5/thumbnails/18.jpg)
2007/2008 Curriculum Reform• The old curriculum focused on what teachers should teach
rather than what knowledge and skills students should acquire.
• Rapid changes in Polish education, economy and society called for a modernization of the curriculum.
• The reform began in 2007 with a consultation process that included all major stakeholders. After a year of discussions, a new curriculum was passed as law in 2008.
• The new curriculum was introduced gradually, with the last changes only recently implemented in upper secondary schools.
![Page 19: INEE Curso UIMP 2016 - Evaluación educativa: Maciej Jakubowski](https://reader034.fdocuments.co/reader034/viewer/2022051318/587a45df1a28ab00148b53bf/html5/thumbnails/19.jpg)
2007/2008 Curriculum Reform
The new curriculum was developed under these principles:• Describe the expected learning outcomes for each
stage of education• Indicate the main objectives of teaching each
school subject• Define the requirements of central assessments• Constitute a coherent part of the Polish
Qualifications Framework
![Page 20: INEE Curso UIMP 2016 - Evaluación educativa: Maciej Jakubowski](https://reader034.fdocuments.co/reader034/viewer/2022051318/587a45df1a28ab00148b53bf/html5/thumbnails/20.jpg)
Major Effects of the New Curriculum
• The new curriculum had two major effects:– It strengthened teachers’ autonomy — and responsibility– It further shifted the emphasis from knowledge acquisition to critical
and analytical thinking• Polish students’ improvement between the PISA 2009 and
2012 was mostly the result of better responses to items measuring more complex, analytical thinking.
• The reform also included group projects and emphasized cross-curricular skills.
• The reform was also introduced in vocational schools• National exams were aligned with the new curriculum.
![Page 21: INEE Curso UIMP 2016 - Evaluación educativa: Maciej Jakubowski](https://reader034.fdocuments.co/reader034/viewer/2022051318/587a45df1a28ab00148b53bf/html5/thumbnails/21.jpg)
School Evaluation Reform
• Evaluating the education activity of schools and educational establishments;
• Auditing compliance with the law with respect to teaching and care activities and other statutory activities of schools and educational establishments; and
• Supporting the operation of schools and educational establishments and supporting teachers in carrying out their tasks in the area of teaching, care and other statutory activities.
![Page 22: INEE Curso UIMP 2016 - Evaluación educativa: Maciej Jakubowski](https://reader034.fdocuments.co/reader034/viewer/2022051318/587a45df1a28ab00148b53bf/html5/thumbnails/22.jpg)
School evaluation system in Poland
External evaluation
Internal evaluation
RequirementsReports
![Page 23: INEE Curso UIMP 2016 - Evaluación educativa: Maciej Jakubowski](https://reader034.fdocuments.co/reader034/viewer/2022051318/587a45df1a28ab00148b53bf/html5/thumbnails/23.jpg)
School reforms and PISA outcomes in Poland
1999
REFORM
2008
REFORM
2000 2003 2006 2009 2012470
480
490
500
510
520
530
reading mathematics science
OECDaverage
![Page 24: INEE Curso UIMP 2016 - Evaluación educativa: Maciej Jakubowski](https://reader034.fdocuments.co/reader034/viewer/2022051318/587a45df1a28ab00148b53bf/html5/thumbnails/24.jpg)
Re-analysis with 3PL IRT model and Polish data only(Dolata, Jakubowski, Pokropek, 2015)
![Page 25: INEE Curso UIMP 2016 - Evaluación educativa: Maciej Jakubowski](https://reader034.fdocuments.co/reader034/viewer/2022051318/587a45df1a28ab00148b53bf/html5/thumbnails/25.jpg)
Trends in performance across subjects and groups of students
0
5
10
15
20
25
30
low achievers high achievers
![Page 26: INEE Curso UIMP 2016 - Evaluación educativa: Maciej Jakubowski](https://reader034.fdocuments.co/reader034/viewer/2022051318/587a45df1a28ab00148b53bf/html5/thumbnails/26.jpg)
![Page 27: INEE Curso UIMP 2016 - Evaluación educativa: Maciej Jakubowski](https://reader034.fdocuments.co/reader034/viewer/2022051318/587a45df1a28ab00148b53bf/html5/thumbnails/27.jpg)
Early Education Reform• The reform made preschool education compulsory at the age of
five beginning in the school year 2011/12. • Since 2015, primary education has become compulsory for all 6-
year-olds. • In 2013, the government introduced a new law that secured
places for all 3- and 4-year-olds in preschool education. • In addition, preschool education became much more affordable
thanks to new regulations that offer the first five hours per day free of charge and allow local governments to charge no more than PLN 1 (less than EUR 0.25) for each additional hour.
• The goal is to reach 90% enrollment rate for 3-5-year-olds
![Page 28: INEE Curso UIMP 2016 - Evaluación educativa: Maciej Jakubowski](https://reader034.fdocuments.co/reader034/viewer/2022051318/587a45df1a28ab00148b53bf/html5/thumbnails/28.jpg)
![Page 29: INEE Curso UIMP 2016 - Evaluación educativa: Maciej Jakubowski](https://reader034.fdocuments.co/reader034/viewer/2022051318/587a45df1a28ab00148b53bf/html5/thumbnails/29.jpg)
15 years of reforms
• It is a continuum of changes despite all usual politics: big jumps, two steps backwards, three steps forward
• Main characteristic: expansion of comprehensive education
• But also: school autonomy, soft accountability, teacher professionalization, student-centered and outcomes oriented curriculum and practice
![Page 30: INEE Curso UIMP 2016 - Evaluación educativa: Maciej Jakubowski](https://reader034.fdocuments.co/reader034/viewer/2022051318/587a45df1a28ab00148b53bf/html5/thumbnails/30.jpg)
Extending comprehensive education for all
3-5 6 7 8 9 10 11 12 13 14 15 16 17 18 19
before 1999
Pre--school "0" primary
general secondary higher education secondary vocational
basic vocational
![Page 31: INEE Curso UIMP 2016 - Evaluación educativa: Maciej Jakubowski](https://reader034.fdocuments.co/reader034/viewer/2022051318/587a45df1a28ab00148b53bf/html5/thumbnails/31.jpg)
Extending comprehensive education for all
3-5 6 7 8 9 10 11 12 13 14 15 16 17 18 19
before 1999
Pre--school "0" primary
general secondary
higher education
secondary vocational
basic vocational
after 1999
Pre--school "0" primary lower
secondary
general secondary
secondary vocational
general/vocational
basic vocational
![Page 32: INEE Curso UIMP 2016 - Evaluación educativa: Maciej Jakubowski](https://reader034.fdocuments.co/reader034/viewer/2022051318/587a45df1a28ab00148b53bf/html5/thumbnails/32.jpg)
Extending comprehensive education for all
3-5 6 7 8 9 10 11 12 13 14 15 16 17 18 19
before 1999
Pre--school "0" primary
general secondary
higher education
secondary vocational
basic vocational
after 1999
Pre--school "0" primary lower
secondary
general secondary
secondary vocational
general/vocational
basic vocational
after2014
Pre--school primary lower
secondary
General secondary
secondary vocational
basic vocational
![Page 33: INEE Curso UIMP 2016 - Evaluación educativa: Maciej Jakubowski](https://reader034.fdocuments.co/reader034/viewer/2022051318/587a45df1a28ab00148b53bf/html5/thumbnails/33.jpg)
Further Challenges• Young adults in Poland have strong foundation skills,
but older generations lack such skills (PIAAC results)
• Students in Poland lack ICT skills and need to improve their ability to master foreign languages
• Tertiary education graduation rate is above 50%
• Levels of unemployment among young people are comparatively high and they are higher still among youngsters without a tertiary education degree
![Page 34: INEE Curso UIMP 2016 - Evaluación educativa: Maciej Jakubowski](https://reader034.fdocuments.co/reader034/viewer/2022051318/587a45df1a28ab00148b53bf/html5/thumbnails/34.jpg)
Learning to learn:What competencies will be needed in 20 years?
Forecasting vs. help students learn how to learn
Balancing different skills: a holistic approach to educationBusinesses in Poland rarely complain about lack of skills in
mathematics or reading among prospective employees. Companies often complain about lack of social skills,
language proficiency and ICT. Change in focus?
34
What next?
![Page 35: INEE Curso UIMP 2016 - Evaluación educativa: Maciej Jakubowski](https://reader034.fdocuments.co/reader034/viewer/2022051318/587a45df1a28ab00148b53bf/html5/thumbnails/35.jpg)
Key goals:
I. SOCIAL SKILLS: Identify what practices enable to develop social skills and develop instruments to assess such skills
II. ICT: Ensure that all students leave school with solid ICT skills and that students are as proficient on computers as they are when solving problems on paper.
III. VET: Develop and promote a more flexible vocational training system
IV. Equity: Ensure equal opportunities to master key competences
V. Creating space for innovations for the best educated generation of Poles!!!
35
What next?
![Page 36: INEE Curso UIMP 2016 - Evaluación educativa: Maciej Jakubowski](https://reader034.fdocuments.co/reader034/viewer/2022051318/587a45df1a28ab00148b53bf/html5/thumbnails/36.jpg)
Effective use of research
![Page 37: INEE Curso UIMP 2016 - Evaluación educativa: Maciej Jakubowski](https://reader034.fdocuments.co/reader034/viewer/2022051318/587a45df1a28ab00148b53bf/html5/thumbnails/37.jpg)
Effective structures are necessary
• Two main challenges:– Massive amount of information– Limited capacity to transform that into policy advice and
useful hints for practitioners• Two typical structural problems:
– Centralized institutions– Research-oriented with weak links to policy and practice
• Two typical research-related problems:– Lack of capacity to conduct „policy-friendly” research– Focus on data gathering rather than effective use of existing
data in secondary analysis
![Page 38: INEE Curso UIMP 2016 - Evaluación educativa: Maciej Jakubowski](https://reader034.fdocuments.co/reader034/viewer/2022051318/587a45df1a28ab00148b53bf/html5/thumbnails/38.jpg)
Effective use of research1. Knowledge brokers/research managers are necessary
• Specialized institutions to prepare policy-friendly products• Special units within then ministries to manage
knowledge-brokers/research and to use evidence effectively within the government
• Disseminate findings among practitioners• Work on research targets with policy makers and practitioners
2. Contract research through grants and shift funding to secondary analysis
3. Add impact and financial analysis to all government documents
![Page 39: INEE Curso UIMP 2016 - Evaluación educativa: Maciej Jakubowski](https://reader034.fdocuments.co/reader034/viewer/2022051318/587a45df1a28ab00148b53bf/html5/thumbnails/39.jpg)
Evidence and policy… and politics Research evidence was used to motivate reforms to
face existing challenges Research was used to defend reforms by showing their
outcomes (existing and potential) or by describing with data what issues need to be addressed• School structure• Early education reform• Curriculum reform
Current government actions are mainly political and often against the evidence:– Abandon support for early education reform– Plans to transform lower-secondary schools– Back to knowledge-oriented curriculum
![Page 40: INEE Curso UIMP 2016 - Evaluación educativa: Maciej Jakubowski](https://reader034.fdocuments.co/reader034/viewer/2022051318/587a45df1a28ab00148b53bf/html5/thumbnails/40.jpg)
How to support evidence-based policy making in EU?
Require evaluation for all EU-funded projectsSupport research comparing policies and
outcomes across European countries Good examples: Eurydice, PIAAC Not that good examples: ESLC Very limited use of secondary analysis
Support policy-relevant research but also promote independent knowledge-brokers
![Page 41: INEE Curso UIMP 2016 - Evaluación educativa: Maciej Jakubowski](https://reader034.fdocuments.co/reader034/viewer/2022051318/587a45df1a28ab00148b53bf/html5/thumbnails/41.jpg)
Bermuda triangle of education reforms
Centralized + limited
autonomy
No accountabilityLack of Focus on learning outcomes
Low quality
Teachers as bureaucrats
Limited professional
support
![Page 42: INEE Curso UIMP 2016 - Evaluación educativa: Maciej Jakubowski](https://reader034.fdocuments.co/reader034/viewer/2022051318/587a45df1a28ab00148b53bf/html5/thumbnails/42.jpg)
Key components of successful
school systems
Decentralized + school
autonomy
Soft accountability
focusing on learning
outcomes
High qualitylearning
Teacher as professionals