Last item for navigation
Reimagining Excellence: Stakeholder Surveys
Reimagining Excellence: District Launches Stakeholder Surveys Dec. 6 – 17
Posted on 12/03/2021
Student Working

Puyallup School District has partnered with Panorama Education to administer stakeholder input surveys to families, staff, and students that will help us identify strengths and opportunities for growth. We need your feedback. Your voice matters as we reimagine excellence for student learning and make meaningful changes in schools.     

How to Access:

- Staff and families will receive a link to the survey via email.  Survey links will close Dec. 17 at 5 p.m.  Please check your email or contact communications@puyallup.k12.wa.us if you did not receive a link to the survey via email.

- Student surveys will be administered in class Dec. 6 - 17.  

Thank you in advance for your participation. Creating and maintaining an organization that fosters inclusive education, care, professional learning, development and celebration of a diverse student population and workforce is a collective responsibility. Your feedback will help us improve learning environments, provide systems of support, and continue to graduate students who are happy, strong, and ready to take on the world.        

_____________________________________

General Information:  Frequently Asked Questions


- About the surveys
- Survey logistics
- Survey results

_____________________________________

About the surveys

 

How were the stakeholder surveys developed?
Surveys were developed under the leadership of Dr. Hunter Gehlbach, associate professor and associate dean at the UC Santa Barbara's Gevirtz Graduate School of Education and director of research at Panorama Education. Dr. Gehlbach and his research team at the Harvard Graduate School of Education followed a rigorous survey development process consisting of literature reviews, focus groups, feedback from experts around the county, cognitive interviews with students, and multiple rounds of piloting and refining. 

 

Dr. Gehlbach and his team developed the instrument based on modern principles of survey design. 
These best practices include:
Wording survey items as questions rather than statements.
Avoiding "agree-disagree" response options that may introduce acquiescence bias and instead using verbally labeled response options that reinforce the underlying topic.

 - Asking about one idea at a time rather than using double-barreled items (e.g., "How happy and engaged are you?").
Using at least five response options to capture a wider range of perception.
Phrasing questions with positive language rather than using reverse-scored or negative language, which students tend to have trouble understanding

 

Who can participate in the survey? Will all teachers and schools participate? 

Staff, students and families will have the opportunity to take the stakeholder survey specific to them Dec. 6-17 

 

What does the Panorama Student Survey measure? 

The Panorama Student Survey measures student perceptions of teaching and learning, culture and climate, and student experience in the classroom and school.  Student perceptions of their classroom experience helps identify a teacher's strengths and areas for teacher growth. Schools and teachers can use the results to set specific priorities for differentiated professional development and coaching support, to design effective teaching practices and more engaging learning environments, and to take actions that will improve student experience in school.  
 

The Panorama Student Survey contains two main categories of scales:
1. Scales about the Classroom and Teaching: Measures student perceptions of teaching and learning in a particular class.
2. Scales about the School: Measures student perceptions of teaching and learning at the school in general.


Within these two categories, Panorama offers several scales – or sets of questions – that measure specific topics (e.g., School Climate, Teacher-Student Relationships).
 


What are the student survey topics? 

Panorama has a total of 19 scales that measure student perceptions of teaching and learning in a particular class or at the school in general. The following scales have been selected for the student survey:
 

Scales about the Classroom and Teaching
- Pedagogical EffectivenessPerceptions of the quality of teaching and amount learning students experience from a particular teacher.
- Classroom ClimatePerceptions of the overall social and learning climate of the classroom.
- Classroom Rigorous ExpectationsHow much students feel that a specific teacher holds them to high expectations around effort, understanding, persistence, and performance in class.
- Classroom EngagementHow attentive and invested students are in class.
- Classroom Teacher-Student RelationshipsHow strong the social connection is between teachers and students within and beyond the classroom.

Scales about the School
- School BelongingHow much students feel that they are valued members of the school community.
- Valuing of School:How much students feel that school is interesting, important, and useful.
- School SafetyPerceptions of student physical and psychological safety while at school.

 
How many questions or survey items are there for each stakeholder survey?
- Grades 3-528 survey items (15-25 minutes)
Grades 6-12: 35 survey items (15-25 minutes)
Teachers: about 85 survey items (30 minutes)
Staff: about 50 survey items (20 minutes)
Families: 44 survey items(15-20 minutes)

What kinds of survey questions are asked?
Each of Panorama's survey scales includes 4-7 items that measure one specific construct or topic. Survey items were developed based on modern principles of survey design. These best practices include:

Wording survey items as questions rather than statements.
Avoiding "agree-disagree" response options that may introduce acquiescence bias and instead using verbally labeled response options that reinforce the underlying topic.
Asking about one idea at a time rather than using double-barreled items (e.g., "How happy and engaged are you?").
- Using at least five response options to capture a wider range of perceptions.
Phrasing questions with positive language rather than using reverse-scored or negative language, which students tend to have trouble understanding.

Stakeholder survey items use response options that reinforce the central focus of the question. For example, a question like "How much do you enjoy your class?" might have the following responses to keep respondents focused on the idea of "enjoy" as they think about their response: 

Do not enjoy at all

Enjoy a little bit

Enjoy somewhat

Enjoy quite a bit

Enjoy a tremendous amount

 

An example question for each survey scale are included below: 

Scales about the Classroom and Teaching

- Pedagogical Effectiveness
How often does this teacher give you feedback that helps you learn?
Classroom Climate 
In this class, how much does the behavior of other students hurt or help your learning?
Classroom Rigorous Expectations
How often does this teacher take time to make sure you understand the material?
Classroom Engagement
How often do you get so focused on class activities that you lose track of time?
Classroom Teacher-Student Relationships
If you walked into class upset, how concerned would your teacher be?

Scales about the School
- School Belonging
How connected do you feel to the adults at your school?
Valuing of School
How much do you see yourself as someone who appreciates school
School Safety
How likely is it that someone from your school will bully you online?

What information is there regarding the reliability and validity of the Panorama Student Survey? 

Panorama developed the Panorama Student Survey as the first major survey instrument with the following essential properties:

Educator-focused design, including survey scales that equip teachers with feedback they can use to improve practice and enable educators to monitor student attitudes, beliefs, and values that are predictive of important outcomes;
- Theoretically-grounded, empirically-based design process that meets or exceeds standards of academic scholarship;
Adherence to best practices in survey design;
Allowing schools to customize the survey to their specific needs and teaching frameworks while retaining validity and reliability; and
Providing the survey instrument to any educator interested in improving pedagogical practice and student outcomes for free.

How will the survey data be used? 

The primary purpose of the survey is to provide valuable reflective information for educators who are working to improve the classroom and school learning environment. Teacher reflections of the Panorama Student Survey results are used to inform a teacher's Core Professionalism. Teachers may reflect upon their individual or school-level results as appropriate to their role in the school. Teachers should consult and collaborate with their evaluator on the acceptable documentation method of reflection. Data is also aggregated to provide school, complex- and state- level feedback. These data can be used to highlight priorities, track improvement and evaluate programs.

_____________________________________

SURVEY LOGISTICS 

 

What are the differences between the Elementary (3-5) and Secondary (6-12) student survey versions? 

The Elementary (3-5) survey (28 items) has fewer items than the secondary and uses language and vocabulary that is accessible to most students in these grades. The Secondary (6-12) survey (35 items) is designed for older students and includes more items and age-appropriate language.
 

Is the survey administered in paper or online format? 

Surveys for staff and families will be administered online.  If a paper version is needed, email communications@puyallup.k12.wa.us.  Surveys for students in grades 3-12 will also be administered online. For students in grades K-, survey questions will be answered via class discussion.
 

How long does the survey take to complete? 

Anywhere from 15-30 minutes, dependent on stakeholder survey. For student administration, the time to complete the entire process in class, including material distribution and instruction should not last longer than 30 minutes.
 
 

How is the survey administered to students in different age groups? 

The surveys are administered to the whole class in grades 3-12. Students in grades 3–12 follow a standard protocol that typically involves the teacher administering the survey with the students reading the survey themselves. Specific details and instructions are outlined in separate administration instructions and scripts for the survey levels.
 

Will parents have the opportunity to review the survey? 

Yes. Hard copies of the student survey will be on file in school offices and posted online.   

 
What should parents do if they do not want their child participating?   

Parents who do not want their children to participate in the survey should contact their child’s school or classroom teacher (elementary grades) to opt out of participation. 

 

Can teachers read the items to a student who is having difficulty understanding the survey? 

Yes, teachers may do the following:
Read sentences or individual words.
Define words.
Read items requested by student(s).


What accommodations can be made for students with special needs participating in the survey?
 

Students will be provided with the documented accommodations identified in their IEPs during the survey administration window. 
 

Are students who are language or vocabulary challenged exempt from the survey administration? 

No, all students will be administered the Student Survey.
 

What are the considerations for English Language Learners or those who speak English as a second language?   

The Student Survey has been translated into multiple languages. The student may complete their survey using the online English or an online translated version. Students will be provided with the same documented accommodation as they receive for regular classroom instructionincluding questions being read aloud by the immersive reader in their devices.