How many questions or survey items are there for each stakeholder survey?
- Grades 3-5: 28 survey items (15-25 minutes)
- Grades 6-12: 35 survey items (15-25 minutes)
- Teachers: about 85 survey items (30 minutes)
- Staff: about 50 survey items (20 minutes)
- Families: 44 survey items(15-20 minutes)
What kinds of survey questions are asked?
Each of Panorama's survey scales includes 4-7 items that measure one specific construct or topic. Survey items were developed based on modern principles of survey design. These best practices include:
- Wording survey items as questions rather than statements.
- Avoiding "agree-disagree" response options that may introduce acquiescence bias and instead using verbally labeled response options that reinforce the underlying topic.
- Asking about one idea at a time rather than using double-barreled items (e.g., "How happy and engaged are you?").
- Using at least five response options to capture a wider range of perceptions.
- Phrasing questions with positive language rather than using reverse-scored or negative language, which students tend to have trouble understanding.
Stakeholder survey items use response options that reinforce the central focus of the question. For example, a question like "How much do you enjoy your class?" might have the following responses to keep respondents focused on the idea of "enjoy" as they think about their response:
|
|
|
|
|
Enjoy a tremendous amount
|
An example question for each survey scale are included below:
Scales about the Classroom and Teaching
- Pedagogical Effectiveness
How often does this teacher give you feedback that helps you learn?
- Classroom Climate
In this class, how much does the behavior of other students hurt or help your learning?
- Classroom Rigorous Expectations
How often does this teacher take time to make sure you understand the material?
- Classroom Engagement
How often do you get so focused on class activities that you lose track of time?
- Classroom Teacher-Student Relationships
If you walked into class upset, how concerned would your teacher be?
Scales about the School
- School Belonging
How connected do you feel to the adults at your school?
- Valuing of School
How much do you see yourself as someone who appreciates school
- School Safety
How likely is it that someone from your school will bully you online?
What information is there regarding the reliability and validity of the Panorama Student Survey?
Panorama developed the Panorama Student Survey as the first major survey instrument with the following essential properties:
- Educator-focused design, including survey scales that equip teachers with feedback they can use to improve practice and enable educators to monitor student attitudes, beliefs, and values that are predictive of important outcomes;
- Theoretically-grounded, empirically-based design process that meets or exceeds standards of academic scholarship;
- Adherence to best practices in survey design;
- Allowing schools to customize the survey to their specific needs and teaching frameworks while retaining validity and reliability; and
- Providing the survey instrument to any educator interested in improving pedagogical practice and student outcomes for free.
How will the survey data be used?
The primary purpose of the survey is to provide valuable reflective information for educators who are working to improve the classroom and school learning environment. Teacher reflections of the Panorama Student Survey results are used to inform a teacher's Core Professionalism. Teachers may reflect upon their individual or school-level results as appropriate to their role in the school. Teachers should consult and collaborate with their evaluator on the acceptable documentation method of reflection. Data is also aggregated to provide school, complex- and state- level feedback. These data can be used to highlight priorities, track improvement and evaluate programs.
_____________________________________
SURVEY LOGISTICS
What are the differences between the Elementary (3-5) and Secondary (6-12) student survey versions?
The Elementary (3-5) survey (28 items) has fewer items than the secondary and uses language and vocabulary that is accessible to most students in these grades. The Secondary (6-12) survey (35 items) is designed for older students and includes more items and age-appropriate language.
Is the survey administered in paper or online format?
Surveys for staff and families will be administered online. If a paper version is needed, email [email protected]. Surveys for students in grades 3-12 will also be administered online. For students in grades K-, 2 survey questions will be answered via class discussion.
How long does the survey take to complete?
Anywhere from 15-30 minutes, dependent on stakeholder survey. For student administration, the time to complete the entire process in class, including material distribution and instruction should not last longer than 30 minutes.
How is the survey administered to students in different age groups?
The surveys are administered to the whole class in grades 3-12. Students in grades 3–12 follow a standard protocol that typically involves the teacher administering the survey with the students reading the survey themselves. Specific details and instructions are outlined in separate administration instructions and scripts for the survey levels.
Will parents have the opportunity to review the survey?
Yes. Hard copies of the student survey will be on file in school offices and posted online.
What should parents do if they do not want their child participating?
Parents who do not want their children to participate in the survey should contact their child’s school or classroom teacher (elementary grades) to opt out of participation.
Can teachers read the items to a student who is having difficulty understanding the survey?
Yes, teachers may do the following:
- Read sentences or individual words.
- Define words.
- Read items requested by student(s).
What accommodations can be made for students with special needs participating in the survey?
Students will be provided with the documented accommodations identified in their IEPs during the survey administration window.
Are students who are language or vocabulary challenged exempt from the survey administration?
No, all students will be administered the Student Survey.
What are the considerations for English Language Learners or those who speak English as a second language?
The Student Survey has been translated into multiple languages. The student may complete their survey using the online English or an online translated version. Students will be provided with the same documented accommodation as they receive for regular classroom instruction, including questions being read aloud by the immersive reader in their devices.