SAYO-S&T: Survey of Academic and Youth Outcomes for Staff and Teachers
What is SAYO-S&T?
SAYO-S&T is one of three research-based measurement tools that make up the APAS System, a field-tested, user-friendly suite of assessment tools built with OST in mind.
Use the SAYO-S&T survey to measure any of the eight youth outcome areas that are scientifically linked to long-term positive youth development and academic and life success. SAYO-S&T is flexible -- it can be tailored to measure the specific youth outcomes that are linked to your program goals:
- Behavior in the Program/Classroom
- Initiative
- Engagement in Learning
- Relations with Adults
- Relations with Peers
- Problem-Solving
- Communication
- Critical Thinking
- Perseverance
- Self-Regulation
- Leadership
- Homework
- Academic Performance
How does it work?
SAYO-S&T relies on pre- and post-participation surveys that are completed by OST staff (SAYO-S) and/or academic teachers (SAYO-T) to collect data about youth participants. Each outcome area is measured by asking staff and teachers to respond to questions related to observable youth behavior. Programs should have the same individual or team complete the pre and post SAYO surveys on individual youth. This will allow programs to accurately capture changes that may have occurred over the year.
Who is it for?
- OST leaders, program directors, supervisors, curriculum and education coordinators, researchers, and 21st Century Community Learning Center staff and teachers
- Well-established programs (1 year or older) that offer a variety of programming to 25 or more youth participants who attend on a regular basis
- Programs serving youth in Grades K-12
How do I get trained to use it?
The APAS tools are free to use at your program site after you complete the required prerequisite training program. Training on the SAYO-S&T tools is available either in-person or online. If you are interested in SAYO-S&T for your program site, you can receive training for the entire APAS System, or training only for SAYO-S&T. Most programs find it favorable to complete our online training asynchronously through our training portal. Our online training subscription includes unlimited access to the training portal for one year.
For more information on training and fees: Please click here to get started
SAYO-S&T training will show you:
- How SAYO-S&T can be used to increase positive youth outcomes within your program
- How to plan your SAYO evaluation, customize the tools, and prepare staff and teachers to complete the surveys
- How to distribute surveys and collect data from SAYO
- How to understand and use your findings
- How SAYO-S&T fits into the APAS System
Frequently Asked Questions about the APAS System
What is the APAS System?
The APAS System is a flexible, research-based suite of tools to help programs measure quality and link it to youth outcomes. It is made up of three tools: APT (to measure program quality), SAYO-S&T (to survey staff and teachers about youth outcomes), and SAYO-Y (to survey youth about their perspectives). The tools can be used alone or together and are not intended for individual youth assessment or as a diagnostic tool.
Who should use the APAS System?
The APAS System has been used by OST leaders, program directors, supervisors, curriculum and education coordinators, researchers, and 21st Century Community Learning Center staff and teachers. These tools work best for programs that offer a variety of experiences for youth, such as enrichment and leadership activities in addition to academic support.
Is the APAS System right for my program?
The APAS System works best for well-established programs (1 year or older) that offer a variety of programming to 25 or more youth participants who attend on a regular basis. It is recommended for programs serving youth in Grades K-12 where youth attend at least 100 hours across a full school year or intensive session such as a day camp.
If your program does not fit the above description, we recommend that you start with only the APT, which is one tool in the APAS System, to measure the quality of your program and identify areas of strength and areas for improvement.
I am confused. How do I know if I need all of the APAS System or just one tool?
Each of the APAS tools can be used alone or in any combination. Tool selection should align with your program goals, the data you need, and your readiness to begin this work. For programs just starting data collection, select one tool that best aligns with what you need to know and your capacity to collect the data.
How much does the APAS System cost?
The APAS tools are free to use at your program site after you complete the required prerequisite training program. Training on the APAS tools is available either in-person or online.
What do you mean by “program site”?
Pricing for the APAS System is determined by the number of program sites. A program site is defined as a physical address where programming for youth occurs. For example, if your organization offers three programs at two different physical locations, you have two program sites.
How many staff members can be trained to use the APAS System?
Training provides instruction on the proper use of the tools and customization. If you opt for an in-person training, we will work with you to determine how many staff members should be trained. If you purchase a 1-year online training subscription for your program site, you can train as many staff members who work at that site as you want.
Can I customize the tools in the APAS System?
Yes, through our in-person training or online training subscription, you will learn how to customize the APAS System tools while maintaining the validity of your results.
Is the APAS System research-based?
Yes. The APAS System tools have been extensively piloted and scientifically tested beginning with the statewide Massachusetts Afterschool Research Study in 2004. Reliability and validity testing has continued with funding from the WT Grant Foundation and the Massachusetts Department of Elementary and Secondary Education. Technical Reports on the development, testing, and validation of the APAS tools can be found below.
- Measuring Program Quality - Afterschool Matters Journal 2016
- Measuring Program Quality Part 2 - Afterschool Matters Journal 2018
- Understanding and Promoting SAYO Outcomes
- Social and Emotional Learning with the Survey of Academic and Youth Outcomes (SAYO)
- Testing and Development of SAYO-S & T
- Testing and Development SAYO-Y
Who collects and analyzes the data?
The method for data collection and analysis for the APAS System depends on the specific tool. For the APT tool, data collection and analysis can be done by the program site director or administrator, a designated team, or an internal or external evaluator. For the SAYO-Y and SAYO-S&T tools, there are two options: NIOST staff can manage data collection and analysis (for a fee) OR programs can collect their own data through Survey Monkey, Qualtrics, or another survey platform. If you choose to collect your own data, you will need to pay for a professional-level license for Survey Monkey or Qualtrics.
Join OST professionals around the country who are using the APAS System.
