2016-17 School Recognition FAQs



Recognition Timeline

Criteria

Criteria

  
What Level Should We Apply For

What Level Should We Apply For?

Recognition Webinars

Webinars

 
https://www.surveymonkey.com/r/rec2016-17

Application


Please carefully read the Recognition Application FAQs to address any questions about the process. If, after reviewing the general Recognition webpage, these FAQs, and viewed the Recognition Webinars, you still have an unanswered question, please email Evaluation Team who will review your question and add it to the FAQs below. Recognition Applications were due online by Wednesday, May 24, 2017.


Please note this document is being added to as questions are submitted to our team! We appreciate your feedback. If you feel you have a question that is helpful to others please email the Evaluation Team.

Contents

  1. 1 General Questions
    1. 1.1 Q: When does the online Recognition Application need to be submitted?
    2. 1.2 Q: Our school missed the due date for Recognition. Can we still apply?
    3. 1.3 Q: In what situation does my school need to “apply” for Recognition?
    4. 1.4 Q: Where is the online Recognition Application?
    5. 1.5 Q: Before I begin the online Application, can I see the questions I will be asked?
    6. 1.6 Q: How much time will it take me to fill out the online Recognition application?
    7. 1.7 Q: Can I begin an application, exit the application, and come back to it to complete it later on?
    8. 1.8 Q: How will I know that my school's application has been submitted successfully?
    9. 1.9 Q: When will Recognized Schools be posted to the Midwest PBIS Website?
    10. 1.10 Q: Is there a required cover letter or other paperwork that needs to be completed?
    11. 1.11 Q: Why do we have to meet only behavioral outcomes for Gold, but demonstrate behavioral and academic outcomes for Platinum?
    12. 1.12 Q: Can early childhood centers, juvenile justice facilities or alternative settings apply/be considered for Recognition?
    13. 1.13 Q: Is there a separate process for Gold or Platinum levels of Recognition?
    14. 1.14 Q: What if our school doesn't fully meet a requirement, but we believe our outcomes warrant receiving a higher level of recognition? Where can we explain further?
    15. 1.15 Q: What if our school applies for a certain level of Recognition, but we end up not meeting the requirements. Will we be Recognized at a lower level where we do meet requirements?
  2. 2 Tiered Fidelity Inventory Questions
    1. 2.1 Q: How do we access the TFI online?
    2. 2.2 Q: What is considered fidelity at each tier of the TFI?
    3. 2.3 Q: My school does not have SWIS. Do we need to be SWIS users to obtain access to the TFI online?
    4. 2.4 Q: Can we submit our hard copy of the TFI or Recognition documents to the Midwest PBIS office? Can the Midwest team just enter it online for us?
    5. 2.5 Q: How does my school know their scores at each Tier on the Inventory? (These scores, in turn, help identify if we meet qualifications to then apply for Gold or Platinum level).
    6. 2.6 Q: We completed more than one TFI this year, which scores do we enter into the Recognition Application?
    7. 2.7 Q: Is Recognition based on the “Total Score” of our Inventory results?
    8. 2.8 Q: Do I need to print a Report of my TFI scores and send them into the Midwest PBIS Office in order to be Recognized?
    9. 2.9 Q: My team did not use the TFI Walkthrough tool, or similar surveying format, to complete Tier I subscale. Can we get full points for those items (1.3, 1.4 and 1.9)?
    10. 2.10 Q: At the end of the TFI there are optional questions. Are these required for all teams, and how do they connect to Recognition?
  3. 3 Academic Trend Data Questions
    1. 3.1 Q: For Platinum level applicants, what “evidence of sustaining and/or improving academic trends” is acceptable?
    2. 3.2 Q: What if our school has not seen positive Academic trends between any set of years? Where can I further explain?
    3. 3.3 Q: For Platinum level applications, what type of time frame is needed when providing three years or more of academic trend data?
    4. 3.4 Q: Why do we need to show trends, or multiple years of improvements?  Why not just a “cut off” percentage of achievement?
  4. 4 Behavioral Outcome Data Questions
    1. 4.1 Q: What tools can I use to track our school's Tier 2/Tier 3 outcome data?
    2. 4.2 Q: Does our school need to email our Tier 2/Tier 3 tracking tool to the MW PBIS team?
    3. 4.3 Q: If our district/school does not use SWIS, how can or should we report their ODR data?
    4. 4.4 Q: Why do we have to report only behavioral outcomes for Gold, but both behavioral and academic outcomes for Platinum?
    5. 4.5 Q: For Gold and Platinum level applicants, what is expected multi-tiered behavioral outcome data that demonstrates effectiveness of PBIS across all three tiers?
    6. 4.6 Q: When can I start calculating my behavioral outcomes and trend data for Recognition purposes?
    7. 4.7 Q: When calculating ODR data, should our school consider majors, minors, or both?
  5. 5 PBIS Assessments Questions
    1. 5.1 Q: Does my school still need to submit our BoQ, SAS, and/or TIC report scores for Recognition? Aren’t they required for Recognition?


General Questions

Q: When does the online Recognition Application need to be submitted?

A: By May 24, 2017. 


Q: Our school missed the due date for Recognition. Can we still apply?

A: Yes. Apply online, then email eval@midwestpbis.org to notify us of the late submission. We will review any late applications (submitted after May 24th) when we are finished processing the other applications, so possibly as late as August. Late submissions will likely not be included in the Recognize Schools list posted to our website by June 30th, 2017.

 

Q: In what situation does my school need to “apply” for Recognition?

A: All schools can decide to apply for recognition, and it is as simple as completing the TFI online and completing an online Recognition Application.


Q: Where is the online Recognition Application?

A: https://www.surveymonkey.com/r/rec2016-17

Q: Before I begin the online Application, can I see the questions I will be asked?

A: Yes. You can download this Microsoft Word document to see all questions included in the online application.


Q: How much time will it take me to fill out the online Recognition application?

A: Our best estimates are as follows:
  • Bronze or Silver: 5-10 minutes
  • Gold: 15-30 minutes
  • Platinum: 30-60 minutes

Q: Can I begin an application, exit the application, and come back to it to complete it later on?

A: No. The application must be completed in one sitting. You cannot go back into your application later on.

Q: How will I know that my school's application has been submitted successfully?

A: After you have filled out the online application, you will see the following screen:

Q: When will Recognized Schools be posted to the Midwest PBIS Website?

A: By June 30th, 2017. Late applications will be posted once they are reviewed by MW PBIS Staff, possibly as late as August 30.


Q: Is there a required cover letter or other paperwork that needs to be completed?

A: No.  The Recognition Process is intended to be as easy as possible, and focus school teams on the desired student outcomes. We hope the documents and data reported as part of the Recognition Application are a routine part of team action planning.


Q: Why do we have to meet only behavioral outcomes for Gold, but demonstrate behavioral and academic outcomes for Platinum?

A: The conceptual framework for PBIS is based on improving behaviors to increase academic instructional time and engagement. As school teams implement with higher rates of fidelity we anticipate that (1) student behaviors will improve, (2) instructional time will be “gained”, leading to (3) improvement in academic outcomes.


Q: Can early childhood centers, juvenile justice facilities or alternative settings apply/be considered for Recognition?

A: Yes, if the center or facility has taken the TFI for the 2016-17 school year, and completed the online Recognition Application online by May 24th, 2017.


Q: Is there a separate process for Gold or Platinum levels of Recognition?

A: No. All teams applying for Recognition follow the same online process, regardless of scores on the TFI subscales.

Q: What if our school doesn't fully meet a requirement, but we believe our outcomes warrant receiving a higher level of recognition? Where can we explain further?

A: At the end of the Application, you will enter a section named "Additional Information". It will say at the top "You are nearing the end of the 2016-17 Recognition Application!". In that section, you can explain further. Please be sure to include data in your explanation. Be sure to include how a solution fits into your action plan for next school year.

Q: What if our school applies for a certain level of Recognition, but we end up not meeting the requirements. Will we be Recognized at a lower level where we do meet requirements?

A: Yes. The school would then be recognized at the level they meet requirements for. (Example: applies for Gold, but doesn't meet Gold requirements; if meets Silver requirements, will be Recognized at Silver level.)


Tiered Fidelity Inventory Questions

ALL SCHOOLS wishing to be recognized for their PBIS efforts in 2016-17 will first need to complete the School-wide PBIS Tiered Fidelity Inventory (TFI) online and then complete the Recognition Application no later than May 24th, 2017.


Q: How do we access the TFI online?

A: The TFI is available at no cost on PBIS Assessments . Login to www.pbisapps.org with your user name and password, and click on PBISAssessments.  Select “Forgot my Password” option to reset your password if you do not remember it. If you need your TFI survey opened and do not have a local PBIS Assessments Coordinator, email eval@midwestpbis.org.


Q: What is considered fidelity at each tier of the TFI?

A: Fidelity @ Tier I = 70%+, Fidelity @ Tier II = 80%+, Fidelity @ Tier III = 80%+


Q: My school does not have SWIS. Do we need to be SWIS users to obtain access to the TFI online?

A: No. You do not need SWIS.


Q: Can we submit our hard copy of the TFI or Recognition documents to the Midwest PBIS office? Can the Midwest team just enter it online for us?

A: No. All responses to the TFI, and the Recognition Application, must be entered online in each system by a representative from that school/district by May 24th, 2017 for Recognition purposes.


Q: How does my school know their scores at each Tier on the Inventory? (These scores, in turn, help identify if we meet qualifications to then apply for Gold or Platinum level).

A:

  1. In PBIS Assessments, when viewing your organization, to the far right of the organization name is an option for Reports.

  2. Select Reports

  3. Once in Reports, select the options that enable you to report on each subscale. From the drop down menus:

  4. Under Select Survey, select SWPBIS TFI 2.1

  5. Under Select Report, select Subscale

  6. Make sure the From range includes the current school year


Q: We completed more than one TFI this year, which scores do we enter into the Recognition Application?

A: Please report the most recent responses. If your team has completed the TFI more than one time this school year, graphs generated in PBIS Assessments will include the subscale scores from each completion, with the dates for each completion clearly indicated under the scores.


Q: Is Recognition based on the “Total Score” of our Inventory results?

A: No. It is based on your “SubScale” scores (ie: what your school scored at Tier I, Tier II, and Tier III).


Q: Do I need to print a Report of my TFI scores and send them into the Midwest PBIS Office in order to be Recognized?

A: No. Please do not send us TFI Reports. Please enter the subscale scores into the Recognition Application online only.


Q: My team did not use the TFI Walkthrough tool, or similar surveying format, to complete Tier I subscale. Can we get full points for those items (1.3, 1.4 and 1.9)?

A: The TFI is a self-assessment that is only useful if self-assessment is accurate and can be documented. The scoring rubric represents evidence-based guidelines for implementation in PBIS. Teams are much more likely to achieve valued students outcomes if they self-assess accurately, which includes documentation of implementation efforts.  The team and coach together should determine if other sources document they are meeting scoring rubric requirements for an item.

Q: At the end of the TFI there are optional questions. Are these required for all teams, and how do they connect to Recognition?

A: The optional questions, in PBIS Assessments, for the TFI are not required for recognition. They are part of a larger data collection process by the National PBIS Technical Assistance Center. The optional data questions allow your team to consider how effective Tiers I, II, and III are in your school. They are part of a larger data for decision-making process, and improvements in these numbers should always be the goal of the team.


Academic Trend Data Questions

Q: For Platinum level applicants, what “evidence of sustaining and/or improving academic trends” is acceptable?

A: The Platinum level of recognition requires a summary that indicates the school is sustaining and/or improving academic outcomes for three years or more

  • Please describe whole school trends, and also focus in on any groups within the school that have made gains in the past three years. Include data in your response summaries for each year, but only provide us with an actual data report if you are contacted and asked to do so.
  • Examples of these academic trend documents to reference for your summary may include, but are not limited to: DIBELS, Easy CBM, Aimsweb, MAP testing results/reports, % of students passing all classes, % of students on track with credits (or proficiencies) to move to next grade level, or comparable data are acceptable evidence of trends in academic outcomes. Here are examples of reports that are acceptable to aid in describing your academic trends:

DIBELS example, “Cross-Year Box Plot Report:"


AIMSweb example, “Grade Level Report: Avg. Score by School Year:"


% of students passing all classes example:

- Export of school-wide data from edline, Infinite Campus, or other online grade programs


Here are examples of some academic trend descriptions that are acceptable :
1. Our DIBELS scores consistently show improvements for a majority of students from fall to spring of each of the past three years. The percentage of students who are at or above grade level has been at least 80% by the spring of each year. 

2. We had almost 95% of all students complete testing this year, and saw improvements across most student groups including:
      • Improvement in science testing for 10th grade.
      • Improvements in 9th grade for both reading and math compared to last year.
3. “60%-70% of 4th grade students have met or exceeded proficiency in Reading and Math for the past 3 years.”

Q: What if our school has not seen positive Academic trends between any set of years? Where can I further explain?

A: After the Academic Trend section of the application, you will enter a section of the application named "Additional Information".

If for any reason your data does not match criteria, but you still believe your outcomes warrant receiving a higher level of recognition, you can provide an explanation with supporting information. Please be sure to include data in your explanation. Be sure to include how a solution fits into your action plan for next school year. Here is an example:

  • "Our reading scores for elementary schools declined between last year and this year, because we had an influx of students who were English language learners. As a result, our action plan for next year includes more ELL supports."

Q: For Platinum level applications, what type of time frame is needed when providing three years or more of academic trend data?

A: Three consecutive years. For your 2016-17 SY data, if your scoring will not be reported to you by May 24th, you can provide another time frame showing academic success-- as long as it captures three consecutive years (ie: December to December, Fall-to-Fall, etc.).


Q: Why do we need to show trends, or multiple years of improvements?  Why not just a “cut off” percentage of achievement?

A: All schools go through challenges to implementing PBIS. Schools that have the systems in place to sustain through those challenges may see student data go up and down from year to year, but maintain an overall trend of improvement.  It is the long term trend toward improvement that is important, as this shows the integrity of implementation.


Behavioral Outcome Data Questions

Q: What tools can I use to track our school's Tier 2/Tier 3 outcome data?

A: Schools can utilize the Midwest PBIS Tier 2/3 Tracking Tool or the Wisconsin Tier 2/3 Tracking Tool.

Q: Does our school need to email our Tier 2/Tier 3 tracking tool to the MW PBIS team?

A: No. Please do not email us documents unless we reach out to you after May 24th and specifically ask for documents.

Q: If our district/school does not use SWIS, how can or should we report their ODR data?

A: Schools will report number of students who have 0-1 referral, 2-5 referrals, and 6 or more. For further help on obtaining these numbers using your raw data, visit the Evaluation page and look in the bottom left corner for a tip on how to create a Triangle Data Report.

Q: Why do we have to report only behavioral outcomes for Gold, but both behavioral and academic outcomes for Platinum?

A: The conceptual framework for PBIS is based on improving behaviors to increase academic instructional time and engagement. As school teams implement with higher rates of fidelity we anticipate that (1) student behaviors will improve, (2) instructional time will be “gained”, leading to (3) improvement in academic outcomes.

Q: For Gold and Platinum level applicants, what is expected multi-tiered behavioral outcome data that demonstrates effectiveness of PBIS across all three tiers?

A: Teams will report the % of students receiving 0-1 ODRs, 2-5 ODRs and 6+ ODRS.  They can gather this information through the Triangle Report in SWIS, or other triangle reports (WI PBIS Triangle Tool, or Connecticut Triangle Tool) or from other behavioral data systems.


The expectation for Gold level of Recognition will be as follows:

      1. 80-90% of all students have 0-1 office discipline referrals (ODR)
      2. 5-15% of all students have 2-5 ODR
      3. 1-5% of students have 6 or more ODR, and
      4. Suspension rates in the following ranges
        • Elementary Schools: 3.5% or fewer of students have received an out-of-school suspension.
        • Middle/Junior and High School: 6% or fewer students have received an out-of-school suspension.
          • Illinois Senate Bill 100 prohibits publicly-funded Illinois schools, including charters, from using "zero tolerance" discipline policies, unless otherwise required by law.  A key goal of the measure is to "limit the number and duration of expulsions and suspensions to the greatest extent practicable". 
The expectation for Platinum level of Recognition will be as follows:
      1. 80-90% of all students have 0-1 office discipline referrals (ODR)
      2. 5-15% of all students have 2-5 ODR
      3. 1-5% of students have 6 or more ODR, and
      4. Suspension rates in the following ranges
        • Elementary Schools: 3.5% or fewer of students have received an out-of-school suspension.
        • Middle/Junior and High School: 6% or fewer students have received an out-of-school suspension.
          • Illinois Senate Bill 100 prohibits publicly-funded Illinois schools, including charters, from using "zero tolerance" discipline policies, unless otherwise required by law.  A key goal of the measure is to "limit the number and duration of expulsions and suspensions to the greatest extent practicable". 

Q: When can I start calculating my behavioral outcomes and trend data for Recognition purposes?

A: Mid-April is our suggested time to begin calculating behavioral outcomes and trend data.

Q: When calculating ODR data, should our school consider majors, minors, or both?

A: Majors.


PBIS Assessments Questions

Q: Does my school still need to submit our BoQ, SAS, and/or TIC report scores for Recognition? Aren’t they required for Recognition?

A: No.

  • School teams are encouraged to take the assessments that they have historically taken and used for action planning-- BoQ, SAS, and/or TIC (or any other assessment through PBIS Apps).  These results are not “required” for MW PBIS Recognition.

  • If your school did complete any of these assessments, they can use those assessments as documentation for items within the TFI.