Recognition
   
Criteria
   
What Level Should We Apply For
   
Recognition Webinars
   
https://www.surveymonkey.com/r/recognition1819



Contents

  1. 1 General Questions
    1. 1.1 Q: When does the online Recognition Application & our TFI need to be submitted?
    2. 1.2 Q: Is there an Early Bird incentive?
    3. 1.3 Q: Our school missed the due date for Recognition. Can we still apply?
    4. 1.4 Q: In what situation does my school need to “apply” for Recognition?
    5. 1.5 Q: Where is the online Recognition Application?
    6. 1.6 Q: Before I begin the online Application, can I see the questions I will be asked?
    7. 1.7 Q: How much time will it take me to fill out the online Recognition application?
    8. 1.8 Q: Can I begin an application, exit the application, and come back to it to complete it later on?
    9. 1.9 Q: How will I know that my school's application has been submitted successfully?
    10. 1.10 Q: When will Recognized Schools be posted to the Midwest PBIS Website?
    11. 1.11 Q: Is there a required cover letter or other paperwork that needs to be completed?
    12. 1.12 Q: Why do we have to meet only behavioral outcomes for Gold, but demonstrate behavioral and academic outcomes for Platinum?
    13. 1.13 Q: Can early childhood centers, juvenile justice facilities or alternative settings apply/be considered for Recognition?
    14. 1.14 Q: Is there a separate process for Gold or Platinum levels of Recognition?
    15. 1.15 Q: What if our school doesn't fully meet a requirement, but we believe our outcomes warrant receiving a higher level of recognition? Where can we explain further?
    16. 1.16 Q: What if our school applies for a certain level of Recognition, but we end up not meeting the requirements. Will we be Recognized at a lower level where we do meet requirements?
  2. 2 Tiered Fidelity Inventory Questions
    1. 2.1 Q: How do we access the TFI online?
    2. 2.2 Q: What is considered fidelity at each tier of the TFI?
    3. 2.3 Q: For Recognition purposes, does my school need to fill out the TFI at all three Tiers?
    4. 2.4 Q: My school does not have SWIS. Do we need to be SWIS users to obtain access to the TFI online?
    5. 2.5 Q: Can we submit our hard copy of the TFI or Recognition documents to the Midwest PBIS office? Can the Midwest team just enter it online for us?
    6. 2.6 Q: How does my school know their scores at each Tier on the Inventory? (These scores, in turn, help identify if we meet qualifications to then apply for Gold or Platinum level).
    7. 2.7 Q: We completed more than one TFI this year, which scores do we enter into the Recognition Application?
    8. 2.8 Q: Is Recognition based on the “Total Score” of our Inventory results?
    9. 2.9 Q: Do I need to print a Report of my TFI scores and send them into the Midwest PBIS Office in order to be Recognized?
    10. 2.10 Q: My team did not use the TFI Walkthrough tool, or similar surveying format, to complete Tier I scale. Can we get full points for those items (1.3, 1.4 and 1.9)?
    11. 2.11 Q: At the end of the TFI there are optional questions. Are these required for all teams, and how do they connect to Recognition?
  3. 3 Academic Trend Data Questions
    1. 3.1 Q: For Platinum level applicants, what “evidence of sustaining and/or improving academic trends” is acceptable?
    2. 3.2 Q: What if our school has not seen positive Academic trends between any set of years? Where can I further explain?
    3. 3.3 Q: For Platinum level applications, what type of time frame is needed when providing three years or more of academic trend data?
    4. 3.4 Q: Why do we need to show trends, or multiple years of improvements?  Why not just a “cut off” percentage of achievement?
  4. 4 Behavioral Outcome Data Questions
    1. 4.1 Q: What tools can I use to track our school's Tier II/Tier III outcome data?
    2. 4.2 Q: Does our school need to email our Tier II/Tier III tracking tool to the MW PBIS team?
    3. 4.3 Q: If our district/school does not use SWIS, how can or should we report their ODR data?
    4. 4.4 Q: Why do we have to report only behavioral outcomes for Gold, but both behavioral and academic outcomes for Platinum?
    5. 4.5 Q: What is expected multi-tiered behavioral outcome data that demonstrates effectiveness of PBIS across all three tiers?
    6. 4.6 Q: When can I start calculating my behavioral outcomes and trend data for Recognition purposes?
    7. 4.7 Q: When calculating ODR data, should our school consider majors, minors, or both?
    8. 4.8 Q: How do we calculate the Out of School Suspension (OSS) Rate?
  5. 5 PBIS Assessments Questions
    1. 5.1 Q: Does my school still need to submit our BoQ, SAS, and/or TIC report scores for Recognition? Aren’t they required for Recognition?


General Questions

Q: When does the online Recognition Application & our TFI need to be submitted?

A: Tuesday, April 30th 2019

NOTE: If your school submits both the online Recognition Application, and the TFI in PBIS Assessment by April 30th, your school will be entered into a raffle for 1 free registration to the Summer Training Institute (July 16 - 18 @ NIU Naperville). 5 school winners total!


Q: Is there an Early Bird incentive?

A: Yes.
  • If your school submits their Online Recognition Application, and their TFI online in PBIS Assessment by Monday, April 1st 2019, your school will be entered into an Early Bird raffle for 1 free registration to the Spring Training Institute (April 23 -25 @ NIU Naperville). 5 school winners total!
  • Your school will ALSO be entered in the Due Date Raffle (info above) for the Summer Training Institute (Jul 16-18 @ NIU Naperville). 5 school winners total!
  • Apply by April 1st, for TWICE the opportunity to attend our Institutes, for free!

Q: Our school missed the due date for Recognition. Can we still apply?

A: Yes. Apply online. Applications received by April 30th will be reviewed by early June, 2019. Late submissions will be reviewed by September 1st. All Recognized Schools will be sent congratulatory emails once their application is reviewed, and posted to the Recognized Schools list on our website.

 

Q: In what situation does my school need to “apply” for Recognition?

A: All schools can decide to apply for recognition, and it is as simple as completing the TFI online and completing an online Recognition Application.


Q: Where is the online Recognition Application?

A: 2018-19 :https://www.surveymonkey.com/r/recognition1819 View this short video before you begin! 
  • Though this video was recorded using SY1718 application and shows last year's dates & images-- all criteria & process is the same for SY1819. 

Q: Before I begin the online Application, can I see the questions I will be asked?

A: Yes. You can download this Microsoft Word document to see all questions included in the online application, and record your online replies for your own record keeping.


Q: How much time will it take me to fill out the online Recognition application?

A: Our best estimates are as follows:
  • Bronze or Silver: 5-10 minutes
  • Gold: 15-30 minutes
  • Platinum: 30-60 minutes

Q: Can I begin an application, exit the application, and come back to it to complete it later on?

A: No. The application must be completed in one sitting. You cannot go back into your application later on.

Q: How will I know that my school's application has been submitted successfully?

A: After you have completed the online application, you will see the following:

Q: When will Recognized Schools be posted to the Midwest PBIS Website?

A: By early June 2019. Late applications will be posted once they are reviewed by MW PBIS Staff, possibly after June 2019.


Q: Is there a required cover letter or other paperwork that needs to be completed?

A: No. The Recognition Process is intended to be as easy as possible, and focus school teams on the desired student outcomes. We hope the documents and data reported as part of the Recognition Application are a routine part of team action planning.


Q: Why do we have to meet only behavioral outcomes for Gold, but demonstrate behavioral and academic outcomes for Platinum?

A: The conceptual framework for PBIS is based on improving behaviors to increase academic instructional time and engagement. As school teams implement with higher rates of fidelity we anticipate that (1) student behaviors will improve, (2) instructional time will be “gained”, leading to (3) improvement in academic outcomes.


Q: Can early childhood centers, juvenile justice facilities or alternative settings apply/be considered for Recognition?

A: Yes, if the center or facility has taken the TFI for the 2018-19 school year, and completed the online Recognition Application by April 30, 2019.


Q: Is there a separate process for Gold or Platinum levels of Recognition?

A: No. All teams applying for Recognition follow the same online process, regardless of scores on the TFI subscales.

Q: What if our school doesn't fully meet a requirement, but we believe our outcomes warrant receiving a higher level of recognition? Where can we explain further?

A: At the end of the Application, you will enter a section named "Additional Information". It will say at the top "You are nearing the end of the 2018-19 Recognition Application!". In that section, you can explain further. Please be sure to include data in your explanation. Be sure to include how a solution fits into your action plan for next school year.

Q: What if our school applies for a certain level of Recognition, but we end up not meeting the requirements. Will we be Recognized at a lower level where we do meet requirements?

A: Yes. The school would then be recognized at the level they meet requirements for. (Example: applies for Gold, but doesn't meet Gold requirements; if meets Silver requirements, will be Recognized at Silver level.)


Tiered Fidelity Inventory Questions

ALL SCHOOLS wishing to be recognized for their PBIS efforts in 2018-19 will first need to complete the School-wide PBIS Tiered Fidelity Inventory (TFI) online and then complete the online Recognition Application by April 30, 2019.


Q: How do we access the TFI online?

A: The TFI is available at no cost on PBIS Assessments . Login to www.pbisapps.org with your user name and password, and click on PBISAssessments.  Look under "Open Survey Windows" for the "School-wide PBIS Tiered Fidelity Inventory 2.10". View this video for assistance.

  • Select “Forgot my Password” option to reset your password if you do not remember it. 
  • If you need a PBIS Assessments account or need your TFI survey opened, and do not have a local PBIS Assessments Coordinator, email eval@midwestpbis.org with your First & Last Name, email address, school name & district name/number.

Q: What is considered fidelity at each tier of the TFI?

A: Fidelity @ Tier I = 70%+, Fidelity @ Tier II = 80%+, Fidelity @ Tier III = 80%+



Q: For Recognition purposes, does my school need to fill out the TFI at all three Tiers?

A: First, consider the best practices for taking the TFI throughout the school year, as explained in the TFI Guide on PBIS Assessment. Then, consider which level of Recognition your school will be applying for, and review the Recognition criteria for that level, paying close attention to the TFI requirements. Each level of Recognition has TFI requirements, and you want to be sure to carefully score the TFI Tiers that you know will need to report on your Recognition application.

Q: My school does not have SWIS. Do we need to be SWIS users to obtain access to the TFI online?

A: No. You do not need SWIS.


Q: Can we submit our hard copy of the TFI or Recognition documents to the Midwest PBIS office? Can the Midwest team just enter it online for us?

A: No. All responses to the TFI, and the Recognition Application, must be entered online in each system by a representative from that school/district by the due date.


Q: How does my school know their scores at each Tier on the Inventory? (These scores, in turn, help identify if we meet qualifications to then apply for Gold or Platinum level).

A:

  1. In PBIS Assessments, when viewing your organization, to the far right of the organization name is an option for Reports.

  2. Select Reports

  3. Once in Reports, select the options that enable you to report on each subscale. From the drop down menus:

  4. Under Select Survey, select SWPBIS TFI 2.1

  5. Under Select Report, select Scale

  6. Make sure the From range includes the current school year


Q: We completed more than one TFI this year, which scores do we enter into the Recognition Application?

A: Please report the most recent responses. If your team has completed the TFI more than one time this school year, graphs generated in PBIS Assessments will include the subscale scores from each completion, with the dates for each completion clearly indicated under the scores.


Q: Is Recognition based on the “Total Score” of our Inventory results?

A: No. It is based on your “Scale” scores (ie: what your school scored at Tier I, Tier II, and Tier III).


Q: Do I need to print a Report of my TFI scores and send them into the Midwest PBIS Office in order to be Recognized?

A: No. Please do not send us TFI Reports. Please enter the scores for each Tier into the Recognition Application online only.


Q: My team did not use the TFI Walkthrough tool, or similar surveying format, to complete Tier I scale. Can we get full points for those items (1.3, 1.4 and 1.9)?

A: The TFI is a self-assessment that is only useful if self-assessment is accurate and can be documented. The scoring rubric represents evidence-based guidelines for implementation in PBIS. Teams are much more likely to achieve valued students outcomes if they self-assess accurately, which includes documentation of implementation efforts.  The team and coach together should determine if other sources document they are meeting scoring rubric requirements for an item.

Q: At the end of the TFI there are optional questions. Are these required for all teams, and how do they connect to Recognition?

A: The optional questions, in PBIS Assessments, for the TFI are not required for recognition. They are part of a larger data collection process by the National PBIS Technical Assistance Center. The optional data questions allow your team to consider how effective Tiers I, II, and III are in your school. They are part of a larger data for decision-making process, and improvements in these numbers should always be the goal of the team.


Academic Trend Data Questions

Q: For Platinum level applicants, what “evidence of sustaining and/or improving academic trends” is acceptable?

A: The Platinum level of recognition requires a summary that indicates the school is sustaining and/or improving academic outcomes for three years or more

  • Please describe whole school trends, and also focus in on any groups within the school that have made gains in the past three years. Include data in your response summaries for each year, but only provide us with an actual data report if you are contacted and asked to do so.
  • Examples of these academic trend documents to reference for your summary may include, but are not limited to: DIBELS, Easy CBM, Aimsweb, PARCC, MAP testing results/reports, % of students passing all classes, % of students on track with credits (or proficiencies) to move to next grade level, or comparable data are acceptable evidence of trends in academic outcomes. Here are examples of reports that are acceptable to aid in describing your academic trends:

DIBELS example, “Cross-Year Box Plot Report:"


AIMSweb example, “Grade Level Report: Avg. Score by School Year:"


% of students passing all classes example:

- Export of school-wide data from edline, Infinite Campus, or other online grade programs


Here are examples of some academic trend descriptions that are acceptable :
1. Our school's overall reading scores have been trending upward for the past three years. Our Map triangles show that reading is definitely a strength, this is what the data shows: 72% of second graders are above the 25th percentile, 72% of third graders are above the 25th percentile, and 77%of fourth graders are above the 25th percentile. Looking at a three year trend of student growth data, in the spring of 2015, 20% of students met their growth projection for 2nd grade, in the spring of 2016, 21% of students met their growth projection for 2nd grade, and this past year in the spring of 2017, 22% of students for second grade met their growth projection.

2. In the last three years our bilingual kindergarten students have moved from 90% of our bilingual Kindergarten students performing at grade level on syllable reading fluency in the spring of 2015, to 93% in the spring of 2016, to 100% of our bilingual kindergarten students in 2017 performing at grade level. We will continue to focus on small group instruction (literacy and oral language) during the 2017-2018 to maintain student growth in this area.

3. Our AIMSWEB reading scores...consistently show improvements for a majority of students from fall to spring of each of the past three years. The percentage of 3rd, 4th and 5th grade students who are at or above expected target has been at least 75% by the spring of each year. Overall reading scores have been trending upward for the past three years. Our Terra Nova scores show that reading is an area of sustained or continued growth: 72 % of the current 3rd grade cohort are above the 70th percentile, 73% of the current 4th grade cohort are above the 70th Percentile, and 74% of the current 5th grade cohort are above the 70th percentile. A three year trend analysis of student data indicates a consistent pattern of growth from year to year. All cohorts at the 3rd, 4th and 5th grade levels demonstrated an average of 10% increase in their mean normal curve equivalent over the last 3 school years. Overall math scores have been trending upward for the past three years. Our Terra Nova scores show that math is an area of sustained or continued growth: 78 % of the current 3rd grade cohort are above the 70th percentile, 78% of the current 4th grade cohort are above the 70th Percentile, and 79% of the current 5th grade cohort are above the 70th percentile. A three year trend analysis of student data at the indicates a consistent pattern of growth. The 3rd and 4th cohorts demonstrated more than a 10% increase in their mean normal equivalent over the last 3 school years.


Q: What if our school has not seen positive Academic trends between any set of years? Where can I further explain?

A: After the Academic Trend section of the online application, you will enter a section of the application named "Additional Information". If for any reason your data does not match criteria, but you still believe your outcomes warrant receiving a higher level of recognition, you can provide an explanation with supporting information. Please be sure to include data in your explanation. Be sure to include how a solution fits into your action plan for next school year. Here is an example:

  • "Our reading scores for elementary schools declined between last year and this year, because we had an influx of students who were English language learners. As a result, our action plan for next year includes more ELL supports."

Q: For Platinum level applications, what type of time frame is needed when providing three years or more of academic trend data?

A: Three consecutive years. For your 2018-19 SY data, if your scoring will not be reported to you by April 30,2019, you can provide another time frame showing academic success-- as long as it captures three consecutive years (ie: December to December, Fall-to-Fall, etc.).


Q: Why do we need to show trends, or multiple years of improvements?  Why not just a “cut off” percentage of achievement?

A: All schools go through challenges to implementing PBIS. Schools that have the systems in place to sustain through those challenges may see student data go up and down from year to year, but maintain an overall trend of improvement. It is the long term trend toward improvement that is important, as this shows the integrity of implementation.


Behavioral Outcome Data Questions

Q: What tools can I use to track our school's Tier II/Tier III outcome data?

A: Schools can utilize the Midwest PBIS Tier 2/3 Tracking Tool or the Wisconsin Tier 2/3 Tracking Tool.

Q: Does our school need to email our Tier II/Tier III tracking tool to the MW PBIS team?

A: No. Please do not email us documents unless we reach out to you after the due date, and specifically ask for documents.

Q: If our district/school does not use SWIS, how can or should we report their ODR data?

A: Schools will report number of students who have 0-1 referral, 2-5 referrals, and 6 or more. For further help on obtaining these numbers using your raw data, visit the Evaluation page and look along the left menu for how to "Create a Triangle Data Report".

Q: Why do we have to report only behavioral outcomes for Gold, but both behavioral and academic outcomes for Platinum?

A: The conceptual framework for PBIS is based on improving behaviors to increase academic instructional time and engagement. As school teams implement with higher rates of fidelity we anticipate that (1) student behaviors will improve, (2) instructional time will be “gained”, leading to (3) improvement in academic outcomes.

Q: What is expected multi-tiered behavioral outcome data that demonstrates effectiveness of PBIS across all three tiers?

A: Teams will report the % of students receiving 0-1 ODRs, 2-5 ODRs and 6+ ODRS.  They can gather this information through the Triangle Report in SWIS, or other triangle reports (WI PBIS Triangle Tool, or Connecticut Triangle Tool) or from other behavioral data systems.


The expectation for Gold level of Recognition will be as follows:

      1. 80-90% of all students have 0-1 office discipline referrals (ODR)
      2. 5-15% of all students have 2-5 ODR
      3. 1-5% of students have 6 or more ODR, and
      4. Suspension rates in the following ranges
        • Elementary Schools: 2.51% or fewer of students have received an out-of-school suspension.
        • Middle/Junior and High School: 7.08% or fewer students have received an out-of-school suspension.
          • Illinois Senate Bill 100 prohibits publicly-funded Illinois schools, including charters, from using "zero tolerance" discipline policies, unless otherwise required by law.  A key goal of the measure is to "limit the number and duration of expulsions and suspensions to the greatest extent practicable". 
The expectation for Platinum level of Recognition will be as follows:
      1. 80-90% of all students have 0-1 office discipline referrals (ODR)
      2. 5-15% of all students have 2-5 ODR
      3. 1-5% of students have 6 or more ODR, and
      4. Suspension rates in the following ranges
        • Elementary Schools: 2.51% or fewer of students have received an out-of-school suspension.
        • Middle/Junior and High School: 7.08% or fewer students have received an out-of-school suspension.
          • Illinois Senate Bill 100 prohibits publicly-funded Illinois schools, including charters, from using "zero tolerance" discipline policies, unless otherwise required by law.  A key goal of the measure is to "limit the number and duration of expulsions and suspensions to the greatest extent practicable". 

Q: When can I start calculating my behavioral outcomes and trend data for Recognition purposes?

A: Mid-April is our suggested time to begin calculating behavioral outcomes and trend data.

Q: When calculating ODR data, should our school consider majors, minors, or both?

A: Majors. However, if you do not have access to majors and minors separately, and all ODRs are aggregated, you can indicate that in your online Recognition Application in question 9.

Q: How do we calculate the Out of School Suspension (OSS) Rate?

A: Take the # of students who have had OSS this year, and divide that by the total # of students in the school. Multiply that number (a decimal) by 100, to get your % (the rate).

 

PBIS Assessments Questions

Q: Does my school still need to submit our BoQ, SAS, and/or TIC report scores for Recognition? Aren’t they required for Recognition?

A: No.

  • School teams are encouraged to take the assessments that they have historically taken and used for action planning-- BoQ, SAS, and/or TIC (or any other assessment through PBIS Apps).  These results are not “required” for MW PBIS Recognition.

  • If your school did complete any of these assessments, they can use those assessments as documentation for items within the TFI.