Introduction
The First Study
used trained observers to compare the behavior of 21 students (grades 3-8) before and after the use of Revibe, in order to analyze the efficacy of vibration reminders to improve on-task behavior. (Fall 2015)
The Second Study
was funded in part by the U.S. Department of Education and conducted by a third-party research group with 50 students (grades 3-5) in a mock classroom laboratory, and 29 students in real classrooms during school hours in order to explore efficacy in a real-world setting. (Summer 2017)
All data has been de-identified to protect the privacy of our customers and study participants, as well as the security of our data. Results may vary across users, settings, etc...and do not imply or suggest any performance claims about Revibe. Revibe is not intended to diagnose, treat, cure, or prevent any disease.
We would like to thank the following individuals and organizations for their participation and funding of this research:
-
- United States Department of Education
- Dr. Cynthia Pritchard and BioTechnology Transfer
- Innovation Fund North Carolina
- NC IDEA
- Wake County Public Schools
- Franklin Academy
- Multi-Health Systems (MHS)
- Dr. Melissa De Rosier, Jim Thomas and 3C Institute for Social Development
Study 1
A three-month pilot study was conducted in order to: a) provide data on the changes in on-task behavior with Revibe, b) measure to what extent (if any) habituation occurred while using Revibe, and c) observe any adverse effects of Revibe (increased distraction, annoyance to the wearer or their classmates, skin irritation, etc.)
The study was conducted at two sites (a charter elementary and charter middle school in North Carolina). There were 21 children (17 boys and 4 girls) in grades 3-8 who participated. All students were evaluated at the beginning of the study to establish a baseline for their on-task behavior. Nine of the 21 students displayed on-task behavior for a majority (more than 90%) of the time and were therefore excluded from most of the analyses since their level of on-task behavior was already deemed as proficient. It was noted that the use of Revibe for children who did not need it did not produce any significant negative or deleterious effects in on-task behavior. The 12 evaluable test subjects who had demonstrated difficulty staying on task during the initial baseline remained. While Revibe is not intended to diagnose, treat, cure or prevent any disease, it was noted that prior to the study, six of the 12 students had been diagnosed with ADHD or Autism Spectrum Disorder.
Students were observed by third party research assistants (Ph.D students from School Psychology programs at the University of North Carolina at Chapel Hill and North Carolina State University, as well as practicing psychologists) in a 1:1 fashion in their normal classroom settings. Observation was limited to Core Classes (e.g., Math, English, Science and Social Studies). Each student was observed in only one classroom, at the same time of day, by the same observer. Research assistants used a specialized behavioral tracking software to record children as "on-task" (i.e., engaged in expected classroom behaviors, such as listening to a lesson or completing work) or "off-task" (i.e., looking about the classroom, staring at the floor, daydreaming, etc.) every 30 seconds during 30-minute observation sessions (an initial session, and 2-4 follow-up observations in the weeks after).
All data was sent directly to a third-party contract research organization (BioTechnology Transfer, LLC) for scoring and analysis. The study was cleared by the Heartland Institutional Review Board, an independent, third-party board that operates in accordance with human subject research standards established by the National Institute of Health (NIH).
Results for Students
-
- Among students with self-regulation deficits, the average increase in on-task behavior was 19%
- Among responders, the average improvement over baseline was 38%
- 100% of improvements in on-task behavior were immediate and sustained for up to three months.
- There were no signs of habituation, nor any adverse effects reported
- Among students with self-regulation deficits, the average increase in on-task behavior was 19%
- 100% of teachers felt Revibe was a quiet intervention tool that did not distract anyone in the classroom
- 89% of students said they noticed a positive difference in the time they spent on-task while wearing Revibe
- Over 80% of teachers and students who used Revibe would recommend it to others
Study 2
Part 1: Market Research
Overview
Once the prototype of the self-monitoring wristband device was developed, a student test group with 50 3rd-5th grade students was recruited to achieve the following goals: a) to ensure the device functions as intended, b) gather simultaneous behavioral observations and wristband sensor data to establish algorithms for intelligent modulation of tactile prompts, and c) gather input from students to guide the selection of the type and content of gamified rewards, finalize design specifications for the wristband, and gauge overall perception. We collected behavioral observations and sensor data during four different academic and play activities, which were then used to establish initial algorithms for intelligent modulation of tactile prompt schedules. We also gathered student feedback via pencil-and-paper ratings and qualitative discussion groups to finalize wristband specifications, establish the design and game mechanics for the online gamified rewards systems for students, and measure overall perceptions of the product.
To participate, students had to a) be in 3rd-5th grade (7-11 years old), b) experience significant deficits in self-regulation (defined as a score of at or above 5 of the Activity Level subscale, at or below 3 on the Attentional Focusing subscale, at or above 5 on the Impulsivity subscale, or at or below 3 on the Inhibitory Control subscale of the parent-report Child-Behavior Questionnaire-Short Form; CBQ-S), c) attend a regular education classroom for at least 40% of the school day, d) be English language proficient, and e) have parent permission to participate.
Student Feedback
Overall, students were very positive about the usability of the self-monitoring wristband device. Representative comments about the prototype included:
- "It helps me learn."
- "It helped me focus more."
- "It looks cool."
- "It's a really cool thing."
- "It's the best."
- "I like everything about it."
- "It is the perfect size."
- "It's very comfortable."
- "Overall, it's awesome."
- "It looks futuristic."
Students commented that they would be motivated to wear the wristband while at school and at home. Representative reasons for why included:
- "To remind me when I'm off-task."
- "Because it will help me pay attention."
- "It is nice and cool."
- "It could help me get my work done quicker."
- "To help me stay on-task."
- "I get off-task and forget about homework."
Part 2: Classroom Observation Study
Overview
In order to participate, teachers needed to teach students in grades 1-5 and commit to using Revibe with at least one student for a period of two weeks. Of the eligible and selected participants, 26 teachers participated (Mage = 36 years; 25 female; 88.5% Caucasian, 3.8% African American, and 7.7% declined to report race/ethnicity; 1-16+ years of experience, with the average participant reporting approximately 10 years of experience). After consenting to participate, four teachers withdrew from the study (two reported personal events that prevented them from having the time to participate and two were unable to receive parent consent). Teachers were asked to identify at least one student to participate in the study with them. To participate, students needed to be enrolled at a participating school, in grades 1-5, and have parental permission to participate. 29 students participated (Mage = 9 years; 23 boys; two 1st graders; eight 3rd graders; six 4th graders; thirteen 5th graders; 56.7% had a parent-reported ADHD diagnosis; 46.7% on medication; 56.7% Caucasian, 23.3% African American, 10% more than one race, 3.3% American Indian or Alaska Native, and 3.3% declined to report race/ethnicity). To ensure that responses were not reflective of practices and policies of one school or type of school, five different schools in NC participated (two charter, two public, one alternative educational program).
During the trial, students received personalized prompts over the course of their school day and self-recorded on-task vs. off-task behavior by tapping the device screen (2x or 1x, respectively). The software tracked the timing and number of prompts, self-recorded data, and activity sensor data. At the end of the trial, students provided qualitative comments and quantitative ratings on a Likert-scale in the following areas: a) comfort, b) attractive, c) distracting, d) stigmatizing to wear, e) ease of use, f) clarity of prompts, g) value for self-monitoring, h) useful for helping stay on task, i) would want to continue to use in school, and j) would want to use for homework at home.
Before and after the trial, teachers rated their students’ Activity Level, Attentional Focusing, Impulsivity, and Inhibitory Control using the teacher version of the Child Behavior Questionnaire-short form (CBQ-S). Additionally, at the end of the trial, teachers rated each component of the Revibe as well as the overall product on a Likert-scale in the following areas: a) quality, b) value, c) feasibility, and d) utility. Teachers also rated the degree to which they would recommend Revibe to other educators and would want to use the product themselves following Phase II full development and testing.
Results
A statistically significant change in Attentional Functioning was reported by teachers on the CBQ-S, t (18) = 2.218, p =.047.
Feedback From Students
Statement |
Average Score |
The wristband helped me stay on-task more often. |
4.31 |
The wristband helped me pay attention in class. |
4.15 |
I would want to continue wearing the wristband at school even though the research study is over. |
4.15 |
Feedback From Teachers
Rating Scale (1-5): 1 = Never, 2 = Rarely, 3 = Occasionally, 4 = Frequently, 5 = Very Frequently
Statement |
Average Score |
Revibe Connect will be useful in the classroom setting |
4.23 |
If developed fully, Revibe Connect will be a useful tool in supporting students self-monitor their on-/off-task behavior. |
4.45 |
Revibe Connect is an innovative way to help student self-monitor their on-/off-task behavior. |
4.41 |
If fully developed, I would use Revibe Connect in my classroom. |
4.32 |
I think my students’ parents would find Revibe Connect helpful. |
4.14 |
I would recommend Revibe Connect to other educators. |
4.18 |
I think my school should use Revibe Connect. |
4.23 |
Revibe Connect would be valuable to schools for data collection and progress monitoring in areas of focus/academic engaged time. |
4.41 |
Conclusion
In summation of our research to date, while Revibe may not be a tool for everyone, it did appear to help many students improve on-task behavior in these discrete studies:
- The initial pilot study of vibration technology saw immediate and sustained improvements in on-task behavior among responders. Over 80% of students and teachers who used Revibe in this study would recommend it to others.
- In the U.S. Department of Education-funded study, there were statistically significant increases in attentional focusing for the duration of the trial period. Overall, the qualitative and quantitative data collected confirmed students and teachers were very positive about the usability and effectiveness of Revibe.
Please remember, Revibe is not intended to diagnose, treat, cure or prevent any disease. Each child’s case should be handled individually to accommodate their particular needs.
Revibe™ Vibration Reminder Watches are manufactured by Revibe Technologies, Inc.
For any questions, or for more information including special offers for schools, please email support@revibetech.com.