Last year, we introduced “Auditor” – a free tool that helps schools ensure the safety of their students by monitoring Gmail for messages that are indicative of bullying or self-harm. Today, we are emerging from closed Beta after an extended period with 20 customers in which we scanned 70,000 emails daily for indicators of cyberbullying and self-harm.
Already, Principals and IT Admins are finding Auditor to be a powerful asset to student safety. Tom Walker, Massac Unit School District #1, remarked, “The ability to detect bullying, self harm, or other potential destructive behavior is something we’ve never had before. One Saturday evening, I received an email from the Auditor Safety Bot. The email contained wording about a video being uploaded to YouTube with a suicidal line. Upon further inspection, the video was not uploaded by one of our students, but was from a popular YouTube channel that the student had subscribed to. However, the fact that the Auditor was able to detect it gives us another tool to have in the struggle against bullying and self harm. From a legal perspective, it makes perfect sense that a school district would want the Auditor on their side.”
How Auditor Came to Be
As Gmail became the chosen tool in thousands of schools across the world, we realized blocking these channels is no longer a productive solution. However, from conversations with our customers, we learned that these resources have opened up new avenues for students to vent negative emotions such as bullying and self-harm.
In general, we found that many schools did not have good solutions in place that address this issue due to the following:
- By its very definition, “web-filtering” does not apply to emails. A lot of schools that we’ve spoken to use Google’s default compliance options to flag emails that contain a predefined set of keywords. This can be prone to lots of False Positives (False Alarms) and False Negatives (Missed Alerts) and does not scale well in a large District where IT becomes the bottleneck in sorting through these flagged messages.
- Old school approaches to monitoring these channels involving human auditors are costly.
- The CIPA law is vague about the need to cover this vector – “The policy proposed must address.. security and safety of minors using chat rooms, email, instant messaging, or any other types of online communications.” However, the meaning of “safety” is left too vague.
Auditor’s Unique Benefits – COMING SOON
Automated sentiment inference approach: While existing tools rely heavily on keyword matching to detect inappropriate behavior (e.g. by looking for words like “suicide” or “ugly”), Auditor will use our tried and tested machine learning techniques. For example, consider the following post that was flagged by our algorithm: “slowly i’m realizing i don’t really have a purpose here say good-bye cause Fryday it’s all over <3” It should be clear to the reader that a keyword-based approach would not have worked in detecting this.
911 Emergency Response Notifications to Parents and Guidance Counselors: We will extend our existing Delegated Administration and Parent Reports functionality from our flagship web-filtering product to Auditor. In the context of Auditor, these services will become 911 Emergency Response notifications to both guidance counselors and parents. Parents, principals and guidance counselors will receive an alert whenever our Auditor detects disturbing emails sent or received.
It’s free? What’s the catch?
No catch! Keeping Auditor free –forever – is our commitment to the pursuit of student safety. Given the lack of any compliance requirement, and cash-strapped schools already reluctant to spend on paid solutions, we felt it necessary to introduce a free tool to address this serious issue.
As with any other company that is trying to build a sustainable business, we need to charge a fee for our services and grow our revenues year over year. However, while achieving this somewhat “practical” goal, we aspire to make a dent in the universe. In our mind, that “dent” has always been (and likely always will be) ubiquitous child safety – both at school and at home.
For more updates and product releases, subscribe to our newsletter: