Watch: AI Content Detection
DEJAN-LM is an AI content detection model trained on 20 million sentences, using a combined deep learning and heuristic approach to identify advanced AI text.
Transcript
AI models are getting so advanced that standard detection tools can no longer keep up. Text from the latest systems easily fools them. To tackle this, we brought AI detection in-house.
We started with our own base model, DEJAN-LM, which is an expert in web articles. We pre-trained it on ten million sentences from top-quality websites, and then fine-tuned it on a twenty-million sentence dataset split evenly between human and AI-generated content.
But even with this advanced setup, the newest OpenAI models managed to fly under the radar. Our deep-learning model struggled to detect content from the elusive GPT-o-four-mini.
To solve this, we went old school. We analyzed our twenty-million sentence dataset to identify and weigh the top one thousand words for both human and AI writing. By combining this simple vocabulary heuristic with our deep-learning model, we saw a massive breakthrough.
The detection confidence for that elusive new GPT model jumped from just around twenty-one percent to over sixty-eight percent. By merging modern deep learning with classic heuristics, we can confidently flag AI-generated content once again.