Non-native speakers' writing was often misclassified as AI generated, Professor Zou said, because they did not use as many 'fancy' words. 'If there are a lot of complicated words, then they'll have high perplexity,' he said. Professor Zou said many of the current AI detection algorithms had an over-reliance on a 'perplexity' metric, a measure of complicated words being used in the text. Report co-author James Zou, an assistant professor of biomedical data science at Stanford University, said he would not trust AI detectors right now because the research showed they could be easily fooled and made too many mistakes. Some have started using the tools that detect AI-generated text as one way to pick up assignments possibly written by machines.īut AI experts say the technology can be inaccurate, and some argue the detectors should not yet be used to monitor student assessments. The rapid advent of generative AI programs such as ChatGPT, which are able to produce material such as university essays that some students have been able to pass off as their own work, has universities scrambling to respond. She is one of a number of international students in Australia who have posted on Chinese social media about concerns tools to detect AI-generated text are unreliable and might lead them to be falsely accused of cheating. 'I know other students who were found to have committed misconduct,' said Ms Li, who spoke to the ABC on the condition she was able to use a pseudonym.

Ms Li used the detector because her university has started employing similar tools to flag students who might be cheating by using text-generating AI programs. 'It is my own work but says it's AI generated,' she told the ABC.

Illustrator foreign text shortcuts