New survey data shows that nearly one in five high school seniors say they or someone they know has been romantically involved with an artificial intelligence. And 42% of students surveyed say they or someone they know has used AI to communicate.
This is according to new research from the Center for Democracy and Technology (CDT), a nonprofit organization that advocates for civil rights, civil liberties, and the responsible use of data and technology.
CDT conducted national surveys of approximately 800 public school teachers in grades six through 12, 1,000 students in grades nine through 12, and 1,000 parents. The vast majority—86% of students, 85% of teachers, and 75% of parents—say they have used AI during the last school year.
CDT's Elizabeth Laird, one of the report's authors, says the surveys showed some strong correlations.
Among them: “The more ways a student reports that their school uses AI, the more likely they are to report things like “I know someone who considers an AI their friend,” “I know someone who considers an AI their romantic partner.”
Data leaks, deepfakes and broken trust
Laird says surveys have shown that higher levels of AI use in schools (defined as seven to ten instances of AI being used in school for teachers and four to six for students) correlates with increased exposure to data breaches, troubling interactions between students and AI, and AI-generated deepfakes or manipulated videos or photos that could be used for sexual harassment and abuse. intimidation of students.
“This technology is a new vector for sexual harassment and bullying, which have been long-standing problems. [before widespread use of AI]“,” says Laird, “and this became a new way to make things worse.”
According to the report, 28% of teachers who use AI for many school-related tasks say their school has experienced a large-scale data breach, compared to 18% of teachers who do not use AI or only use it for a few tasks.
Laird, who previously worked as a data privacy specialist for the District of Columbia's state education agency, says she believes the more data schools feed AI systems, the more they risk data breaches.
“AI systems take in a lot of data, but they also output a lot of information,” she says. “It promotes that connection.”
Teachers with higher levels of AI use in school were also more likely to report that the AI system they used in the classroom did not work properly.
These teachers were also more likely to report that the use of AI has undermined public trust in schools. For example, Laird says schools often use artificial intelligence software to monitor activity on school devices, which in some cases leads to false positives and even student arrests. She says this is especially concerning for students who can't afford their own personal computers.
“So if you have a personal device and don't have to use a school-issued device, you can essentially afford to keep your documents and communications private,” Laird says.
Risks to student well-being
Students who attend schools where AI is used frequently were also more likely to report that they or their friends used AI for mental health support, as a companion, as a way to escape reality, and to engage in romantic relationships.
When students reported talking to AI systems for personal reasons rather than for school work, 31% said they used devices or software provided by their school.
“I think students need to know that they are not really talking to a person. They talk to a tool, and those tools have known limitations,” Laird says. “Our research shows that the AI literacy and training that students receive is very basic.”
Laird says students and teachers often don't receive training or guidance to help them deal with the more complex problems associated with the technology.
For example, only 11% of teachers surveyed said they had received training on how to respond if they suspected students' use of AI was harming their well-being.
Teachers who frequently use AI were more likely to say that the technology improves their teaching, saves time and provides personalized learning for students, but students in schools where AI is widely used report higher levels of anxiety about the technology, including that it makes them feel less connected to their teachers.
“What we're hearing from students is that while there are benefits, there are also some negative consequences,” Laird says. “And if we're going to realize the benefits of AI, you know, we really need to pay attention to what students are telling us.”
