The digital landscape is turning into a more perilous place for youngsters due to advancements in artificial intelligence (AI). According to jugendschutz.net's annual report, a collaborative effort from various federal and state governments, AI is amplifying the challenges that kids and teenagers face online. The report highlights, "At present, generative AI is blurring the lines between fact and fiction," leading to a rise in issues like sexual misconduct, bullying, and extremism.
Family Minister Lisa Paus from the Greens emphasizes that the online sphere is brimming with hate speech, provocations, and false information. She primarily accuses platform providers of not doing enough to protect children and teenagers. Last year, jugendschutz.net handled 7,645 incidents, with more than two-thirds of them revolving around sexual violence, while 12% involved sexual or pornographic content.
The organization tackles violations related to child or adolescent pornographic content, or those posing a threat to life or limb, by forwarding them to relevant authorities or platform providers. By the end of the year, around 90% of the 6,902 cases were resolved. However, Stefan Glaser, head of jugendschutz.net, criticized that online service providers are not doing enough to safeguard children and teenagers.
The intelligence of advanced AI technologies, such as generative AI, makes it difficult to distinguish fact from fiction, exacerbating online issues like sexual misconduct, bullying, and hate speech. Family Minister Lisa Paus advocates for increased accountability of platform providers, as they have a significant role in safeguarding children and teenagers from such prevalent issues.
AI has the potential to both mitigate and worsen online threats towards children and youth, depending on how it is used. For instance, AI can be utilized for enhanced content detection and prevention, educational tools to promote online safety, and awareness. However, some AI tools can also lead to the creation of harmful content, addiction, and overuse, which can negatively impact their development and well-being.
To address these challenges, governments, tech companies, and child protection organizations can collaborate on regulatory measures, technological solutions, educational initiatives, and international cooperation. These efforts can help establish a safer digital environment for children and youth.
