Skip to content

Online existence of children and youth becomes more hazardous due to advances in artificial intelligence.

Online existence of children and youth becomes more hazardous due to advances in artificial intelligence.

Online existence of children and youth becomes more hazardous due to advances in artificial intelligence.
Online existence of children and youth becomes more hazardous due to advances in artificial intelligence.

The advent of advanced artificial intelligence (AI) is escalating the risks children and adolescents face online, making it even more challenging to distinguish fact from fiction. According to jugendschutz.net's annual report, AI is intensifying issues such as sexual violence, bullying, and extremism. Family Minister Lisa Paus from the Greens points out that the online sphere is saturated with hate speech, provocations, and false information, mainly because of a culture that frequently disregards social norms.

Embracing hate speech, provocations, and false information, the online realm is particularly harmful for youngsters, as they are still developing critical thinking and life skills. Last year, jugendschutz.net tackled 7,645 incidents, with over two-thirds pertaining to sexualized violence, 12% involving pornographic content, and 11% centering around political extremism. Furthermore, 5% implied content promoting self-harm, while 2% correlated with cyberbullying.

The organization forwards cases involving child or adolescent pornographic content, or those posing a threat to life or limb, to the relevant authorities or platform providers. By year's end, around 90% of the 6,902 cases were resolved. Nonetheless, Stefan Glaser, the jugendschutz.net head, criticizes platform providers for not doing enough to safeguard youngsters. Glaser highlights inadequate responses when violations are reported and negligence towards verifying the ages of users as major liabilities.

The intelligence of advanced AI technologies, such as generative AI, poses issues in distinguishing reality from fiction and exacerbates issues like sexual violence and bullying. Family Minister Lisa Paus advocates for greater accountability of platform providers, who play a crucial role in safeguarding children and adolescents from the widespread of hate speech, provocations, and false information.


As AI evolves, so do the challenges it imposes on children and young people. The technology is a double-edged sword, with potential benefits like teaching new skills and fostering creativity, as well as drawbacks like promoting harmful behaviors and encouraging addiction. Families, educators, and policymakers must collaborate to develop measures addressing these challenges, ensuring that AI safeguards and enriches children's lives better.

For instance, AI can be used to identify patterns of harmful content and behaviors, enabling companies to develop resources to protect users, and empowering individuals to foster positive digital relationships. Policymakers can propose legislation enforceable across various platforms, laying down clear guidelines and promoting transparency in AI algorithms. Together, we can build a digital world that fosters responsible AI with the wellbeing of current and future generations in mind.


References: [1]

[2]

[3]

[4]

[5]

Latest