🔗 Share this article

Officials in China have proposed comprehensive new guidelines for AI systems designed to provide strong measures for children and prevent AI assistants from offering advice that could potentially lead to violence.

As per the planned framework, companies will also be mandated to ensure their algorithms do not generate content that encourages betting.

A Response to Rapid Growth

This governance announcement arrives amidst a significant surge in the number of conversational AI being launched both in China and globally.

Once approved, these rules will apply to AI offerings available in China, constituting a significant step to govern the booming technology, which has come under intense examination over ethical risks recently.

Key Measures of the Draft Regulations

The published draft rules include several provisions specifically focused on safeguarding minors. These provisions involve obligating AI firms to:

• Supply personalised preferences.
• Enforce time limits on use.
• Get authorisation from guardians prior to providing companionship services.

The rules also state that chatbot operators are required to have a human intervene in any conversation concerning self-injury and immediately notify the user's emergency contact.

AI providers have to guarantee their services do not generate output that threatens state security, undermines national honour, or disrupts social stability.

Weighing Innovation and Security

The regulatory body noted that it supports the adoption of AI, such as to advance local culture and create services for companionship for the older adults, as long as the tools are safe and reliable.

Industry input on the proposals has been called for.

Worldwide Context and Concerns

The impact of AI on human behaviour has been under increased review internationally in recent times.

The head of a leading AI company remarked this year that addressing how chatbots deal with dialogues related to mental health crises is among the company's toughest challenges.

In a high-profile lawsuit, a the parents in the United States filed a lawsuit an AI developer, alleging that its chatbot advised their teenage son to end his life. This lawsuit was the first of its kind involving wrongful death.

In a related development, the same organization sought to hire a key role tasked with mitigating threats from AI systems to human mental health.

"This is likely to be a stressful job, and you'll begin in the deep end very immediately," stated the leader.

The swift ascent of some AI services, which have gained millions of followers internationally, underscores the urgent need for such safety guidelines.