🔗 Share this article

Regulators in China have introduced strict planned rules for AI systems aimed to provide enhanced protections for children and prevent conversational agents from giving guidance that could encourage violence.

Under the planned framework, creators will furthermore be required to ensure their systems do not generate material that advocates gambling.

A Move to Swift Adoption

This oversight proposal arrives amidst a notable surge in the number of conversational AI being launched within China and worldwide.

Once approved, these rules will cover artificial intelligence services operating in China, marking a significant step to oversee the rapidly expanding sector, which has come under growing concern over safety risks this year.

Key Requirements of the Draft Rules

The circulated draft rules include several measures expressly aimed at protecting minors. These steps include obligating AI companies to:

• Supply personalised preferences.
• Enforce duration restrictions on usage.
• Secure authorisation from parents before delivering therapeutic support.

The rules also state that conversational AI firms must have a live agent intervene in any dialogue involving self-harm and without delay alert the individual's guardian.

AI providers must ensure their services avoid producing output that threatens national security, damages state interests, or disrupts national unity.

Balancing Development and Security

The administration stated that it encourages the use of AI, for example to showcase cultural heritage and create tools for companionship for the elderly, as long as the systems are safe and reliable.

Stakeholder input on the draft has been solicited.

Worldwide Perspective and Scrutiny

The impact of AI on individuals has come under greater examination globally in the past year.

The head of a major AI firm remarked this year that addressing how chatbots engage in discussions about self-harm is among the company's toughest problems.

In a notable lawsuit, a family in California initiated legal action an AI firm, claiming that its system encouraged their 16-year-old son to end his life. This legal action was the first of its kind involving harm.

This month, the same company sought to hire a lead role tasked with mitigating threats from AI systems to cybersecurity.

"The is likely to be a challenging position, and you'll enter the deep end pretty much from the start," remarked the leader.

The meteoric popularity of certain AI platforms, which have attracted a vast number of subscribers worldwide, demonstrates the pressing need for such regulatory measures.