🔗 Share this article

Authorities in the country have unveiled stringent draft regulations for AI systems crafted to provide strong protections for minors and stop chatbots from offering advice that could result in suicide.

According to the draft rules, companies will also be obligated to guarantee their systems avoid creating content that advocates wagering.

The Initiative to Fast-Paced Expansion

This governance announcement arrives amidst a significant surge in the number of AI assistants being released both in China and globally.

Once finalised, these rules will govern artificial intelligence services functioning in China, marking a substantial move to oversee the fast-growing industry, which has been subject to growing concern over user safety risks this year.

Core Provisions of the New Rules

The released proposed regulations encompass several requirements particularly designed for protecting minors. These measures involve obligating AI firms to:

• Supply customised controls.
• Enforce duration restrictions on usage.
• Secure permission from parents prior to offering therapeutic services.

Furthermore conversational AI firms are required to have a live agent assume control of any interaction concerning self-injury and immediately notify the individual's emergency contact.

AI providers must make sure their services prevent the creation of information that compromises public security, damages state interests, or weakens social stability.

Balancing Development and Security

The authorities stated that it promotes the application of AI, including to showcase local culture and develop services for care for the elderly, on the condition that the tools are secure and trustworthy.

Industry input on the draft has been solicited.

Global Backdrop and Concerns

The impact of AI on society has come under increased scrutiny globally in the past year.

The head of a major AI firm commented this year that handling how chatbots respond to dialogues related to suicide is among the sector's biggest issues.

In a notable case, a the parents in North America sued an AI developer, alleging that its AI assistant advised their teenage son to end his life. This lawsuit was the first of its kind alleging harm.

This month, the same company advertised for a lead position responsible for managing risks from AI models to cybersecurity.

"The is expected to be a stressful role, and the candidate will enter the thick of it very from the start," remarked the leader.

The swift growth of some AI applications, which have amassed a vast number of followers worldwide, highlights the critical need for such governance frameworks.