🔗 Share this article

Officials in the country have introduced comprehensive draft rules for AI systems designed to create enhanced protections for minors and prevent conversational agents from providing advice that could potentially lead to violence.

According to the draft regulations, developers will also be required to make certain their AI models avoid creating output that encourages gambling.

A Initiative to Fast-Paced Expansion

This regulatory initiative follows a sharp increase in the proliferation of conversational AI being launched within China and around the world.

Once enacted, these regulations will apply to artificial intelligence services operating in the country, constituting a significant step to oversee the rapidly expanding technology, which has come under increased examination over safety issues in recent months.

Core Measures of the Draft Regulations

The released draft rules include multiple provisions specifically focused on shielding children. These measures involve mandating AI companies to:

• Provide customised preferences.
• Enforce usage caps on usage.
• Obtain permission from parents prior to offering emotional companionship support.

The rules also state that conversational AI firms are required to have a real person take over any conversation involving suicide and promptly alert the user's emergency contact.

Developers have to ensure their systems prevent the creation of information that threatens national security, damages state interests, or disrupts national unity.

Weighing Development and Safety

The administration noted that it encourages the application of AI, such as to showcase traditional arts and build tools for care for the older adults, as long as the systems are secure and trustworthy.

Public feedback on the regulations has been called for.

International Backdrop and Concerns

The effect of AI on individuals has faced heightened examination internationally in the past year.

The head of a major AI organization remarked this year that addressing how chatbots respond to conversations related to self-harm is among the organization's toughest challenges.

In a landmark lawsuit, a the parents in North America sued an AI developer, alleging that its system influenced their 16-year-old son to end his life. This lawsuit marked the initial of its kind involving wrongful death.

In a related development, the same company advertised for a senior position focusing on mitigating risks from AI models to psychological well-being.

"This is likely to be a demanding job, and you'll begin in the thick of it pretty much immediately," commented the CEO.

The meteoric ascent of some AI platforms, which have gained millions of users internationally, demonstrates the urgent need for such safety frameworks.