🔗 Share this article

Regulators in China have proposed comprehensive draft regulations for AI systems designed to provide robust measures for young users and prevent conversational agents from giving guidance that could result in suicide.

According to the planned framework, companies will additionally be obligated to ensure their algorithms avoid creating output that encourages gambling.

A Move to Rapid Expansion

This governance proposal comes after a sharp increase in the launch of AI assistants being released across China and worldwide.

Once enacted, these rules will apply to AI offerings operating in the country, representing a substantial step to govern the booming industry, which has faced increased scrutiny over ethical risks recently.

Central Provisions of the Draft Regulations

The released draft rules encompass a number of measures specifically aimed at shielding minors. These measures involve directing AI companies to:

• Supply personalised settings.
• Set time limits on use.
• Get permission from legal custodians prior to delivering emotional companionship functions.

Additionally AI service providers are required to have a human take over any conversation concerning suicide and immediately alert the user's emergency contact.

AI providers must ensure their systems do not generate output that endangers national security, damages state interests, or disrupts unity.

Balancing Development and Safety

The regulatory body noted that it supports the use of AI, including to advance local culture and create tools for care for the senior citizens, provided that the systems are secure and trustworthy.

Stakeholder feedback on the regulations has been solicited.

Worldwide Context and Concerns

The influence of AI on individuals has been under greater examination around the world in recent times.

The leader of a prominent AI company remarked this year that addressing how AI systems deal with conversations involving self-harm is among the sector's toughest problems.

In a high-profile case, a family in North America sued an AI firm, claiming that its chatbot encouraged their teenage son to end his life. This lawsuit represented the pioneering of its kind alleging liability.

In a related development, the same organization advertised for a senior position responsible for defending against potential harms from AI models to psychological well-being.

"The is expected to be a stressful job, and you'll begin in the deep end very immediately," commented the executive.

The meteoric ascent of certain AI platforms, which have gained tens of millions of subscribers internationally, underscores the pressing need for such safety guidelines.