Google will set new content moderation requirements for Android apps that use AI. Starting early next year, developers of such apps will have to implement a feature to report offensive or controversial content directly in the user interface. These changes affect not only AI-based chatbots, but also applications that create visual and audio content. The aim of the initiative is to combat inappropriate content, including deepfakes and disinformation.
Google clarified that the new policy does not apply to all AI applications. This affects chatbots, applications for creating images, voice and video content. Apps that only store AI-generated content or use AI to summarize text material remain excluded from the scope of the new rules.
Google focuses on specific categories of content that require strict moderation. This list includes fake videos or images created without the consent of the people depicted, as well as footage of real people used for fraudulent purposes.
In addition, the Company will be particularly vigilant about disseminating false or misleading information related to the election. No less strict controls apply to applications in which generative AI is primarily used for sexual gratification, as well as to the creation of malicious code.
In its announcement, Google emphasized that generative AI is a rapidly growing application category, suggesting the company may reconsider its AI policies as the technology evolves. In addition to new rules for AI-generated content, Google has also expanded its photo and video permissions policy for the Play Store and restricted Android apps’ access to data.
“Photos and videos on users’ devices represent their personal and confidential information and require the utmost responsibility, the company emphasized in its statement. — Such data represents a potential vulnerability for users in the event of data leaks or other forms of exploitation. Restricting access to it not only increases the security of users, but also reduces the burden on developers of processing sensitive information“