India summons Meta over CSAM ads on Instagram

What happened?

India's government has summoned Meta, Instagram's parent company, after a BBC investigation revealed the platform displayed paid ads promoting child sexual abuse material (CSAM) to users in the country. Information Technology Minister Ashwini Vaishnaw ordered ministry officials to seek a formal explanation from the company, according to Business Standard, as cited by The Next Web. The BBC investigation identified ads that redirected to Telegram groups where CSAM was shared, suggesting Meta's automated systems failed to detect these illegal ads. The case has triggered an immediate response from the Indian government, which demands answers on how these ads were allowed to run and what measures Meta will take to prevent a recurrence.

Why is this important?

India is Meta's largest market by user count, with over 300 million Instagram accounts, representing roughly 30% of the platform's global user base. This incident exposes critical flaws in Meta's automated content moderation systems, which failed to detect ads promoting illegal material. It comes at a key time when India is drafting its new Personal Data Protection Act (DPDP Act, 2023) and tightening regulations on digital intermediaries through amendments to the Information Technology Act (IT Act, 2000). The government summons could set a precedent for stricter oversight of big tech in the country, which has been one of the most active in demanding accountability, including account blocks and content removal requests. Moreover, this case adds to a series of global controversies over child safety on social platforms, such as the Facebook Papers scandal in 2021, which revealed the company knew about CSAM risks on Instagram. The failure to detect these ads suggests Meta has not adequately implemented technologies like PhotoDNA, an image hashing tool developed by Microsoft to identify known CSAM, or that its ad review systems are insufficient for the volume of ads in India.

Potential consequences

Meta faces significant legal and regulatory risks. India's Information Technology Act, under section 67B, penalizes publishing or transmitting material depicting children in sexual acts, with penalties of up to seven years in prison and fines. Additionally, the new Personal Data Protection Act (DPDP Act) imposes fines of up to 250 million rupees (approximately $3 million) for violations related to processing children's data. If Meta is found negligent, sanctions could be even higher. In the short term, Meta may be forced to invest more in CSAM detection systems, such as PhotoDNA or AI tools, and revise its advertising policies to include additional human reviews in high-risk markets. In the long term, this incident could accelerate the implementation of stricter rules for all social platforms in India, affecting competitors like YouTube (owned by Google) and WhatsApp (also owned by Meta). For example, India has already proposed a 'responsible intermediaries' framework requiring platforms to remove illegal content within 24 hours and cooperate with authorities. This case could serve as a catalyst for these rules to be enforced more rigorously, increasing compliance costs for tech companies. Furthermore, public pressure could lead to user boycotts and increased scrutiny from regulators in other countries, such as the European Union, which is already implementing the Digital Services Act (DSA) with strict content moderation requirements.

What readers should know

• The BBC investigation identified ads leading to Telegram groups where CSAM was shared, indicating the problem is not limited to Instagram but involves other platforms. Telegram has previously been criticized for its lack of moderation of illegal content.
• Meta has stated it has strict policies against CSAM and invests in technology to detect it, but this case shows shortcomings. The company uses AI and tools like PhotoDNA to identify known content, but the ads promoted Telegram groups that may have contained previously unidentified material, making automatic detection difficult.
• India has been one of the most active countries in holding big tech accountable. In 2021, the government issued guidelines for platforms to remove harmful content within 24 hours, and in 2023, the new DPDP Act established strict rules for processing children's data. Additionally, India has blocked hundreds of accounts and websites for illegal content, including CSAM.
• The case also highlights Meta's reliance on automated moderation systems. According to a 2021 Wall Street Journal report, Instagram's algorithms detect only a small fraction of CSAM, and the company relies heavily on user reports. This suggests human oversight remains crucial, especially in high-volume markets like India.

“This incident underscores the need for human oversight in content moderation systems, especially in markets with large user volumes,” notes an analysis by TheVortiq. “Technology alone cannot prevent all abuses; a combination of automated tools, human review, and cooperation with authorities is required.”

In conclusion, the Indian government's summons to Meta is a clear warning that big tech must improve their content moderation systems or face regulatory consequences. This case not only affects Meta but sets a precedent for all digital platforms operating in India, the world's largest internet market after China. Investors and users should watch for the Indian government's next steps, which could include fines, mandatory audits, or even operational restrictions. Online child safety is a cross-border issue, and India's response could influence policies in other developing countries seeking to balance technological innovation with the protection of children's rights.