INTRODUCTION
You do not always have to search for harmful content online; sometimes, it finds you. A teenager opens a social media app to watch dance videos or memes, but within minutes, the feed begins showing self-harm content, explicit material, dangerous “challenges,” or emotionally disturbing videos. This is not always accidental. It is often the result of algorithms designed to maximise engagement, regardless of whether that engagement is healthy or harmful.
In today’s digital age, young people spend a significant part of their lives online. Social media platforms do not simply display content randomly; they carefully select what users see based on their clicks, watch time, likes, and even moments of hesitation while scrolling. The result is a highly personalised digital environment where harmful content can be repeatedly pushed toward vulnerable users. This raises an important question: when algorithms actively amplify dangerous content, should the law hold platforms accountable?
THE LEGAL CONCERN: WHO IS RESPONSIBLE?
The legal issue here is not only about harmful content being uploaded, but about harmful content being amplified. A platform may argue that it did not create the content, but if its algorithm continuously promotes that content to vulnerable users, the question of responsibility becomes unavoidable.
A major 2026 report highlighted how teenagers and young adults across India have been dying while attempting dangerous stunts for Instagram Reels and short videos. Cases included fatal train-track videos, drowning while filming dramatic shots, electrocution during rooftop stunts, and road accidents caused while recording content for likes and views. The pattern showed that the desire for online validation was pushing young users into life-threatening behaviour. As highlighted in a 2026 report by The Times of India[1], the pursuit of likes and visibility through Instagram Reels has led to multiple deaths across India, showing how algorithm-driven validation can turn ordinary users into participants in dangerous and sometimes fatal behaviour.
RECENT DEVELOPMENTS AND GROWING REGULATION
Recent discussions around stricter regulation of influencers and online creators show that the law is beginning to recognise digital responsibility more seriously. Platforms and creators are increasingly being questioned for the impact of what they promote, especially when content influences public behaviour.
A major 2026 social media trial[2] in Los Angeles brought global attention to the legal responsibility of digital platforms when Mark Zuckerberg personally testified regarding allegations that Meta’s platforms, particularly Instagram, were deliberately designed to keep young users addicted. The plaintiff, a now 20-year-old woman identified as KGM, argued that her early use of social media led to addiction, worsened depression, and suicidal thoughts. Meta Platforms and YouTube remained the main defendants, while TikTok and Snap had already settled similar claims. The case focused on features such as infinite scrolling, algorithmic recommendations, cosmetic filters, and endless feeds, which the plaintiffs argued were intentionally structured to maximise engagement at the cost of users’ mental well-being.
This shift reflects an important legal principle: representation and influence carry responsibility. If influencers can be questioned for misleading endorsements, platforms should also be questioned when their systems repeatedly push harmful material to young users simply because it increases engagement.
YOUTH, VULNERABILITY, AND ARTICLE 21
The issue also connects to the broader constitutional idea of the right to life under Article 21[3], which has been interpreted by the Supreme Court of India to include dignity, mental well-being, and the right to live with safety and protection.
When children and young adults are repeatedly exposed to harmful content that affects their mental health, body image, or emotional stability, it becomes more than a social issue; it becomes a question of rights. Digital spaces are now part of everyday life, and safety in these spaces deserves the same seriousness as safety in physical spaces.
The law must therefore ask: if society protects children from harmful physical environments, why should digital environments be treated differently?
NEED FOR STRONGER SAFEGUARDS
The law must move beyond simply removing harmful content and focus on preventing algorithmic amplification of such material. Since platforms use sophisticated technology to predict what keeps users online, they should also be expected to identify what may place them at risk. Stronger safeguards are necessary to ensure that innovation does not come at the cost of mental health, dignity, and child safety.
Some important safeguards are –
Age-Sensitive Algorithms: Platforms should be required to create separate recommendation systems for minors that automatically restrict content related to nudity, self-harm, violence, and dangerous online challenges.
Transparent Recommendation Systems: Social media companies should disclose how their algorithms function, especially when certain content is repeatedly promoted. Transparency would help determine whether harmful exposure is accidental or a result of deliberate engagement-driven design.
Stronger Parental Controls: Parents should be given clearer tools to monitor screen time, filter sensitive content, and understand what kind of material is being recommended to children.
Mandatory Warning and Intervention Systems: If users repeatedly engage with self-harm, suicide-related, or disturbing content, platforms should be legally required to trigger warnings, mental health resources, or intervention measures rather than continuing recommendations.
Clearer Legal Accountability: Indian law should define when algorithmic promotion amounts to negligence. If a platform knowingly continues to push harmful content despite repeated warnings or reports, legal liability should arise.
CONCLUSION
Algorithms were created to personalise digital experiences, but when personalisation turns into repeated exposure to harm, the issue becomes deeply legal. Young people today are not merely consuming content, but they are being shaped by systems designed to predict and influence their behaviour.
The real danger lies not in a single harmful post, but in the invisible mechanism that keeps bringing similar content back to the screen. In such a world, responsibility cannot stop with the content creator alone. Platforms that profit from attention must also answer for the consequences of what they choose to amplify.
In the end, scrolling may seem harmless, but when technology quietly pushes users toward danger, the law must step in. Because in the digital age, harm is not always searched for; sometimes, it is carefully delivered.
Author: Sukanya Roy (Sister Nivedita University)
References:
[1] R K Laxmi, ‘Chasing likes, losing lives: How social media reels are fueling fatal risks among youth’ (The Times of India, 18 April 2026) https://timesofindia.indiatimes.com/city/delhi/chasing-likes-losing-lives-how-social-media-reels-are-fueling-fatal-risks-among-youth/articleshow/130348916.cms
[2] Kaitlyn Huamani and Barbara Ortutay, ‘Zuckerberg testifies at trial accusing social media firms of addicting kids to their platforms’ (ABC7 Chicago, 18 February 2026) https://abc7chicago.com/post/mark-zuckerberg-set-testify-watershed-social-media-trial/18615587/
[3] Constitution of India, art 21
