The influence of generative AI-created content in India : a critical analysis of digital safety and democratic processes (2023-2024)

Abstract

Generative AI applications can produce synthetic text, images, videos, etc. Conventional tools cannot reliably detect AI-created content since generative models advance much faster. Generative AI, though created to enhance the productivity of several industries, is being exploited unethically to cause harm to digital citizens through cyber scams, online gender-based violence and election manipulation. This study seeks to understand the influence of AI-generated content on society between 2023 and 2024, determine experts’ views on the topic, and critically examine India’s preparedness to preempt and mitigate adverse effects. The dissertation could establish that from 2023 to 2024, generative AI helped create synthetic media that was used to create cyber scams, vengeance, and election interference. It further concluded that India’s governance frameworks at the moment are inadequate for preventing such online harms or providing justice to victims. The influence of generative AI tools on electoral processes was mixed; while it revolutionized campaign practices, could detect harmful content through automated classifiers and increased voter engagement, it also helped create disinformation campaigns, thus eroding public trust. To prevent the misuse of generative AI, a proactive approach to enhancing legal, technological, enforcement capacities, improving public awareness and literacy through international cooperation is needed.