Dark Web and Generative AI: Unveiling the Intriguing Connection
Via Flare
Summary
The emergence of generative AI tools in 2023 prompted rapid adoption — and exploitation — on dark web forums, where cybercriminals began circulating cracked versions of legitimate large language models alongside purpose-built malicious alternatives. Two of the most prominent, WormGPT and FraudGPT, appeared on dark web marketplaces in July 2023, offering subscribers AI-powered capabilities for generating phishing emails, writing malware, and creating fraudulent content with no built-in safety guardrails.
Security researchers documented hundreds of listings on dark web forums offering prompt injection kits and jailbreaks designed to circumvent the content restrictions of mainstream AI tools. The ease of access and low subscription costs lowered the technical barrier for cybercrime significantly. The trend highlighted a growing arms race between AI safety measures and criminal actors seeking to weaponize the same generative AI advances driving legitimate industry adoption.
