VICTORIA, Canada — The Canadian province of British Columbia is preparing to file a lawsuit against OpenAI, the company behind ChatGPT, over its alleged failure to report violent prompts generated by a school shooter, according to reports. The proposed legal action seeks to hold the AI giant accountable for not flagging concerning content that could have prevented a tragedy and to secure funds for the affected community.
The province’s legal challenge would centre on claims that OpenAI’s systems detected but did not report violent prompts related to a school shooting, potentially allowing the perpetrator to plan the attack without intervention. The case would be brought as a public interest lawsuit, with the province seeking both damages and systemic changes to how AI companies handle harmful content.
British Columbia, Canada’s westernmost province with a population of over five million, has taken a leading role in regulating technology companies operating within its jurisdiction. The province has previously pursued legal action against social media platforms over harmful content, establishing a framework for holding tech companies accountable for content moderation failures.
The lawsuit comes amid growing scrutiny of AI companies worldwide over their handling of harmful content. The case could have far-reaching implications for how AI platforms monitor and report potentially dangerous behaviour. Legal experts have noted that this would be one of the first major lawsuits of its kind against an AI company.
The proposed suit would follow a pattern of public interest litigation aimed at technology companies, where governments seek to establish liability for harm caused by digital platforms. The province is expected to argue that OpenAI’s duty of care extends to identifying and reporting potential threats to public safety.
OpenAI, which has faced increasing regulatory pressure globally, has previously stated its commitment to building safe and beneficial AI systems. The company has not yet publicly commented on the planned lawsuit from British Columbia.
As the legal action moves forward, the case could establish important precedents for AI accountability and the responsibilities of technology companies to report violent content. The outcome could shape how AI companies across North America handle threat detection and reporting in the future.
