Back to all posts

ChatGPT Chat Privacy At Risk After New Court Ruling

2025-06-25Eric Hal Schwartz5 minutes read
AI Privacy
ChatGPT
Legal

A federal judge has declined a ChatGPT user's request to overturn an order mandating OpenAI to preserve all ChatGPT conversations. This directive originated from a request by The New York Times in its ongoing lawsuit against OpenAI and Microsoft. OpenAI is preparing to contest this ruling.

judge hammer (Image credit: Pixabay)


OpenAI finds itself in a position where it must retain all your interactions with ChatGPT, potentially sharing them with numerous lawyers—even conversations you believed were deleted. This situation arises from an order by the federal judge overseeing the copyright infringement lawsuit initiated by The New York Times against OpenAI. Judge Ona Wang reaffirmed her earlier decision to preserve all ChatGPT conversations as potential evidence. This came after she rejected a motion from ChatGPT user Aidan Hunt, who, along with others, had asked for the order to be rescinded due to privacy and other concerns.

The Court's Mandate: Preserving ChatGPT Data

Judge Wang instructed OpenAI to "indefinitely" preserve ChatGPT's outputs. The New York Times argued this was necessary to determine if the chatbot has unlawfully replicated articles without compensating the original publishers. However, identifying such instances involves retaining every conversation, including intimate, awkward, or private communications users have had with the chatbot. Although user inputs are not explicitly part of the order, it's conceivable that one could deduce who was discussing personal topics with ChatGPT based on the AI's responses. In fact, the more personal the discussion, the easier it might be to identify the user.

User Privacy Takes Center Stage

Aidan Hunt highlighted that he received no warning about this possibility until he encountered a report about the order in an online forum. He expressed concern that his ChatGPT conversations, which include "highly sensitive personal and commercial information," might be disseminated. Hunt requested the judge to either vacate the order or modify it to exclude particularly private content, such as conversations in private mode or those discussing medical or legal matters.

According to Hunt, the judge was overstepping her authority with the order. He argued, "this case involves important, novel constitutional questions about the privacy rights incident to artificial intelligence usage – a rapidly developing area of law – and the ability of a magistrate [judge] to institute a nationwide mass surveillance program by means of a discovery order in a civil case."

Judge Wang's Rebuttal

Judge Wang dismissed Hunt's request, stating his concerns were not directly related to the copyright issue at the heart of the lawsuit. She emphasized that the order concerns preservation, not disclosure, and that it is not unusual for courts to direct private companies to retain certain records for litigation. While technically accurate, an average ChatGPT user might understandably feel differently.

The judge also seemed to particularly disapprove of the "mass surveillance" accusation. She quoted that part of Hunt's petition, adding a "[sic]" and a pointed remark in her legal filing, questioning how a document retention order for a private company in a civil litigation could be considered a "nationwide mass surveillance program." She asserted, "It is not. The judiciary is not a law enforcement agency."

Despite this, there's still a possibility the order might be rescinded or altered after OpenAI presents its arguments in court this week as part of the broader legal wrangling surrounding the lawsuit.

Deleted But Not Gone: The Lingering Impact

Hunt also raised a crucial point: regardless of this case's outcome, OpenAI will now possess the capability to retain chats that users thought were deleted, potentially using them in the future. This sparks concerns about whether OpenAI will prioritize user privacy over legal expediency. So far, OpenAI has advocated for user privacy and has requested oral arguments to challenge the retention order, which are set to occur this week. The company has indicated a strong desire to defend its users' interests. In the interim, your chat logs remain in a state of limbo.

Many users might have felt that conversing with ChatGPT was like confiding in a discreet friend. This situation may lead more people to realize that it functions like a computer program, and data akin to browser history and search terms are stored. At a minimum, increased transparency is hoped for. Even if courts compel AI companies to retain sensitive data, users should be informed by these companies, rather than discovering such policies by chance on web forums.

If OpenAI genuinely aims to protect its users, it could begin by offering more detailed controls: clear options for an anonymous mode, more robust deletion assurances, and notifications when conversations are being preserved for legal reasons. Until then, it might be prudent to treat ChatGPT less like a therapist and more like a coworker who could potentially be recording your conversations.


You Might Also Like

Read Original Post
ImaginePro newsletter

Subscribe to our newsletter!

Subscribe to our newsletter to get the latest news and designs.