News

What you should never share with an AI chatbot

AI chatbots, like ChatGPT, Claude, and Copilot, are becoming increasingly popular. But how much do they really need to know about us?

Many users view AI chatbots as friends or trusted individuals they can ask for advice from. However, in reality, they are not human, and it is not always clear how they handle the information we share with them.

Therefore, before seeking advice on mental health, medical, legal or other personal matters, carefully consider the potential implications. ai chatbots

AI chatbots remember more than you think

They usually store the information you give them so they can:

  • be retrieved by you at a later time,
  • be retained as part of a broader context of information about you or your work (memory),
  • be audited by the platform provider to identify violations of the Terms of Service (ToS) and to improve security,
  • be used to improve services and develop future versions of the models, among other things.

Not every prompt is automatically used to train models; practices vary by platform, privacy policy, and account settings.

Additionally, the information you share may be exposed due to security incidents on the provider's side, through shared chat links, or through integrations that forward prompts to third-party services.

Some offer zero data retention ( ZDR) and commit to not using user data to train their models. Before choosing a particular platform or model, it is important to study the provider’s data management policies and review the available privacy settings so you know how your information is collected, stored, and used.

Five things you should never share

While there are platforms that emphasize privacy and digital data sovereignty, users should remain cautious. Companies' policies, terms of use, and priorities can change, meaning the data you share today could be used to train AI systems in the future.

Here are some categories of information that are best kept private when using AI tools.

  1. Passwords and credentials

This category includes usernames, passwords, recovery codes for multi-factor authentication (MFA), and answers to security questions used to recover or access accounts.

The ability for an AI chatbot to retain information in its memory may seem convenient. However, storing or sharing credentials through such tools poses serious security risks . If these credentials are exposed, for example through improper data handling or unauthorized access, they could be used to compromise accounts.

  1. Sensitive Personally Identifiable Information (SPII)

This includes identity and passport details, residential addresses and financial data.

Some of this information may be provided to an AI service provider as part of a transaction, such as when paying for a subscription. In such cases, its management may be governed by specific security and regulatory compliance requirements. However, this does not mean that it is equally safe to share it with a chatbot.

If they fall into unauthorized hands, they could facilitate identity theft or other forms of fraud.

  1. Confidential work-related information

This category includes internal reports, customer data, product designs, source code, and other non-public business information.

Using AI to summarize a confidential document may seem like an effective way to save time. However, if the tool is not approved to handle such information or is not covered by the corresponding agreement between your employer and the provider, uploading the document may violate internal company policies, contractual obligations, or data protection requirements. In some cases, it may even need to be treated as a security incident.

A case in point is a reported incident in 2023, when Samsung employees allegedly uploaded proprietary source code , semiconductor testing information, and internal meeting notes to ChatGPT in order to facilitate daily tasks. The incident highlighted how easily a seemingly innocent workaround to increase productivity can lead to confidential information being transferred outside the organization.

  1. Medical and other highly sensitive personal data

This includes medical records, test results, information about treatments, and other health-related data.

It is understandable that people may share sensitive information when seeking guidance on difficult personal situations. However, AI tools are not a substitute for healthcare professionals and cannot provide the same personalized assessment and care as a doctor. In addition, the processing of health data is subject to specific protection requirements, and healthcare professionals are bound by specific legal and ethical obligations regarding medical confidentiality. For this reason, it is best to avoid sharing identifiable medical information with AI tools unless you have confirmed that their use is appropriate and safe.

  1. Information about other people

This category includes colleague details, customer records, private conversations, contact details and other personal information of third parties.

Privacy concerns not only our own data, but also that of others. Sharing information about others without proper authorization or, where required, their consent may violate ethical principles, contractual obligations, or even the law. At the same time, it may expose those individuals to risks if their information is disclosed or used in an unpredictable way.

A related example was reported in 2025, when thousands of ChatGPT conversations that had been shared via public links appeared in search engine results. Some of them contained personal or professional information. The conversations were not leaked from private accounts; however, the incident highlighted how a seemingly simple sharing option can make a conversation much more public than users had realized.

Additionally, remember that a prompt is not limited to the text you type. Documents you upload, screenshots, images, voice recordings, and information pulled from connected apps may contain equally sensitive information. Some of this information may be hidden in metadata, comments, or other content that is not immediately visible. All of this information may be accessible and usable by AI.

Think before you submit a prompt

Before sharing any information, ask yourself:

  • Is this public information?
  • Would I be willing to share it in a public forum?
  • Do I have the necessary authorization to share it?
  • Would I feel comfortable if this information was disclosed in the event of a data breach?

If the answer to any of these questions is no, do not enter the information into a chatbot.

Private conversations aren't necessarily private

Private, incognito, or temporary chat features can limit the exposure of your information, for example, by keeping a conversation out of your visible history or excluding it from model training. However, the term “private” can create a false sense of security. The provider may retain conversations for a limited period of time to detect abuse, investigate security issues, or comply with legal obligations.

In addition, these features do not necessarily ensure the protection of information transmitted through plugins, connected applications, shared links or other third-party services.

Use AI safely

If, nevertheless, you absolutely want to share information with the AI ​​chatbot, you can configure your prompt in a way that limits the risks:

  • Remove names and other identifying information.
  • Use fictional or anonymized examples instead of real cases or incidents.
  • Summarize sensitive documents yourself before asking for AI's help.
  • Use approved enterprise AI tools with appropriate data protection safeguards, if available in your workplace.

Approval of a tool does not mean you can use it without restrictions. For added security, check what categories of classified data are allowed to be processed through the tool, whether features like chat history and memory are enabled, and whether external plugins, links, or web search features may transfer information outside of your organization's controlled environment.

Also, be aware that a smart chatbot can extract information that is personally relevant to you by leveraging your prompt history, even when you have anonymized the data you enter. Furthermore, deleting a conversation does not necessarily guarantee that all related data or copies of it have been deleted. While deletion may limit the exposure of information, it should not be considered proof that all traces of it have disappeared.

For this reason, it is important to know the data retention policies and how each provider manages the information it collects, including its possible use for training AI models.

If you discover that you have shared sensitive information, take immediate action, depending on the nature and severity of the exposure. If passwords, API keys, or other credentials have been exposed, change or revoke them without delay. Delete the relevant conversation and clear any cached memories, where possible. If your work, customer, or third-party data has been exposed, report the incident through your organization’s appropriate information security or privacy channel.

Users can reinforce these practices with the help of specialized AI security solutions. AI Security capabilities from trusted providers can analyze prompts and responses in real time, helping to prevent sensitive information from being uploaded to public chatbots. They also help identify malicious links, scripts, and other potentially dangerous content.

Conclusion: Treat AI as a public forum

AI can boost productivity and creativity. However, users should exercise the same caution they would when sharing information with a friend. In the age of AI chatbots, knowing what information to keep to ourselves has become a basic digital skill. AI chatbots are great for general, everyday conversations, but if you want to protect your privacy, it’s best to keep sensitive information to yourself.

FAQ: Using AI chatbots

Are conversations with AI chatbots private?

Not necessarily. How conversations are stored, controlled, or used varies by provider, product, account type, and privacy settings. Treat AI chatbots that are aimed at the general public as third-party services, not confidential communication spaces. Before sharing sensitive information, check the provider’s applicable data management policies.

Does deleting a conversation permanently delete the data?

Not necessarily. Deleting a conversation usually removes it from your visible history, but may not immediately delete all retained copies or operational logs. Data retention periods and related exceptions vary by service. For more information, please consult your provider's privacy policy and data retention guidelines.

Is anonymizing information enough to make a prompt secure?

Anonymization reduces the risk, but does not eliminate it. The combination of individual items, the larger context, or information from previous prompts may reveal the identity of an individual or organization. Remove unnecessary details, use fictional examples where possible, and never submit information that you are not authorized to share.

Are enterprise AI tools safer for work-related information?

Approved enterprise AI tools may provide stronger contractual safeguards, administrative controls, and restrictions on the use of customer data to train models. However, employees must still adhere to their organization’s policies on data confidentiality and use. They should only share information that the tool is approved to process.

What should I do if I have shared sensitive information?

Delete the conversation, where possible, clear any cached memories, and revoke access to connected apps, if relevant to your situation. If you have exposed passwords, recovery codes, or other credentials, change or revoke them immediately. If company, customer, or third-party data is involved, report the incident to your employer or organization’s security team rather than attempting to handle it yourself.

0 reviews

iGuRu.gr
Forum member? Participate in the forum discussion. Forum discussion →

Join the discussion

Your email address will not be published. Required fields are marked *

Your message will not be published if:

  1. Contains abusive, defamatory, racist, offensive or inappropriate comments.
  2. It causes harm to minors.
  3. It harasses the privacy and individual and social rights of other users.
  4. It advertises products or services or websites.
  5. Contains personal information (address, telephone number, etc.).