Discussion
Loading...

Discussion

Log in
  • About
  • Code of conduct
  • Privacy
  • Users
  • Instances
  • About Bonfire
Mike Stone
Mike Stone
@mike@fosstodon.org  ·  activity timestamp 2 months ago

Ooof. This sounds like the worst idea I've heard of for a while. I don't feel like this should need to be said, but don't trust an LLM for medical advice. Seriously.

https://www.zdnet.com/article/openai-chatgpt-health-mode/

  • Copy link
  • Flag this post
  • Block
Federation Bot
Federation Bot
@Federation_Bot  ·  activity timestamp 2 months ago

@mike "OpenAI's new 'dedicated experience' that taps into your medical records..." What could go wrong 😀

On the other hand, as a woman™ I'm actually kind of excited for the advanced pattern recognition that AI could bring. It might help with better identifying women's health issues.

  • Copy link
  • Flag this comment
  • Block
ojonnysilva
ojonnysilva
@ojonnysilva@fosstodon.org  ·  activity timestamp 2 months ago

@Gina @mike Assuming the training data doesn't have the same biases. Besides, part of the issue is how women have been negleted at the research level, so what we know and the data we can work on is already biased, rather than just a doctors beeing bad at their jobs.

  • Copy link
  • Flag this comment
  • Block
Kevin Dominik Korte
Kevin Dominik Korte
@kdkorte@fosstodon.org  ·  activity timestamp 2 months ago

@Gina @mike Unfortunately, AI isn't really good at identifying women's health issues. So, "what could go wrong" could actually be fatal.
https://www.newscientist.com/article/2510065-ai-chatbots-miss-urgent-issues-in-queries-about-womens-health/
https://femtechnology.org/2025/07/30/built-to-fail-her-ais-invisible-bias-in-womens-health-and-how-we-fix-it-for-everyone
https://www.business-humanrights.org/en/latest-news/uk-ai-tools-downplay-womens-health-issues-study-finds/

  • Copy link
  • Flag this comment
  • Block
Gina
Gina
@Gina@fosstodon.org  ·  activity timestamp 2 months ago

@kdkorte @mike yeah chatbots are pretty useless, but applications like improved breast cancer screening sound interesting.

https://www.sciencedirect.com/science/article/pii/S0720048X24001736

  • Copy link
  • Flag this comment
  • Block
Mike Stone
Mike Stone
@mike@fosstodon.org  ·  activity timestamp 2 months ago

@Gina Theoretically, AI may be able to better identify women's health issues than some rando doctor, but as a American™ the whole idea of giving all my medical information to a company that's more than likely to turn around and sell it to the highest bidder creeps me the hell out. Especially since those companies could very well be health insurance companies that could decide to deny me coverage based on conditions I may or may not even have. And that's assuming the "AI" is not some random LLM.

  • Copy link
  • Flag this comment
  • Block

bonfire.cafe

A space for Bonfire maintainers and contributors to communicate

bonfire.cafe: About · Code of conduct · Privacy · Users · Instances
Bonfire social · 1.0.2-alpha.32 no JS en
Federation disabled
Log in
Instance logo
  • Explore
  • About
  • Members
  • Code of Conduct