We have been covering health concerns about AI, much of it based upon educated guesses about where AI will go. But, there are already concerns about what is being done with AI even now. Thus, in some US hospitals, but not as far as I could ascertain, any Australian hospitals yet, health decisions are being made by AI systems, overriding the practical experience of nurses. The problem is that the AI algorithm is limited, not being able to take in all the possibilities and realistically evaluate them, and justify a decision. It performs badly when there are competing medical hypotheses, consistent with the evidence, and has difficulties evaluating such situations. I simply would hate to be sick in a hospital bed, and have my life hang in the balance to be decided by a machine. Cold, and very often, just plain wrong.
https://www.naturalnews.com/2023-06-19-ai-overriding-decisions-human-care-nurses-hospitals.html