Medicare’s AI Experiment Faces Legal Challenge: What It Means for Your Healthcare
The Electronic Frontier Foundation (EFF) has filed a Freedom of Information Act (FOIA) lawsuit against the Centers for Medicare & Medicaid Services (CMS) demanding transparency around a modern AI program called WISeR (Wasteful and Inappropriate Service Reduction). This program, rolled out in six states in January, uses artificial intelligence to evaluate prior authorization requests from Medicare beneficiaries. The EFF argues the public deserves to understand how these algorithms work, fearing potential delays or denials of necessary medical care.
The Rise of AI in Healthcare: A Double-Edged Sword
WISeR isn’t an isolated incident. The healthcare industry is rapidly adopting AI for tasks ranging from diagnosis and drug discovery to administrative processes like prior authorization. While AI promises increased efficiency and cost savings, concerns about bias, accuracy, and patient safety are mounting. The core issue, as highlighted by Kit Walsh, EFF’s Director of AI and Access-to-Knowledge Legal Projects, is that “tasking an algorithm with making determinations about treatment can create unwarranted—and even discriminatory—delays or denials of necessary medical care.”
How WISeR Works – And What We Don’t Know
Prior authorization, previously uncommon in traditional Medicare, now requires providers to seek approval from insurers before certain treatments or services are covered. WISeR aims to streamline this process using AI. Though, critical details remain opaque. What data is the AI trained on? Are there safeguards against algorithmic bias? How are wrongful denials of care prevented? These questions remain unanswered, fueling the EFF’s lawsuit.
Adding to the concern, WISeR incentivizes contracted companies to deny prior approvals, with vendors receiving a percentage of the savings generated by denials. Reports have already surfaced of delays in care approval and administrative strain following the program’s launch, suggesting the system may be prioritizing cost-cutting over patient well-being.
Beyond WISeR: The Broader Implications for AI and Healthcare
The WISeR case highlights a growing trend: the increasing use of “black box” algorithms in critical decision-making processes. This lack of transparency raises several key issues:
- Algorithmic Bias: AI algorithms are only as good as the data they are trained on. If that data reflects existing societal biases, the AI will perpetuate and even amplify them, potentially leading to unequal access to care.
- Lack of Accountability: When an AI makes an incorrect decision, it can be difficult to determine who is responsible. Is it the algorithm developer, the healthcare provider, or the insurer?
- Erosion of Trust: Without transparency, patients may lose trust in the healthcare system, fearing that their care is being dictated by an opaque and potentially flawed algorithm.
The EFF’s FOIA request sought agreements with software vendors, records of accuracy and bias testing, and audits of the WISeR program. CMS has yet to provide these records.
The Future of AI in Healthcare: Navigating the Challenges
The integration of AI into healthcare is inevitable, but it must be done responsibly. Here are some key steps to ensure a future where AI enhances, rather than hinders, patient care:
- Transparency and Explainability: Algorithms should be designed to be transparent and explainable, allowing healthcare providers and patients to understand how decisions are made.
- Rigorous Testing and Validation: AI algorithms must be rigorously tested for accuracy, bias, and fairness before being deployed in clinical settings.
- Robust Oversight and Regulation: Clear regulatory frameworks are needed to govern the development and use of AI in healthcare, ensuring accountability and protecting patient rights.
- Human-in-the-Loop Systems: AI should be used to augment, not replace, human judgment. Healthcare providers should always have the final say in treatment decisions.
As Kit Walsh of the EFF emphasizes, “The public has a right to know more about the algorithms driving decisions around their healthcare.”
FAQ: AI and Your Healthcare
- What is prior authorization? Prior authorization requires healthcare providers to get approval from an insurer before providing certain treatments or services.
- What is WISeR? WISeR is an AI program used by Medicare to assess prior authorization requests.
- Why is the EFF suing CMS? The EFF is seeking transparency about how WISeR works and whether it has safeguards against bias and wrongful denials of care.
- Could AI negatively impact my healthcare? Potentially, if algorithms are biased or inaccurate, they could lead to delays or denials of necessary care.
Pro Tip: If you are concerned about the use of AI in your healthcare, talk to your doctor and ask questions about how AI is being used in your treatment plan.
Learn more about the EFF’s work on AI and civil liberties: https://www.eff.org/
Explore the complaint: https://www.eff.org/document/complaint-eff-v-cms-medicare-wiser-foia
