Florida’s New Legislation: Balancing AI and Human Oversight in Insurance
In an era where artificial intelligence (AI) is dramatically changing industries, the insurance sector is not exempt from its influence. However, Florida is taking a thoughtful approach as it navigates the intersection of technology and human decision-making in insurance claim handling. Recent legislation filed in the state aims to establish mandatory human reviews for claim denials, ensuring that technology complements rather than replaces the critical thinking of insurance professionals.
The Legislative Framework
Two significant pieces of legislation, House Bill 527 (HB 527) and its companion Senate Bill 202 (SB 202), have been introduced in Florida to address the rising reliance on algorithms and AI systems by insurance companies. These bills specifically state that information created by algorithms or machine learning may not serve as the sole basis for the adjustment or denial of a claim, whether in part or in whole. This means that when a claim is denied, there must be a human review first.
Requirements for Insurers
The proposed laws impose stringent requirements on insurers regarding the use of technology in their claims handling processes. When insurers plan to incorporate algorithms or AI systems, they are mandated to include comprehensive details in their claims handling manual. This includes outlining how these systems will be utilized and demonstrating compliance with the law. This move is designed to foster transparency and accountability in the claims process.
The Role of the Human Reviewer
Central to this legislation is the requirement for a “qualified human professional” to review any claim denials. This individual must have the authority, as per the Florida Insurance Code, to adjust or deny a claim. The legislation stipulates that the reviewer must perform several critical tasks before making a decision on the claim:
-
Independent Analysis: The qualified reviewer must analyze the claim and the insurance policy independent of any algorithm or AI system. This requirement underscores the importance of human judgment in evaluating the nuances of each claim.
-
Accuracy Review: The professional is tasked with reviewing the accuracy of any output generated by the AI or algorithm. This step is crucial in ensuring that technology does not inadvertently introduce errors into the claims process.
-
Final Determination: After conducting their assessments, the reviewer must determine whether the claim aligns with the terms of the insurance policy. Only then can they decide if the claim is payable or should be denied.
The Rationale Behind the Legislation
The sponsors of these bills argue that the legislation addresses a growing challenge within the insurance market. With the increasing use of technology, there is a pressing need for safeguards against algorithm-driven decisions that could unfairly impact policyholders. The clear emphasis on human oversight serves as a protective measure, ensuring that individuals are not solely subjected to the whims of technology.
Regulatory Context
In 2023, the National Association of Insurance Commissioners (NAIC) took a proactive step by approving a model bulletin regarding the use of AI in insurance. This bulletin emphasizes the necessity for insurers to establish processes and controls against potential inaccuracies, discriminatory biases, and data vulnerabilities that AI systems might introduce. It reminds insurers of their obligations under existing laws like the Unfair Trade Practices Model Act, which governs against unfair or deceptive acts in the industry.
Future Challenges
The proposed legislation may face challenges at the federal level. Recently, the President signed an executive order aimed at blocking states from enforcing their own regulations concerning artificial intelligence. This development raises questions about how state laws will interact with federal directives, potentially complicating the landscape for insurers navigating the use of AI.
As Florida steps cautiously into this new regulatory framework, it lays the groundwork for a balanced approach that respects both human expertise and technological innovation—a potentially transformative model for the insurance industry at large.
