Automation Bias
Jump to navigation
Jump to search
Basics
- The biases people have towards trusting a machine or automated result more than alternate opinions
- From Wikipedia:
- ”Automation bias is the propensity for humans to favor suggestions from automated decision-making systems and to ignore contradictory information made without automation, even if it is correct.”
Relevance In System Design
Relevance in Protocols/Safety
- Electronic Meters such as 5 Gas Meters are prone to error, especially if not taken care of + frequently Bump Tested etc
- While if it is giving a False Positive one should treat it as valid etc ( Overabundance of Caution Principle etc), believing the meter is infallible should be avoided as in some situations, a False Negative could occur with deadly consequences
- It’s a bit more mundane for this example, but non-expired PH Strips can be more accurate than Electronic PH Testers
Relevance in Regards to Large Language Models / AI
Examples
- False Positives with testing equipment