Automation Bias: Difference between revisions
Jump to navigation
Jump to search
(Added some more links under the “External Links” section) |
(Saved Progress Mid-Long Edit) |
||
Line 3: | Line 3: | ||
*From Wikipedia: | *From Wikipedia: | ||
**”Automation bias is the propensity for humans to favor suggestions from automated decision-making systems and to ignore contradictory information made without automation, even if it is correct.” | **”Automation bias is the propensity for humans to favor suggestions from automated decision-making systems and to ignore contradictory information made without automation, even if it is correct.” | ||
=Relevance In System Design= | |||
* | |||
=Relevance in Protocols/Safety= | |||
*Electronic Meters such as [[5 Gas Meters]] are prone to error, especially if not taken care of + frequently [[Bump Tested]] etc | |||
*While if it is giving a [[False Positive]] one should treat it as valid etc ( [[Overabundance of Caution Principle]] etc), believing the meter is infallible should be avoided as in some situations, a False Negative could occur with deadly consequences | |||
*It’s a bit more mundane for this example, but non-expired [[PH Strips]] can be more accurate than [[Electronic PH Testers]] | |||
=Relevance in Regards to Large Language Models / AI= | |||
* | |||
=Examples= | =Examples= |
Revision as of 16:26, 20 August 2025
Basics
- The biases people have towards trusting a machine or automated result more than alternate opinions
- From Wikipedia:
- ”Automation bias is the propensity for humans to favor suggestions from automated decision-making systems and to ignore contradictory information made without automation, even if it is correct.”
Relevance In System Design
Relevance in Protocols/Safety
- Electronic Meters such as 5 Gas Meters are prone to error, especially if not taken care of + frequently Bump Tested etc
- While if it is giving a False Positive one should treat it as valid etc ( Overabundance of Caution Principle etc), believing the meter is infallible should be avoided as in some situations, a False Negative could occur with deadly consequences
- It’s a bit more mundane for this example, but non-expired PH Strips can be more accurate than Electronic PH Testers
Relevance in Regards to Large Language Models / AI
Examples
- False Positives with testing equipment