Incentive structures can induce overfitting in companies
Date created: 2022-07-19
When a measure becomes a target, it ceases to be a good measure because of this. You work to optimize for the measure, not the underlying thing you are trying to accomplish.
It really is true that the company will build whatever the CEO decides to measure.
- Sam Altman quoted in Algorithms to live by
References
- Link to website, bibtex from Zotero or note with book/blog/etc summary