Give an agent the ability to keep trying and take action and it will chase the signal of success in ways you never intended. Goodhart's law helps explain why.
Goodhart’s Law and the limits of agent…
Give an agent the ability to keep trying and take action and it will chase the signal of success in ways you never intended. Goodhart's law helps explain why.