Goodhart’s regulation famously says: “When a measure turns into a goal, it ceases to be a superb measure.” Though initially from economics, it’s one thing we’ve got to grapple with at OpenAI when determining the way to optimize aims which might be tough or pricey to measure.