ML Phase III: Slowed Growth, Optimization Refinement, and Complex Models
Rule #38: Don’t waste time on new features if unaligned objectives have become the issue.
As your measurements plateau, do not try to solve it from outside of the scope. Refine objectives or product goals.
Rule #39: Launch decisions are a proxy for long-term product goals
To launch a new model, overal performance enhancement need to be calculated, not for partial improvement.