“The brand new credit score mannequin didn’t carry out as anticipated,” he mentioned.
My colleagues from one other workforce got here out from the “battle room” wanting dejected.
This was my first time witnessing a knowledge science “mistake” in a enterprise context, so I didn’t fairly perceive the dimensions of it.
As I’d study over the following six months, this was a really pricey error from each a monetary and operational perspective, due to the downstream affect and reverberating results it had throughout the corporate.
This situation impacted each workforce and all of us labored tirelessly for months after:
- Analysts labored on metrics to trace portfolio well being,
- Information scientists labored on diagnosing the problem and patching it,
- Engineers labored with information scientists to deploy the brand new mannequin,
- Product entrepreneurs labored on campaigns and messaging,
- Operational of us labored on buyer outreach and training on compensation.
The primary signal of bother was a lot greater default charges relative to expectations, however this was simply the…