i have recently wondered a few times whether we should change the default of not caching failing tests.