04/29/2022, 1:47 PM
One of my engs brought up that Bazel has a
flag which will re-run tests a certain # of times to help identify flaky tests. I could implement this in Pytest + Pants'
, but it might be useful for other languages. Anyone got thoughts?
04/29/2022, 2:15 PM
It would be great to have
04/29/2022, 4:22 PM
works across all languages
04/29/2022, 4:23 PM
Yeah that was why I made the post. I think the idea would be to add another flag like
so that all languages benefit
04/29/2022, 4:54 PM
ah, got it.
a little bit more about the usecases would be good: i think that we were envisioning the retry setting as a tool to smooth out CI… this sounds more like a manually run local “is it flaky” tool
mm: a cool thing about this existing explicitly would be that it could run all attempts in parallel
04/29/2022, 6:18 PM
Re use cases I think it boils down to two settings. Retry+retry behavior.