Right now Pants doesn't seem to rerun a test even when I modify the test file itself. Adding

--test-force

doesn't make a difference.