https://pantsbuild.org/ logo
#development
Title
# development
h

hundreds-father-404

08/18/2021, 12:50 AM
hey @witty-crayon-22786 fyi the dynamic UI is showing up in CI again, this time "Scheduling: Run Pytest for ..."
I was also trying to get a screnshot today but was too slow every time. When running a test, "Scheduling: Run Pytest" appears at the same time as the "Run Pytest" log in dynamic UI. They last for the same amount of time
w

witty-crayon-22786

08/18/2021, 1:08 AM
Blargh. Will look tomorrow.
last time this correlated with slow/delayed cache hits. but afaict, things look fine during this period
👍 1
h

hundreds-father-404

08/18/2021, 5:17 PM
Perhaps reproducing the local issue may be insightful for fixing the CI issue?
w

witty-crayon-22786

08/18/2021, 5:39 PM
yea, have seen it locally. maybe the next step is actually to bisect.
👍 1
hm, yea, something is awry here. in the case that i’m examining, the remote action cache lookup misses in a fraction of a millisecond, which means there should be no other work running under that workunit… only the local process
👍 1
Screen Shot 2021-08-19 at 14.28.49.png
cc @average-vr-56795: ^ our zipkin data is pretty complete at this point!
so, based on this… i think that this is not a cache bug, but a UI bug. i’m going to try that bisect.
👍 1
a

average-vr-56795

08/19/2021, 9:43 PM
Very nice!!
💯 1
w

witty-crayon-22786

08/19/2021, 9:43 PM
only trouble now with workunits is that many runs have 80k of them
1
(…and they are used to render the UI, and i don’t know why the one Eric is referring to is rendering right now… sigh)
a

average-vr-56795

08/19/2021, 9:44 PM
Yeah, it's tricky! Particularly if you end up adding sever-side spans too - a span per input to every action on the server... It adds up
w

witty-crayon-22786

08/25/2021, 5:10 PM
fwiw, still seeing this, and it’s bugging me. want to get patches posted for https://github.com/pantsbuild/pants/issues/12548 before looking at it though.