hey <@U06A03HV1> fyi the dynamic UI is showing up ...
# developmenth
hundreds-father-404
08/18/2021, 12:50 AMhey @witty-crayon-22786 fyi the dynamic UI is showing up in CI again, this time "Scheduling: Run Pytest for ..."
hundreds-father-404
08/18/2021, 12:50 AMhundreds-father-404
08/18/2021, 12:51 AMI was also trying to get a screnshot today but was too slow every time. When running a test, "Scheduling: Run Pytest" appears at the same time as the "Run Pytest" log in dynamic UI. They last for the same amount of time
w
witty-crayon-22786
08/18/2021, 1:08 AMBlargh. Will look tomorrow.
witty-crayon-22786
08/18/2021, 5:16 PMlast time this correlated with slow/delayed cache hits. but afaict, things look fine during this period
👍 1
h
hundreds-father-404
08/18/2021, 5:17 PMPerhaps reproducing the local issue may be insightful for fixing the CI issue?
w
witty-crayon-22786
08/18/2021, 5:39 PMyea, have seen it locally. maybe the next step is actually to bisect.
👍 1
witty-crayon-22786
08/19/2021, 9:28 PMhm, yea, something is awry here. in the case that i’m examining, the remote action cache lookup misses in a fraction of a millisecond, which means there should be no other work running under that workunit… only the local process
👍 1
witty-crayon-22786
08/19/2021, 9:29 PMScreen Shot 2021-08-19 at 14.28.49.png
witty-crayon-22786
08/19/2021, 9:30 PMcc @average-vr-56795: ^ our zipkin data is pretty complete at this point!
witty-crayon-22786
08/19/2021, 9:34 PMso, based on this… i think that this is not a cache bug, but a UI bug. i’m going to try that bisect.
👍 1
a
average-vr-56795
08/19/2021, 9:43 PMVery nice!!
💯 1
w
witty-crayon-22786
08/19/2021, 9:43 PMonly trouble now with workunits is that many runs have 80k of them
❗ 1
witty-crayon-22786
08/19/2021, 9:44 PM(…and they are used to render the UI, and i don’t know why the one Eric is referring to is rendering right now… sigh)
a
average-vr-56795
08/19/2021, 9:44 PMYeah, it's tricky! Particularly if you end up adding sever-side spans too - a span per input to every action on the server... It adds up
w
witty-crayon-22786
08/25/2021, 5:10 PMfwiw, still seeing this, and it’s bugging me. want to get patches posted for https://github.com/pantsbuild/pants/issues/12548 before looking at it though.