https://pantsbuild.org/ logo
#development
Title
# development
h

happy-kitchen-89482

08/31/2021, 11:40 AM
What's been going on with CI recently? Seeing some flakiness.
h

hundreds-father-404

08/31/2021, 3:33 PM
Known sources: • timeouts of Python tools is likely from the changes to stabilize tool lockfiles, which added new tests like testing that every version of Python works w/ the tool. If it times out, please bump the timeout • JVM tests were restored recently but are still flaky. @fast-nail-55400 has been working on stabilizing. (Should we skip in meantime?) • macOS jobs sometimes time out, no idea why
f

fast-nail-55400

08/31/2021, 3:35 PM
I’ve been looking into the JVM test flakiness. Theory: The engine is running multiple copies of coursier concurrently, and unpacking the JDK download conflicts with other attempts to unpack the download by other coursier processes.
resulting in the “Directory not empty” errors that we are seeing
h

hundreds-father-404

08/31/2021, 3:40 PM
@fast-nail-55400 should we skip those in the meantime?
f

fast-nail-55400

08/31/2021, 3:41 PM
are they consistently breaking CI?
h

hundreds-father-404

08/31/2021, 3:42 PM
maybe 5% of runs?
h

happy-kitchen-89482

08/31/2021, 5:58 PM
I'm seeing
Failed to load Toolchain token from env var 'TOOLCHAIN_AUTH_TOKEN'
, that's just a warning, but still (cc @polite-garden-50641 when he gets back from vacation)
ImportError: No module named generate_github_workflows
when trying to build generate_github_workflows.pex
I don't see how that change could affect that
h

hundreds-father-404

08/31/2021, 6:08 PM
That's almost certainly not a flake
I'm seeing Failed to load Toolchain token from env var 'TOOLCHAIN_AUTH_TOKEN', that's just a warning,
Asher fixed this last week, only release hasn't been consumed yet
p

polite-garden-50641

08/31/2021, 6:10 PM
the token error is just a UX issue. I am following up on that https://github.com/toolchainlabs/toolchain/issues/10846
h

happy-kitchen-89482

09/01/2021, 4:21 PM
OK, that error is in fact due to my change interacting badly with something