hey folks! i’ve prepped a blog post that explains ...
# developmentw
witty-crayon-22786
10/28/2020, 9:42 PMhey folks! i’ve prepped a blog post that explains dependency inference which i think we’d like to post tomorrow!: https://docs.google.com/document/d/1iopAAbCsXjR-0FO5kp2QCJWV2YjnJ_QWPJnujXivvN0/edit … the goal is for it to be useful both for people who are aware of monorepos and build tools, and those who aren’t: any and all feedback welcome!
witty-crayon-22786
10/29/2020, 9:28 PMthe demo is ready! https://github.com/pantsbuild/pants/pull/11080 going to convert to gifs and then post as a draft
witty-crayon-22786
10/29/2020, 9:30 PMalso “fun”: this recording results in a crystal clear repro of the bug from https://github.com/pantsbuild/pants/issues/10129 ! i edited it out, but will follow up to add info to the ticket and fix that 😃 cc @hundreds-breakfast-49010
h
hundreds-breakfast-49010
10/29/2020, 9:31 PMinteresting
hundreds-breakfast-49010
10/29/2020, 9:31 PMhopefully reproducable in a way that lends itself ot an easy fix?
w
witty-crayon-22786
10/29/2020, 10:05 PMyea! i think that i have a good idea of what is going on.
witty-crayon-22786
10/29/2020, 10:47 PMa (final?) draft of this! feedback welcome: https://blog.pantsbuild.org/dependency-inference/ … in particular, does the demo make sense?
witty-crayon-22786
10/29/2020, 10:47 PMalso… title?
witty-crayon-22786
10/29/2020, 10:47 PMcc @hundreds-father-404, @hundreds-breakfast-49010, @fast-nail-55400, @polite-garden-50641
h
hundreds-father-404
10/29/2020, 10:49 PMalso… title?Do we need dependency information at all for “concurrency” and “remoting”? I’m thinking it may be more descriptive and focused to say:
Dependency inference: fine-grained caching without the boilerplate
hundreds-father-404
10/29/2020, 10:50 PMNote that lots of folks don’t know what “remoting” means. I think this suggested title is more accessible, that you can easily see what the article is gonna be about
(Also, nit to lowercase the “inference”)
👍 1
w
witty-crayon-22786
10/29/2020, 10:51 PMyep, you need it for concurrency, because you need to know what depends on what. for example, if we actually partitioned mypy by file, we’d be able to run dozens of instances at once because we know which files depend on which other files
witty-crayon-22786
10/29/2020, 10:52 PM(if you view the JSON cache as the “output” of compilation then you can think of mypy as a compiler. and definitely the case for compilers in general)
witty-crayon-22786
10/29/2020, 10:54 PMand yes, absolutely for remoting as well. it’s how you know what needs to be in the sandbox to run.
witty-crayon-22786
10/29/2020, 10:57 PMbut i’ll drop remoting.
👍 1
witty-crayon-22786
10/29/2020, 11:13 PMHN title:
Dependency inference in Pants v2: Precise caching without the boilerplate👍 1
witty-crayon-22786
10/29/2020, 11:14 PM