https://pantsbuild.org/ logo
#general
Title
# general
r

rapid-crayon-8232

06/11/2020, 10:48 PM
Hey, we've been using pants v2 for about two weeks now for all our ML/DL stuff, and it's been awsome πŸ”₯πŸ”₯, no major problems identified, just by following the docs, I was able to have a working linter/formatter and ci pipeline easily so kudos for that too, one thing that I miss dearly for a data science project is to use jupyter notebooks, I know that Ipython is supported so jupyter should theoritically should easy to add too ( maybe as a plugin ? ). Another minor thing is the time taken to re-resolving of all dependencies when running tests or binaries, (usually 10 mins per target, with multiple targets having the same deps...), but as I've it's only minor, since having a warm cache usually speeds up stuff greatly
❀️ 2
πŸ‘– 2
h

hundreds-father-404

06/11/2020, 10:52 PM
Yay! Great to hear about your experience! Agreed on Jupyter. Did you have a v1 plugin to do this? Also agreed on the time to resolve dependencies. Are you using 1.29? We made an initial improvement to speed things up through better caching. But it’s still not ideal. This is our biggest performance priority before we launch Pants 2.0
r

rapid-crayon-8232

06/11/2020, 11:04 PM
nope, no plugin πŸ˜…, I used to do a hack by just adding the pyprep deps and sources to sys.path on top of my notebook .... as I've said just a hack ahah Cool for the speedups, looking forward to it, yep we are using rc0 of 1.29 right now
πŸ‘ 1
h

happy-kitchen-89482

06/11/2020, 11:21 PM
Thanks for the feedback @rapid-crayon-8232! Resolver performance is indeed our biggest priority. Jupyter support has come up before, I'd be interested in hearing what you think this should look like, from a user perspective.
f

flat-zoo-31952

06/12/2020, 10:10 AM
the notebook thing is kinda complicated...they main difference between an ipython repl and a notebook is that the notebook is actually multiple python processes: one server/launcher that will start "kernels" (other python interpreters) on demand. It's fairly easy to build an juputer notebook server executable with the
jupyter.notebookapp:main
entry point, but this server can't successfully start other python kernels
πŸ‘ 1
i suspect we'll need to write some kind of alternate kernel launch type that makes it aware and capable of using pants commands (or at least the pyprep deps as mentioned above) when it creates kernels
w

witty-crayon-22786

06/12/2020, 5:11 PM
this is definitely an important area. i’d love to help get native support in place.
it might not be a 2.0 blocker (maybe folks would disagree?), but in the weeks following
πŸ‘ 1
h

hundreds-father-404

06/12/2020, 5:14 PM
I’d advocate it being something like a 2.1 feature so that we can focus on releasing 2.0 sooner and ensuring it’s stable and polished
f

flat-zoo-31952

06/12/2020, 5:51 PM
this is an important feature, but it's covering a totally new use case, i wouldn't make it into a blocker for something
πŸ‘ 1