Got a bit stuck again with trying to get django's ...
# generalb
big-fall-51153
05/27/2021, 2:04 PMGot a bit stuck again with trying to get django's
manage.pyrunbig-fall-51153
05/27/2021, 2:05 PMmost of the commands seem to work, but the
runservermanage.py shellbig-fall-51153
05/27/2021, 2:06 PMI am seeing a really weird behavior with how that script appears to be executed - I'm seeing it loaded twice
big-fall-51153
05/27/2021, 2:08 PMthis might be some weird django-specific behavior though
big-fall-51153
05/27/2021, 2:09 PMUntitled.py
big-fall-51153
05/27/2021, 2:10 PMGiven the above version of
manage.py Copy code
λ › ./pants django-run tests:manage -- check odl/ol-django nl/pants-t2
LOAD
RUN
System check identified no issues (0 silenced). Copy code
λ › ./pants django-run tests:manage -- runserver odl/ol-django nl/pants-t2
LOAD
RUN
LOAD
RUNbig-fall-51153
05/27/2021, 2:12 PMah, ok, answered my own question - django uses two processes to support code reloading
big-fall-51153
05/27/2021, 2:12 PMso disabling reloading, it works:
big-fall-51153
05/27/2021, 2:13 PM Copy code
λ › ./pants django-run tests:manage -- runserver --noreload odl/ol-django nl/pants-t2
LOAD
RUN
Performing system checks...big-fall-51153
05/27/2021, 2:13 PMI'm guessing that this is due to
PYTHONPATHbig-fall-51153
05/27/2021, 2:14 PMand I'm not sure if this is also a contributor, but I found I had to add
execution_mode="venv"pex_binarymanage.pybig-fall-51153
05/27/2021, 2:25 PMthe problem
venvImportErrormanage.pyPYTOHNPATHb
busy-vase-39202
05/27/2021, 2:35 PMThanks for documenting your fix!
b
big-fall-51153
05/27/2021, 2:39 PMI think it only papered over the problem unfortunately. The forked process still can't import anything that pants is adding to the path
big-fall-51153
05/27/2021, 6:03 PMOk, so I was able to find the source for the django command where it forks, which I believe is here: https://github.com/django/django/blob/02c59b7a4355fda8c99224b5de9c0a3929bffe22/django/utils/autoreload.py#L260
big-fall-51153
05/27/2021, 6:06 PMI've been able to hack a working solution by futzing with
sys.pathmanage.pybig-fall-51153
05/27/2021, 6:08 PMok, so a few things going on here, if I don't run in
venvmanage.pybig-fall-51153
05/27/2021, 6:09 PMonce I turn that mode on, then it fails because it can't find certain packages that are in another source root, because that second source root isn't in
sys.pathbig-fall-51153
05/27/2021, 6:11 PMso for debugging purposes (this is also my hack to fix it), I put this at the top of `manage.py`:
Copy code
print("=============================")
print(sys.path)
for path in os.environ.get("PEX_EXTRA_SYS_PATH", "").split(":"):
if path not in sys.path:
sys.path.append(path)
print(sys.path)big-fall-51153
05/27/2021, 6:13 PMThis is the output from that, you can see several things are dropped from the forked process, but as long as I add at least
src/big-fall-51153
05/27/2021, 6:15 PMthis is probably the limits of my knowledge of python paths and threading, but the hack works for now
h
happy-kitchen-89482
05/28/2021, 1:12 AMI have been able to get runserver working with --noreload, as you have, without issues, but I will look over your logs and see if anything stands out.
happy-kitchen-89482
05/28/2021, 1:12 AMThe reloading mechanism does indeed cause the script to reenter itself, as you deduced
happy-kitchen-89482
05/28/2021, 1:12 AMAnd I've had issues in the past with getting that working in a sandbox
b
big-fall-51153
05/28/2021, 1:28 AMAmending the path seems to work
big-fall-51153
05/28/2021, 1:29 AMObviously not ideal though. Fortunately this is a test app, not a production one
h
happy-kitchen-89482
05/28/2021, 6:23 PMYeah, I don't see a way around having all your source roots on sys.path, if you want to run directly from those sources.
happy-kitchen-89482
05/28/2021, 6:24 PMCan you do this via PYTHONPATH?
b
big-fall-51153
05/28/2021, 6:30 PMI probably could, although for the use case I have, this script will only ever be run for local development purposes on this particular project, so hacking
sys.path6 Views