also here: <
# development
also here: native backend invalidation errors were happening because i don't think v1 products are mixed into the task fingerprint? so if a
option changing invalidated the compile/link tasks, it didn't invalidate the downstream python dist build task which depends on the linked shared libraries. this has been a consistent caching error in the native backend endemic to the model of using two or more tasks which act in the same product pipeline but which act on different targets. ways to fix this: (1) mix product dependencies into downstream task fingerprints, potentially hashing the actual product values themselves too (2) we rewrite the native backend in v2. this is unrelated to the c++ binary/test work i've discussed but if i get around to that it actually might be super great and easy to rewrite those tasks in v2 along the way, especially because then any task can immediately consume the output of the c++ backend, not just python_dist(), with the greatest of ease (e.g. rust support). you can do that in v1 but in v1 you can't have cyclic dependencies, so native code only goes in one direction (we have things like
in the repo which hack around that) and the idea of having C++ depending on a Rust API which may depend on some C++ code underneath is the most absurd native development experience imho, and is achievable with the thoughtful application of the v2 engine
Is proposal 2: “we rewrite to v2” or “we rewrite in v2”. Very different proposals
i do not understand that distinction
i was thinking rewrite the relevant parts in v2 tasks going in topological order as we add e.g. executable binaries to the things we can link
“We rewrite to v2” -> we keep the semantics the same but port to v2 “We rewrite in v2” -> we redesign the system while porting to v2
sure but the thing is the native backend only touches one thing right now which is the python_dist() backend
and if there are no connections outwards this then becomes refactoring
this is why i wrote
like this
so v2 doesn't change the semantics because they are the semantics and the tasks are the links to the v1 engine
👍 1