I don't see it anywhere in the doc, but it looks l...
# generalp
powerful-eye-58407
05/26/2023, 2:27 PMI don't see it anywhere in the doc, but it looks like pants doesn't work well with directories that contain ":" in the name. Is there a workaround for that?
I have test resources that contain directory named "vessellatestposition" with a bunch of parquet files, that I want to add as resources to my test. I can define a resource including that dir, but pants list doesn't show it, and running tests crashes with:
Copy code
AddressParseException: Failed to parse address spec `(...) /vessel:latest:position:(id)/ (...)`: error at 1:137: expected EOFe
enough-analyst-54434
05/26/2023, 2:28 PMAh, yeah - you've stepped on a land mine there.
p
powerful-eye-58407
05/26/2023, 2:28 PMI thought so:)
e
enough-analyst-54434
05/26/2023, 2:28 PMPants reserves
:h
happy-kitchen-89482
05/26/2023, 2:28 PMGrrrr
happy-kitchen-89482
05/26/2023, 2:29 PMThat is... unfortunate
happy-kitchen-89482
05/26/2023, 2:29 PMA choice we made fairly arbitrarily ~13 years ago is biting you now 😞
e
enough-analyst-54434
05/26/2023, 2:30 PMI think there is no single choice that wouldn't bite someone. This would need an option I think.
h
happy-kitchen-89482
05/26/2023, 2:30 PMYeah, I mean, we did go 13 years until it blew up (that we know of)
e
enough-analyst-54434
05/26/2023, 2:31 PMI think the idea here @powerful-eye-58407 is no one in their right mind uses PATHSEP in a path.
enough-analyst-54434
05/26/2023, 2:32 PMI mean, thinking more, this is exactly why it was chosen.
p
powerful-eye-58407
05/26/2023, 2:32 PMyep, I get that, this is the data we get from the customer, and we are testing a parser as it has to split the path by ":" to extract some ids, not the best choice here... 😄
powerful-eye-58407
05/26/2023, 2:33 PMOK, if this is expected, I will work around this by creating the path in the test on the fly. I just wanted to confirm that's a known issue
powerful-eye-58407
05/26/2023, 2:34 PMthanks for claryfing
f
fast-nail-55400
05/26/2023, 2:43 PMCan you just adjust the data received from the customer as part of any ETL process to not have a colon in the directory name?
fast-nail-55400
05/26/2023, 2:43 PMs/:/__/
fast-nail-55400
05/26/2023, 2:46 PMi.e., maybe have a helper script to unpack and adjust the customer data when committing it to the repo?
p
powerful-eye-58407
05/26/2023, 2:51 PMit's not that easy, but I agree that would be the simplest solution 🙂
24 Views