Pants monorepo for a company is not as attractive as Bazel m

Question

Pants monorepo for a company is not as attractive as Bazel monorepo Python is the first class language of Pants Modern Data ML Stack relies heavily on Python Let Data ML dance with Pants

happy-kitchen-89482 · Answer

We do have a lot of use in the data science space and those use cases are one of the reasons we focused on Python initially and then Scala next

happy-kitchen-89482 · Answer

I d argue that Pants is a better choice for many other areas as well but Data Science ML is where we should really shine

happy-kitchen-89482 · Answer

However not many of the core Pants maintainers have much personal data science experience as a user so we welcome suggestions designs etc

bored-energy-25252 · Answer

I think the most important thing for Pants on Data ML is adding SQL support now

happy-kitchen-89482 · Answer

What kind of SQL support would be useful

bored-energy-25252 · Answer

Just like the shell language support format and lint is good enough for the sql language Using SQL Lint tool like <https docs sqlfluff com en stable >

bored-energy-25252 · Answer

For Data Engineering we care about Redshift SQL Spark SQL Google BigQuery It is covered in sqlfluff <https docs sqlfluff com en stable dialects html>

bored-energy-25252 · Answer

And for backend purpose an integration with flyway would be a great next step

bored-energy-25252 · Answer

Things like dependency inference are called sql lineage <https github com reata sqllineage> This is the third step

bored-energy-25252 · Answer

dbt is the super star in data stack using SQL and Python

bored-energy-25252 · Answer

happy-kitchen-89482 · Answer

That s all great info

happy-kitchen-89482 · Answer

Would you mind opening a ticket for this with all those links and details

happy-kitchen-89482 · Answer

Then we can track it