is it because integration tests don't necessarily import the source files that affect their output?

That could be, but where, from Pants perspective, "don't import" materializes as don't (BUILD) depend on.