Currently DVC pipelines use the same module file and have multiple task files calling functions from the module file.
This is not desired behavior as it causes the DVC cache to recompute all the tasks if any changes are made to the shared module file.
We should split the module file up. Possible approaches may be to write the module file's functions directly in the corresponding task file.
Currently DVC pipelines use the same module file and have multiple task files calling functions from the module file.
This is not desired behavior as it causes the DVC cache to recompute all the tasks if any changes are made to the shared module file.
We should split the module file up. Possible approaches may be to write the module file's functions directly in the corresponding task file.