src.util.pathsΒΆ

paths.py

Utility function for initializing the appropriate directories/sub-directories on the start of each run. Decoupled from main code in case we want separate directory structures/artifact storage based on infrastructure (e.g., NLP Cluster vs. GCP).

Functions

create_paths

Create the necessary directories and sub-directories conditioned on the run_id, checkpoint directory, and cache directories.

set_permissions

Recursively call `os.chmod(775) recursively for the given paths.