Skip to content

print warning if actual triton cache dir is on NFS, not just for default - #6487

Merged
loadams merged 1 commit into
deepspeedai:masterfrom
jrandall:fix-6486-triton-cache-dir-nfs-warning
Sep 4, 2024
Merged

print warning if actual triton cache dir is on NFS, not just for default#6487
loadams merged 1 commit into
deepspeedai:masterfrom
jrandall:fix-6486-triton-cache-dir-nfs-warning

Conversation

@jrandall

@jrandall jrandall commented Sep 4, 2024

Copy link
Copy Markdown
Contributor

move the logic that prints a warning when triton cache dir is on NFS to act on the actual calculated cache_dir rather than on the default.

this means that:

  • when the default directory (in the user's home directory) is on NFS but TRITON_CACHE_DIR is set to a non-NFS directory, no warning will be printed whereas prior to this change a spurious and confusing warning was printed
  • when the user's home directory is not on NFS but TRITON_CACHE_DIR is set to an NFS directory, a warning will be printed whereas prior to this change no warning would be printed

fixes #6486

@tjruwase
tjruwase requested review from tohtana and removed request for arashb and awan-10 September 4, 2024 15:18
@tohtana

tohtana commented Sep 4, 2024

Copy link
Copy Markdown
Collaborator

@jrandall Thank you for the contribution!

@loadams
loadams added this pull request to the merge queue Sep 4, 2024
Merged via the queue into deepspeedai:master with commit 9d17116 Sep 4, 2024
mauryaavinash95 pushed a commit to DataStates/DeepSpeed that referenced this pull request Mar 20, 2025
…ult (deepspeedai#6487)

move the logic that prints a warning when triton cache dir is on NFS to
act on the actual calculated cache_dir rather than on the default.

this means that:
- when the default directory (in the user's home directory) is on NFS
but `TRITON_CACHE_DIR` is set to a non-NFS directory, no warning will be
printed whereas prior to this change a spurious and confusing warning
was printed
- when the user's home directory is not on NFS but `TRITON_CACHE_DIR` is
set to an NFS directory, a warning will be printed whereas prior to this
change no warning would be printed
 
fixes deepspeedai#6486
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

[BUG] deepspeed prints a warning when the user's home directory is on NFS even when TRITON_CACHE_DIR is set to a non-NFS directory

3 participants