Skip to content

Cache storage limit exceeded when storing a cache that's under 10GB  #2

Open
actions/cache
#1337

Description

@marco-cpd

Hi all,

It seems there's an issue with the total expected cache size when using buildjet along with buildjets caching action.

For some reason, I get this error:

Screenshot 2024-02-13 at 8 54 45 AM
Warning: Failed to save: Cache size of ~6148 MB (6446280578 B) is over the 10GB limit, not saving cache.
Cache saved with key: docker-image-cache4-Linux

However, if I switch the caching action to use: runs-on: ubuntu-latest along with uses: actions/cache@v4 then it works as expected. Example:

Screenshot 2024-02-13 at 8 45 41 AM

Working:

    ---
    name: Test 
    
    on: [ pull_request ]
    
    permissions:
      id-token: write
      contents: read
    
    jobs:
      test:
        env:
          CI: true
    
        runs-on: ubuntu-latest
    
        steps:
          - name: Free Disk Space (Ubuntu)
            uses: jlumbroso/[email protected]
    
          - run: mkdir -p ~/docker-image-cache
    
          - id: docker-image-cache
            uses: actions/cache@v4
            with:
                path: ~/docker-image-cache
                key: docker-image-cache4-${{ runner.os }}          
    
          - name: Git checkout my app repos
            uses: myorg/repoName/.github/actions/checkout@v3
    
          - name: Load cache for docker images
            if: steps.docker-image-cache.outputs.cache-hit == 'true'
            run: |
                docker load -i ~/docker-image-cache/myOrgImage1.tar
                docker load -i ~/docker-image-cache/myOrgImage2.tar
                docker load -i ~/docker-image-cache/myOrgImage3.tar
                docker load -i ~/docker-image-cache/myOrgImage4.tar
                docker load -i ~/docker-image-cache/myOrgImage5.tar
    
          - name: Pull the docker images 
            run:  |  
                 cd testApp
                 make pull-images
    
          - name: Create cache for docker images
            if: steps.docker-image-cache.outputs.cache-hit != 'true'
            run: |
                docker image list --format "{{ .Repository }}:{{ .Tag }}"
                docker save -o ~/docker-image-cache/myOrgImage1.tar $(docker image list --format "{{ .Repository }}:{{ .Tag }}" | grep "myOrgImage1")
                docker save -o ~/docker-image-cache/myOrgImage2.tar $(docker image list --format "{{ .Repository }}:{{ .Tag }}" | grep "myOrgImage2")
                docker save -o ~/docker-image-cache/myOrgImage3.tar $(docker image list --format "{{ .Repository }}:{{ .Tag }}" | grep "myOrgImage3")
                docker save -o ~/docker-image-cache/myOrgImage4.tar $(docker image list --format "{{ .Repository }}:{{ .Tag }}" | grep "myOrgImage4")
                docker save -o ~/docker-image-cache/myOrgImage5.tar $(docker image list --format "{{ .Repository }}:{{ .Tag }}" | grep "myOrgImage5")

Not working:

      ---
      name: Test
      
      on: [ pull_request ]
      
      permissions:
        id-token: write
        contents: read
      
      jobs:
        test:
          env:
            CI: true
      
          runs-on: buildjet-4vcpu-ubuntu-2204
      
          steps:
            - name: Free Disk Space (Ubuntu)
              uses: jlumbroso/[email protected]
      
            - run: mkdir -p ~/docker-image-cache
      
            - id: docker-image-cache
              uses: buildjet/cache@v4
              with:
                  path: ~/docker-image-cache
                  key: docker-image-cache4-${{ runner.os }}          
      
            - name: Git checkout my app repos
              uses: myorg/repoName/.github/actions/checkout@v3
      
            - name: Load cache for docker images
              if: steps.docker-image-cache.outputs.cache-hit == 'true'
              run: |
                  docker load -i ~/docker-image-cache/myOrgImage1.tar
                  docker load -i ~/docker-image-cache/myOrgImage2.tar
                  docker load -i ~/docker-image-cache/myOrgImage3.tar
                  docker load -i ~/docker-image-cache/myOrgImage4.tar
                  docker load -i ~/docker-image-cache/myOrgImage5.tar
      
          - name: Pull the docker images 
            run:  |  
                 cd testApp
                 make pull-images
      
            - name: Create cache for docker images
              if: steps.docker-image-cache.outputs.cache-hit != 'true'
              run: |
                  docker image list --format "{{ .Repository }}:{{ .Tag }}"
                  docker save -o ~/docker-image-cache/myOrgImage1.tar $(docker image list --format "{{ .Repository }}:{{ .Tag }}" | grep "myOrgImage1")
                  docker save -o ~/docker-image-cache/myOrgImage2.tar $(docker image list --format "{{ .Repository }}:{{ .Tag }}" | grep "myOrgImage2")
                  docker save -o ~/docker-image-cache/myOrgImage3.tar $(docker image list --format "{{ .Repository }}:{{ .Tag }}" | grep "myOrgImage3")
                  docker save -o ~/docker-image-cache/myOrgImage4.tar $(docker image list --format "{{ .Repository }}:{{ .Tag }}" | grep "myOrgImage4")
                  docker save -o ~/docker-image-cache/myOrgImage5.tar $(docker image list --format "{{ .Repository }}:{{ .Tag }}" | grep "myOrgImage5")

Activity

  1. changed the title [-]Cache storage limit exceeded when under 10GB [/-] [+]Cache storage limit exceeded when storing cache under 10GB [/+] on Feb 13, 2024
  2. changed the title [-]Cache storage limit exceeded when storing cache under 10GB [/-] [+]Cache storage limit exceeded when storing a cache that's under 10GB [/+] on Feb 13, 2024
  3. marco-cpd commented on Mar 6, 2024

    @marco-cpd
    Author

    @Endrix1369 Did ya mean to add something to that comment? It seems like a blank comment

  4. deleted a comment from Endrix1369 on Mar 25, 2024
  5. deleted a comment from Endrix1369 on Mar 25, 2024
  6. deleted a comment from Endrix1369 on Mar 25, 2024
  7. deleted a comment from Endrix1369 on Mar 25, 2024
  8. deleted a comment from Endrix1369 on Mar 25, 2024
  9. deleted a comment from Endrix1369 on Mar 25, 2024
  10. deleted a comment from Endrix1369 on Mar 25, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions