Hi,
After migration from AppEngine NDB to Cloud NDB sometimes we are getting errors like:
google.api_core.exceptions.RetryError: Maximum number of 3 retries exceeded while calling functools.partial(<function _transaction_async at 0x3e30c4105cb0>, Context(client=<google.cloud.ndb.client.Client object at 0x3e30c32f0b10>, namespace=None, eventloop=<google.cloud.ndb._eventloop.EventLoop object at 0x3e30c75eaf90>, batches={<class 'google.cloud.ndb._datastore_api._LookupBatch'>: {}}, commit_batches={}, transaction=None, cache={Key('_AE_Pipeline_Record', '28f3ddf2f1f745bc88ebb93bb73294bf'): ...}, global_cache=None, on_commit_callbacks=None, legacy_data=True), <function _PipelineContext.transition_retry.<locals>.txn at 0x3e30c2b21ef0>, read_only=False), last exception: 503 Received RST_STREAM with error code 7
at retry_wrapper (/env/lib/python3.7/site-packages/google/cloud/ndb/_retry.py:87)
at _advance_tasklet (/env/lib/python3.7/site-packages/google/cloud/ndb/tasklets.py:315)
at check_success (/env/lib/python3.7/site-packages/google/cloud/ndb/tasklets.py:140)
at result (/env/lib/python3.7/site-packages/google/cloud/ndb/tasklets.py:193)
at transaction (/env/lib/python3.7/site-packages/google/cloud/ndb/_transaction.py:72)
...
The important bit is cache={Key('_AE_Pipeline_Record', '28f3ddf2f1f745bc88ebb93bb73294bf'): ...} where all of the entities in the cache are dumped into the error message and find their way to the logs. This is quite a big security issue for us as we have quite permissive access to logs, while access to entities is strictly controlled and there may be some confidential information.
Lib version: google-cloud-ndb==1.3.0
Hi,
After migration from AppEngine NDB to Cloud NDB sometimes we are getting errors like:
The important bit is
cache={Key('_AE_Pipeline_Record', '28f3ddf2f1f745bc88ebb93bb73294bf'): ...}where all of the entities in the cache are dumped into the error message and find their way to the logs. This is quite a big security issue for us as we have quite permissive access to logs, while access to entities is strictly controlled and there may be some confidential information.Lib version: google-cloud-ndb==1.3.0