Repository navigation

bpo-33639: use high-performance os.sendfile() in shutil.copy* - #7100

Closed

giampaolo wants to merge 44 commits into

masterfrom

shutil-copyfile-sendfile

Closed

bpo-33639: use high-performance os.sendfile() in shutil.copy*#7100
giampaolo wants to merge 44 commits into
masterfrom
shutil-copyfile-sendfile

Commits on May 22, 2018
- have shutil.copyfileobj use sendfile() if possible
  giampaolo
  committed
  1a72c01
- refactoring: use ctx manager
  giampaolo
  committed
  77c4bfa
- add test with non-regular file obj
  giampaolo
  committed
  2afa04a
- emulate case where file size can't be determined
  giampaolo
  committed
  542cd17
- reference _copyfileobj_sendfile directly
  giampaolo
  committed
  3520c6c
- add test for offset() at certain position
  giampaolo
  committed
  050a722
- add test for empty file
  giampaolo
  committed
  c1fd38a
- add test for non regular file dst
  giampaolo
  committed
  2ab6317
- small refactoring
  giampaolo
  committed
  dacc3b6
Commits on May 24, 2018
- leave copyfileobj() alone in order to not introduce any incompatibility
  giampaolo
  committed
  29d5881
- minor refactoring
  giampaolo
  committed
  114c4de
- remove old test
  giampaolo
  committed
  501c0dd
- update docstring
  giampaolo
  committed
  41b4506
- update docstring; rename exception class
  giampaolo
  committed
  fdb0973
- detect platforms which only support file to socket zero copy
  giampaolo
  committed
  64d2bc5
- don't run test on platforms where file-to-file zero copy is not supported
  giampaolo
  committed
  3a3c8ef
- use tempfiles
  giampaolo
  committed
  7861737
- reset verbosity
  giampaolo
  committed
  f3eecfd
- add test for smaller chunks
  giampaolo
  committed
  f67ce57
- add big file size test
  giampaolo
  committed
  d457254
- add comment
  giampaolo
  committed
  8eb211d
- update doc
  giampaolo
  committed
  a0fe703
- update whatsnew doc
  giampaolo
  committed
  7296147
- update doc
  giampaolo
  committed
  d0c3bba
- catch Exception
  giampaolo
  committed
  2cafd80
- remove unused import
  giampaolo
  committed
  bb2a75f
- add test case for error on second sendfile() call
  giampaolo
  committed
  e5025dc
- turn docstring into comment
  giampaolo
  committed
  a36a534
- add one more test
  giampaolo
  committed
  e9da3fa
- update comment
  giampaolo
  committed
  9fcc2e7
- add Misc/NEWS entry
  giampaolo
  committed
  4f32242
Commits on May 25, 2018
- get rid of COPY_BUFSIZE; it belongs to another PR
  giampaolo
  committed
  24ad25a
- update doc
  giampaolo
  committed
  24d20e6
- set min bufsize to either 8MB or 128MB
  giampaolo
  committed
  8380b9b
- fix test
  giampaolo
  committed
  081f907
Commits on May 26, 2018
- make sendfile() raise immediately if filesystem is full on first call
  giampaolo
  committed
  5c242f3
- use sendfile() only on Linux
  giampaolo
  committed
  470dba8
- raise err from None
  giampaolo
  committed
  cbc79e1
Commits on May 27, 2018
- remove 'total' variable; it's not necessary
  giampaolo
  committed
  5ac745a
- check out file position as an extra method to determine whether some (partial) data was copied
  giampaolo
  committed
  eb1edd3
- refactoring
  giampaolo
  committed
  f83a990
- test refactoring: move utility function out of test class
  giampaolo
  committed
  7905991
- add assert
  giampaolo
  committed
  6ac06c1
- remove unused class attribute
  giampaolo
  committed
  9373b4c

Commits

Commits on May 22, 2018

Commits on May 24, 2018

Commits on May 25, 2018

Commits on May 26, 2018

Commits on May 27, 2018