Commits

Commit history

1. Commits on May 29, 2024

   • Add support for multiple referer policy tokens.

     

     Fabian Schneebauer

     committed
     0d58af8View commit details

     Copy full SHA for 0d58af8

     View code at this pointBrowse repository at this point
2. Commits on May 28, 2024

   • Fix overridable methods in MediaPipeline (#6368)

     kumar-sanchay

     authored
     cadb0ddView commit details

     Copy full SHA for cadb0dd

     View code at this pointBrowse repository at this point
3. Commits on May 26, 2024

   • Add change reactor test to CrawlerRunner

     Laerte

     committed
     2facdd4View commit details

     Copy full SHA for 2facdd4

     View code at this pointBrowse repository at this point
4. Commits on May 16, 2024

   • Update expectations of cookies after redirects. (#6367)

     wRAR

     authored
     631fc65View commit details

     Copy full SHA for 631fc65

     View code at this pointBrowse repository at this point
5. Commits on May 15, 2024

   • Allow user-defined secure cookies (#6357)

     Gallaecio

     authored
     812fd23View commit details

     Copy full SHA for 812fd23

     View code at this pointBrowse repository at this point
6. Commits on May 14, 2024

   • Merge 2.11.2 changes (#6363)

     Gallaecio

     authored
     d2f1e00View commit details

     Copy full SHA for d2f1e00

     View code at this pointBrowse repository at this point
7. Commits on May 13, 2024

   • Add SpiderLoggerAdapter, change Spider.logger to return SpiderLoggerAdapter (#6324)

     bloodforcream

     authored
     b88f22cView commit details

     Copy full SHA for b88f22c

     View code at this pointBrowse repository at this point
8. Commits on May 10, 2024

   • Add Downloader.get_slot_key() without a spider parameter (#6352)

     kumar-sanchay

     authored
     c9ef520View commit details

     Copy full SHA for c9ef520

     View code at this pointBrowse repository at this point
9. Commits on May 8, 2024

   • Closes #6342. Setting METAREFRESH_IGNORE_TAGS to [‘noscript’] by default

     aisha-partha

     committed
     180bc9bView commit details

     Copy full SHA for 180bc9b

     View code at this pointBrowse repository at this point
10. Commits on Apr 19, 2024

    • Merge pull request #6221 from jxlil/fix/LxmlLinkExtractor

      Show description for a5da77d
      wRAR

      authored
      a5da77dView commit details

      Copy full SHA for a5da77d

      View code at this pointBrowse repository at this point
11. Commits on Apr 17, 2024

    • Fix test expectations (#6316)

      

      kokobhara

      authored
      b1fe97dView commit details

      Copy full SHA for b1fe97d

      View code at this pointBrowse repository at this point
12. Commits on Apr 8, 2024

    • Fix WrappedRequest.get_header raising TypeError if default is None (#6310)

      VMRuiz

      authored
      48c5a8cView commit details

      Copy full SHA for 48c5a8c

      View code at this pointBrowse repository at this point
13. Commits on Apr 5, 2024

    • Merge pull request #6298 from lorenzoverardo/bug-6292/robots.txt-non-UTF-8

      Show description for 5d31e89
      wRAR

      authored
      5d31e89View commit details

      Copy full SHA for 5d31e89

      View code at this pointBrowse repository at this point
14. Commits on Apr 4, 2024

    • Handle robots.txt files not UTF-8 encoded

      lorenzoverardo

      committed
      7b37dcdView commit details

      Copy full SHA for 7b37dcd

      View code at this pointBrowse repository at this point
15. Commits on Apr 1, 2024

    • modified string's concat to f-strings (#6296)

      igeni

      authored
      f7bf3f7View commit details

      Copy full SHA for f7bf3f7

      View code at this pointBrowse repository at this point
16. Commits on Mar 14, 2024

    • Run black.

      wRAR

      committed
      8d917c0View commit details

      Copy full SHA for 8d917c0

      View code at this pointBrowse repository at this point

    • Merge branch 'master' into master

      wRAR

      authored
      5bf0e1dView commit details

      Copy full SHA for 5bf0e1d

      View code at this pointBrowse repository at this point

    • Merge pull request #6231 from elramen/check_command_tests

      Show description for 7255dfd
      wRAR

      authored
      7255dfdView commit details

      Copy full SHA for 7255dfd

      View code at this pointBrowse repository at this point
17. Commits on Mar 13, 2024

    • Remove tests/requirements.txt and refactor extra deps (#6272)

      Show description for 4460d3e
      

      lucas-belo

      and

      lucasbelo777

      authored
      4460d3eView commit details

      Copy full SHA for 4460d3e

      View code at this pointBrowse repository at this point
18. Commits on Mar 12, 2024

    • Merge pull request #6290 from Gallaecio/fix-skips

      Show description for 95a70d3
      wRAR

      authored
      95a70d3View commit details

      Copy full SHA for 95a70d3

      View code at this pointBrowse repository at this point

    • Allow disabling the AutoThrottle extension for a given slot (#6246)

      Gallaecio

      authored
      d7581c6View commit details

      Copy full SHA for d7581c6

      View code at this pointBrowse repository at this point

    • Add super

      Gallaecio

      committed
      e72de11View commit details

      Copy full SHA for e72de11

      View code at this pointBrowse repository at this point
19. Commits on Mar 11, 2024

    • Remove unnecessary comment

      Gallaecio

      committed
      188d9a8View commit details

      Copy full SHA for 188d9a8

      View code at this pointBrowse repository at this point

    • Fix WindowsRunSpiderCommandTest skip outside Windows for older Twisted.

      Gallaecio

      committed
      ab5ea32View commit details

      Copy full SHA for ab5ea32

      View code at this pointBrowse repository at this point

    • Fix some comments (#6285)

      Show description for 6e84648
      

      pengqiseven

      and

      pengqiseven

      authored
      6e84648View commit details

      Copy full SHA for 6e84648

      View code at this pointBrowse repository at this point
20. Commits on Mar 6, 2024

    • Use brotlicffi for PyPy

      Laerte

      committed
      532cd2eView commit details

      Copy full SHA for 532cd2e

      View code at this pointBrowse repository at this point
21. Commits on Mar 5, 2024

    • Add brotlicffi support

      Laerte

      committed
      cab1016View commit details

      Copy full SHA for cab1016

      View code at this pointBrowse repository at this point
22. Commits on Feb 29, 2024

    • Regenerate the expired mitmproxy-ca.pem.

      wRAR

      committed
      1311e7dView commit details

      Copy full SHA for 1311e7d

      View code at this pointBrowse repository at this point

    • fix: Proxy tests don't use custom certificate authority

      Laerte

      committed
      2169810View commit details

      Copy full SHA for 2169810

      View code at this pointBrowse repository at this point
23. Commits on Feb 28, 2024

    • Fix tests

      Laerte

      committed
      26a16f2View commit details

      Copy full SHA for 26a16f2

      View code at this pointBrowse repository at this point

    • Bump pylint, cleanup the ignored tags.

      wRAR

      committed
      4f9dd99View commit details

      Copy full SHA for 4f9dd99

      View code at this pointBrowse repository at this point

    • Bump black.

      wRAR

      committed
      282767fView commit details

      Copy full SHA for 282767f

      View code at this pointBrowse repository at this point
24. Commits on Feb 27, 2024

    • Complete coverage for the AutoThrottle extension (#6245)

      Gallaecio

      authored
      2d46b4aView commit details

      Copy full SHA for 2d46b4a

      View code at this pointBrowse repository at this point
25. Commits on Feb 26, 2024

    • Remove usage of deprecated mktemp (#5285)

      darakian

      authored
      b0ef9a8View commit details

      Copy full SHA for b0ef9a8

      View code at this pointBrowse repository at this point
26. Commits on Feb 22, 2024

    • Add support for multiple-compressed responses (#6063)

      vishesh10

      authored
      e208f82View commit details

      Copy full SHA for e208f82

      View code at this pointBrowse repository at this point