Commits

Commit history

1. Commits on Nov 2, 2023

   • Remove unnecessary includes (GH-111633)

     serhiy-storchaka

     authored
     a12f624View commit details

     Copy full SHA for a12f624

     View code at this pointBrowse repository at this point
2. Commits on Oct 11, 2023

   • gh-104169: Refactor tokenizer into lexer and wrappers (#110684)

     Show description for 01481f2
     

     3 peopleauthored
     01481f2View commit details

     Copy full SHA for 01481f2

     View code at this pointBrowse repository at this point
3. Commits on Jul 26, 2023

   • gh-107015: Remove async_hacks from the tokenizer (#107018)

     pablogsal

     authored
     da8f87bView commit details

     Copy full SHA for da8f87b

     View code at this pointBrowse repository at this point
4. Commits on Jun 9, 2023

   • gh-105564: Don't include artificial newlines in the line attribute of tokens (#105565)

     pablogsal

     authored
     d7f46bcView commit details

     Copy full SHA for d7f46bc

     View code at this pointBrowse repository at this point
5. Commits on Jun 7, 2023

   • gh-105390: Add explicit type cast (#105466)

     Eclips4

     authored
     264a011View commit details

     Copy full SHA for 264a011

     View code at this pointBrowse repository at this point

   • gh-105435: Fix spurious NEWLINE token if file ends with comment without a newline (#105442)

     pablogsal

     authored
     7279fb6View commit details

     Copy full SHA for 7279fb6

     View code at this pointBrowse repository at this point

   • gh-105390: Correctly raise TokenError instead of SyntaxError for tokenize errors (#105399)

     pablogsal

     authored
     ffd2654View commit details

     Copy full SHA for ffd2654

     View code at this pointBrowse repository at this point
6. Commits on Jun 6, 2023

   • gh-105259: Ensure we don't show newline characters for trailing NEWLINE tokens (#105364)

     pablogsal

     authored
     c0a6ed3View commit details

     Copy full SHA for c0a6ed3

     View code at this pointBrowse repository at this point
7. Commits on May 30, 2023

   • gh-105042: Disable unmatched parens syntax error in python tokenize (#105061)

     lysnikolaou

     authored
     70f315cView commit details

     Copy full SHA for 70f315c

     View code at this pointBrowse repository at this point

   • gh-105069: Add a readline-like callable to the tokenizer to consume input iteratively (#105070)

     pablogsal

     authored
     9216e69View commit details

     Copy full SHA for 9216e69

     View code at this pointBrowse repository at this point
8. Commits on May 28, 2023

   • gh-105017: Include CRLF lines in strings and column numbers (#105030)

     Show description for 96fff35
     

     mgmacias95

     and

     pablogsal

     authored
     96fff35View commit details

     Copy full SHA for 96fff35

     View code at this pointBrowse repository at this point
9. Commits on May 26, 2023

   • gh-104976: Ensure trailing dedent tokens are emitted as the previous tokenizer (#104980)

     Show description for 46b52e6
     pablogsal

     authored
     46b52e6View commit details

     Copy full SHA for 46b52e6

     View code at this pointBrowse repository at this point

   • gh-104972: Ensure that line attributes in tokens in the tokenize module are correct (#104975)

     pablogsal

     authored
     3fdb55cView commit details

     Copy full SHA for 3fdb55c

     View code at this pointBrowse repository at this point
10. Commits on May 24, 2023

    • gh-104825: Remove implicit newline in the line attribute in tokens emitted in the tokenize module (#104846)

      pablogsal

      authored
      c8cf9b4View commit details

      Copy full SHA for c8cf9b4

      View code at this pointBrowse repository at this point
11. Commits on May 22, 2023

    • gh-104741: Add line number attribute to indentation error exception (#104743)

      mgmacias95

      authored
      729b252View commit details

      Copy full SHA for 729b252

      View code at this pointBrowse repository at this point

    • gh-102856: Tokenize performance improvement (#104731)

      mgmacias95

      authored
      8817886View commit details

      Copy full SHA for 8817886

      View code at this pointBrowse repository at this point
12. Commits on May 21, 2023

    • gh-102856: Python tokenizer implementation for PEP 701 (#104323)

      Show description for 6715f91
      

      mgmacias95

      and

      pablogsal

      authored
      6715f91View commit details

      Copy full SHA for 6715f91

      View code at this pointBrowse repository at this point
13. Commits on May 5, 2023

    • gh-99113: Add Py_MOD_PER_INTERPRETER_GIL_SUPPORTED (gh-104205)

      Show description for a9c6e06
      ericsnowcurrently

      authored
      a9c6e06View commit details

      Copy full SHA for a9c6e06

      View code at this pointBrowse repository at this point
14. Commits on Apr 19, 2023

    • gh-102856: Initial implementation of PEP 701 (#102855)

      Show description for 1ef61cf
      

      5 peopleauthored
      1ef61cfView commit details

      Copy full SHA for 1ef61cf

      View code at this pointBrowse repository at this point
15. Commits on Oct 6, 2022

    • gh-97973: Return all necessary information from the tokenizer (GH-97984)

      Show description for cbf0afd
      lysnikolaou

      authored
      cbf0afdView commit details

      Copy full SHA for cbf0afd

      View code at this pointBrowse repository at this point
16. Commits on Aug 11, 2022

    • gh-90928: Statically Initialize the Keywords Tuple in Clinic-Generated Code (gh-95860)

      Show description for 6f6a4e6
      ericsnowcurrently

      authored
      6f6a4e6View commit details

      Copy full SHA for 6f6a4e6

      View code at this pointBrowse repository at this point
17. Commits on Feb 11, 2022

    • bpo-46613: Add PyType_GetModuleByDef to the public API (GH-31081)

      Show description for 2049469
      

      encukou

      and

      vstinner

      authored
      2049469View commit details

      Copy full SHA for 2049469

      View code at this pointBrowse repository at this point
18. Commits on Oct 13, 2021

    • bpo-45434: Mark the PyTokenizer C API as private (GH-28924)

      Show description for 713bb19
      vstinner

      authored
      713bb19View commit details

      Copy full SHA for 713bb19

      View code at this pointBrowse repository at this point
19. Commits on Oct 3, 2021

    • Remove trailing spaces. (GH-28706)

      serhiy-storchaka

      authored
      a5a5615View commit details

      Copy full SHA for a5a5615

      View code at this pointBrowse repository at this point
20. Commits on Aug 25, 2021

    • Format the Python-tokenize module and fix exit path (GH-27935)

      pablogsal

      authored
      214c2e5View commit details

      Copy full SHA for 214c2e5

      View code at this pointBrowse repository at this point
21. Commits on Aug 24, 2021

    • Add tests for the C tokenizer and expose it as a private module (GH-27924)

      pablogsal

      authored
      a24676bView commit details

      Copy full SHA for a24676b

      View code at this pointBrowse repository at this point
22. Loading