Commits

Commit history

1. Commits on Oct 13, 2026

   • gh-153569: Simplify tokenizer source views and reader ownership (#158849)

     Show description for f892b11
     pablogsal

     authored
     f892b11View commit details

     Copy full SHA for f892b11

     View code at this pointBrowse repository at this point
2. Commits on Oct 5, 2026

   • gh-153569: Simplify tokenizer state (#158124)

     Show description for 0b8aa89
     pablogsal

     authored
     0b8aa89View commit details

     Copy full SHA for 0b8aa89

     View code at this pointBrowse repository at this point
3. Commits on Sep 12, 2026

   • gh-153569: hide tokenizer state behind token and source operations (#156654)

     Show description for 7bfa97f
     pablogsal

     authored
     7bfa97fView commit details

     Copy full SHA for 7bfa97f

     View code at this pointBrowse repository at this point
4. Commits on Sep 8, 2026

   • gh-153569: centralize formatted-string state and source spans (#156484)

     Show description for 2ddc218
     pablogsal

     authored
     2ddc218View commit details

     Copy full SHA for 2ddc218

     View code at this pointBrowse repository at this point
5. Commits on Sep 6, 2026

   • gh-153569: return token spans and unify decoded source storage (#156482)

     Show description for 09117bc
     pablogsal

     authored
     09117bcView commit details

     Copy full SHA for 09117bc

     View code at this pointBrowse repository at this point
6. Commits on Aug 28, 2026

   • gh-153569: Unify tokenizer input readers (#156472)

     pablogsal

     authored
     f5dbcbaView commit details

     Copy full SHA for f5dbcba

     View code at this pointBrowse repository at this point
7. Commits on Mar 24, 2026

   • gh-128341: Use _Py_ABI_SLOT in stdlib modules (#145770)

     Show description for 1887a95
     

     befeleme

     and

     vstinner

     authored
     1887a95View commit details

     Copy full SHA for 1887a95

     View code at this pointBrowse repository at this point
8. Commits on Mar 11, 2026

   • GH-145247: Use _PyTuple_FromPair in Parser and Python (#145842)

     Show description for d19de37
     sergey-miryanov

     authored
     d19de37View commit details

     Copy full SHA for d19de37

     View code at this pointBrowse repository at this point
9. Commits on Mar 19, 2025

   • gh-111178: Fix function signatures for test_types (#131455)

     vstinner

     authored
     bbe5baaView commit details

     Copy full SHA for bbe5baa

     View code at this pointBrowse repository at this point
10. Commits on Oct 9, 2024

    • gh-115754: Use Py_GetConstant(Py_CONSTANT_EMPTY_STR) (#125194)

      Show description for b9a8ca0
      vstinner

      authored
      b9a8ca0View commit details

      Copy full SHA for b9a8ca0

      View code at this pointBrowse repository at this point
11. Commits on Jul 16, 2024

    • gh-120317: Lock around global state in the tokenize module (#120318)

      Show description for 8549559
      

      lysnikolaou

      and

      pablogsal

      authored
      8549559View commit details

      Copy full SHA for 8549559

      View code at this pointBrowse repository at this point
12. Commits on Jun 12, 2024

    • gh-120343: Fix column offsets of multiline tokens in tokenize (#120391)

      lysnikolaou

      authored
      4b5d3e0View commit details

      Copy full SHA for 4b5d3e0

      View code at this pointBrowse repository at this point
13. Commits on Jun 11, 2024

    • gh-120343: Do not reset byte_col_offset_diff after multiline tokens (#120352)

      Show description for 1b62bce
      

      lysnikolaou

      and

      blurb-it[bot]

      authored
      1b62bceView commit details

      Copy full SHA for 1b62bce

      View code at this pointBrowse repository at this point
14. Commits on May 29, 2024

    • gh-119704: Fix reference leak in the ``Python/Python-tokenize.c`` (#119705)

      Eclips4

      authored
      c0faadeView commit details

      Copy full SHA for c0faade

      View code at this pointBrowse repository at this point
15. Commits on May 28, 2024

    • gh-119118: Fix performance regression in tokenize module (#119615)

      Show description for d87b015
      

      lysnikolaou

      and

      pablogsal

      authored
      d87b015View commit details

      Copy full SHA for d87b015

      View code at this pointBrowse repository at this point
16. Commits on May 3, 2024

    • gh-116322: Add Py_mod_gil module slot (#116882)

      Show description for c2627d6
      swtaarrs

      authored
      c2627d6View commit details

      Copy full SHA for c2627d6

      View code at this pointBrowse repository at this point
17. Commits on Dec 11, 2023

    • gh-112943: Correctly compute end offsets for multiline tokens in the tokenize module (#112949)

      pablogsal

      authored
      a135a6dView commit details

      Copy full SHA for a135a6d

      View code at this pointBrowse repository at this point
18. Commits on Nov 2, 2023

    • Remove unnecessary includes (GH-111633)

      serhiy-storchaka

      authored
      a12f624View commit details

      Copy full SHA for a12f624

      View code at this pointBrowse repository at this point
19. Commits on Oct 11, 2023

    • gh-104169: Refactor tokenizer into lexer and wrappers (#110684)

      Show description for 01481f2
      

      3 peopleauthored
      01481f2View commit details

      Copy full SHA for 01481f2

      View code at this pointBrowse repository at this point
20. Commits on Jul 26, 2023

    • gh-107015: Remove async_hacks from the tokenizer (#107018)

      pablogsal

      authored
      da8f87bView commit details

      Copy full SHA for da8f87b

      View code at this pointBrowse repository at this point
21. Commits on Jun 9, 2023

    • gh-105564: Don't include artificial newlines in the line attribute of tokens (#105565)

      pablogsal

      authored
      d7f46bcView commit details

      Copy full SHA for d7f46bc

      View code at this pointBrowse repository at this point
22. Commits on Jun 7, 2023

    • gh-105390: Add explicit type cast (#105466)

      Eclips4

      authored
      264a011View commit details

      Copy full SHA for 264a011

      View code at this pointBrowse repository at this point

    • gh-105435: Fix spurious NEWLINE token if file ends with comment without a newline (#105442)

      pablogsal

      authored
      7279fb6View commit details

      Copy full SHA for 7279fb6

      View code at this pointBrowse repository at this point

    • gh-105390: Correctly raise TokenError instead of SyntaxError for tokenize errors (#105399)

      pablogsal

      authored
      ffd2654View commit details

      Copy full SHA for ffd2654

      View code at this pointBrowse repository at this point
23. Commits on Jun 6, 2023

    • gh-105259: Ensure we don't show newline characters for trailing NEWLINE tokens (#105364)

      pablogsal

      authored
      c0a6ed3View commit details

      Copy full SHA for c0a6ed3

      View code at this pointBrowse repository at this point
24. Commits on May 30, 2023

    • gh-105042: Disable unmatched parens syntax error in python tokenize (#105061)

      lysnikolaou

      authored
      70f315cView commit details

      Copy full SHA for 70f315c

      View code at this pointBrowse repository at this point

    • gh-105069: Add a readline-like callable to the tokenizer to consume input iteratively (#105070)

      pablogsal

      authored
      9216e69View commit details

      Copy full SHA for 9216e69

      View code at this pointBrowse repository at this point
25. Commits on May 28, 2023

    • gh-105017: Include CRLF lines in strings and column numbers (#105030)

      Show description for 96fff35
      

      mgmacias95

      and

      pablogsal

      authored
      96fff35View commit details

      Copy full SHA for 96fff35

      View code at this pointBrowse repository at this point
26. Commits on May 26, 2023

    • gh-104976: Ensure trailing dedent tokens are emitted as the previous tokenizer (#104980)

      Show description for 46b52e6
      pablogsal

      authored
      46b52e6View commit details

      Copy full SHA for 46b52e6

      View code at this pointBrowse repository at this point

    • gh-104972: Ensure that line attributes in tokens in the tokenize module are correct (#104975)

      pablogsal

      authored
      3fdb55cView commit details

      Copy full SHA for 3fdb55c

      View code at this pointBrowse repository at this point
27. Commits on May 24, 2023

    • gh-104825: Remove implicit newline in the line attribute in tokens emitted in the tokenize module (#104846)

      pablogsal

      authored
      c8cf9b4View commit details

      Copy full SHA for c8cf9b4

      View code at this pointBrowse repository at this point
28. Commits on May 22, 2023

    • gh-104741: Add line number attribute to indentation error exception (#104743)

      mgmacias95

      authored
      729b252View commit details

      Copy full SHA for 729b252

      View code at this pointBrowse repository at this point

    • gh-102856: Tokenize performance improvement (#104731)

      mgmacias95

      authored
      8817886View commit details

      Copy full SHA for 8817886

      View code at this pointBrowse repository at this point
29. Commits on May 21, 2023

    • gh-102856: Python tokenizer implementation for PEP 701 (#104323)

      Show description for 6715f91
      

      mgmacias95

      and

      pablogsal

      authored
      6715f91View commit details

      Copy full SHA for 6715f91

      View code at this pointBrowse repository at this point
30. Commits on May 5, 2023

    • gh-99113: Add Py_MOD_PER_INTERPRETER_GIL_SUPPORTED (gh-104205)

      Show description for a9c6e06
      ericsnowcurrently

      authored
      a9c6e06View commit details

      Copy full SHA for a9c6e06

      View code at this pointBrowse repository at this point