Commits

Commit history

1. Commits on Jun 12, 2024

   • [3.12] gh-120343: Fix column offsets of multiline tokens in tokenize (GH-120391) (#120428)

     Show description for f75abf8
     

     miss-islington

     and

     lysnikolaou

     authored
     f75abf8View commit details

     Copy full SHA for f75abf8

     View code at this pointBrowse repository at this point
2. Commits on Jun 11, 2024

   • [3.12] gh-120343: Do not reset byte_col_offset_diff after multiline tokens (GH-120352) (#120356)

     Show description for 0315fdc
     

     3 peopleauthored
     0315fdcView commit details

     Copy full SHA for 0315fdc

     View code at this pointBrowse repository at this point
3. Commits on May 29, 2024

   • [3.12] gh-119704: Fix reference leak in the ``Python/Python-tokenize.c`` (GH-119705) (#119708)

     miss-islington

     authored
     a62681cView commit details

     Copy full SHA for a62681c

     View code at this pointBrowse repository at this point
4. Commits on May 28, 2024

   • [3.12] gh-119118: Fix performance regression in tokenize module (GH-119615) (#119683)

     Show description for 4a0af0c
     

     3 peopleauthored
     4a0af0cView commit details

     Copy full SHA for 4a0af0c

     View code at this pointBrowse repository at this point
5. Commits on Dec 11, 2023

   • [3.12] gh-112943: Correctly compute end offsets for multiline tokens in the tokenize module (GH-112949) (#112957)

     Show description for e4d2fb2
     pablogsal

     authored
     e4d2fb2View commit details

     Copy full SHA for e4d2fb2

     View code at this pointBrowse repository at this point
6. Commits on Jun 9, 2023

   • [3.12] gh-105564: Don't include artificial newlines in the line attribute of tokens (GH-105565) (#105579)

     Show description for 16b1cdc
     

     miss-islington

     and

     pablogsal

     authored
     16b1cdcView commit details

     Copy full SHA for 16b1cdc

     View code at this pointBrowse repository at this point
7. Commits on Jun 7, 2023

   • [3.12] gh-105390: Add explicit type cast (GH-105466) (#105472)

     miss-islington

     authored
     3d4a786View commit details

     Copy full SHA for 3d4a786

     View code at this pointBrowse repository at this point

   • [3.12] gh-105435: Fix spurious NEWLINE token if file ends with comment without a newline (GH-105442) (#105444)

     miss-islington

     authored
     117c153View commit details

     Copy full SHA for 117c153

     View code at this pointBrowse repository at this point

   • [3.12] gh-105390: Correctly raise TokenError instead of SyntaxError for tokenize errors (GH-105399) (#105439)

     miss-islington

     authored
     c84d4d1View commit details

     Copy full SHA for c84d4d1

     View code at this pointBrowse repository at this point
8. Commits on Jun 6, 2023

   • [3.12] gh-105259: Ensure we don't show newline characters for trailing NEWLINE tokens (GH-105364) (#105367)

     miss-islington

     authored
     67b288fView commit details

     Copy full SHA for 67b288f

     View code at this pointBrowse repository at this point
9. Commits on May 31, 2023

   • [3.12] gh-105069: Add a readline-like callable to the tokenizer to consume input iteratively (GH-105070) (#105119)

     Show description for c687946
     

     miss-islington

     and

     pablogsal

     authored
     c687946View commit details

     Copy full SHA for c687946

     View code at this pointBrowse repository at this point

   • [3.12] gh-105042: Disable unmatched parens syntax error in python tokenize (GH-105061) (#105120)

     Show description for 2f8c22f
     

     miss-islington

     and

     lysnikolaou

     authored
     2f8c22fView commit details

     Copy full SHA for 2f8c22f

     View code at this pointBrowse repository at this point
10. Commits on May 28, 2023

    • [3.12] gh-105017: Include CRLF lines in strings and column numbers (GH-105030) (#105041)

      Show description for 3f8d5d9
      

      3 peopleauthored
      3f8d5d9View commit details

      Copy full SHA for 3f8d5d9

      View code at this pointBrowse repository at this point
11. Commits on May 26, 2023

    • [3.12] gh-104976: Ensure trailing dedent tokens are emitted as the previous tokenizer (GH-104980) (#105000)

      miss-islington

      authored
      2c02c68View commit details

      Copy full SHA for 2c02c68

      View code at this pointBrowse repository at this point

    • [3.12] gh-104972: Ensure that line attributes in tokens in the tokenize module are correct (GH-104975) (#104982)

      Show description for 8ca2957
      

      miss-islington

      and

      pablogsal

      authored
      8ca2957View commit details

      Copy full SHA for 8ca2957

      View code at this pointBrowse repository at this point
12. Commits on May 24, 2023

    • [3.12] gh-104825: Remove implicit newline in the line attribute in tokens emitted in the tokenize module (GH-104846). (#104850)

      Show description for 3d2ed89
      pablogsal

      authored
      3d2ed89View commit details

      Copy full SHA for 3d2ed89

      View code at this pointBrowse repository at this point
13. Commits on May 22, 2023

    • gh-104741: Add line number attribute to indentation error exception (#104743)

      mgmacias95

      authored
      729b252View commit details

      Copy full SHA for 729b252

      View code at this pointBrowse repository at this point

    • gh-102856: Tokenize performance improvement (#104731)

      mgmacias95

      authored
      8817886View commit details

      Copy full SHA for 8817886

      View code at this pointBrowse repository at this point
14. Commits on May 21, 2023

    • gh-102856: Python tokenizer implementation for PEP 701 (#104323)

      Show description for 6715f91
      

      mgmacias95

      and

      pablogsal

      authored
      6715f91View commit details

      Copy full SHA for 6715f91

      View code at this pointBrowse repository at this point
15. Commits on May 5, 2023

    • gh-99113: Add Py_MOD_PER_INTERPRETER_GIL_SUPPORTED (gh-104205)

      Show description for a9c6e06
      ericsnowcurrently

      authored
      a9c6e06View commit details

      Copy full SHA for a9c6e06

      View code at this pointBrowse repository at this point
16. Commits on Apr 19, 2023

    • gh-102856: Initial implementation of PEP 701 (#102855)

      Show description for 1ef61cf
      

      5 peopleauthored
      1ef61cfView commit details

      Copy full SHA for 1ef61cf

      View code at this pointBrowse repository at this point
17. Commits on Oct 6, 2022

    • gh-97973: Return all necessary information from the tokenizer (GH-97984)

      Show description for cbf0afd
      lysnikolaou

      authored
      cbf0afdView commit details

      Copy full SHA for cbf0afd

      View code at this pointBrowse repository at this point
18. Commits on Aug 11, 2022

    • gh-90928: Statically Initialize the Keywords Tuple in Clinic-Generated Code (gh-95860)

      Show description for 6f6a4e6
      ericsnowcurrently

      authored
      6f6a4e6View commit details

      Copy full SHA for 6f6a4e6

      View code at this pointBrowse repository at this point
19. Commits on Feb 11, 2022

    • bpo-46613: Add PyType_GetModuleByDef to the public API (GH-31081)

      Show description for 2049469
      

      encukou

      and

      vstinner

      authored
      2049469View commit details

      Copy full SHA for 2049469

      View code at this pointBrowse repository at this point
20. Commits on Oct 13, 2021

    • bpo-45434: Mark the PyTokenizer C API as private (GH-28924)

      Show description for 713bb19
      vstinner

      authored
      713bb19View commit details

      Copy full SHA for 713bb19

      View code at this pointBrowse repository at this point
21. Commits on Oct 3, 2021

    • Remove trailing spaces. (GH-28706)

      serhiy-storchaka

      authored
      a5a5615View commit details

      Copy full SHA for a5a5615

      View code at this pointBrowse repository at this point
22. Commits on Aug 25, 2021

    • Format the Python-tokenize module and fix exit path (GH-27935)

      pablogsal

      authored
      214c2e5View commit details

      Copy full SHA for 214c2e5

      View code at this pointBrowse repository at this point
23. Commits on Aug 24, 2021

    • Add tests for the C tokenizer and expose it as a private module (GH-27924)

      pablogsal

      authored
      a24676bView commit details

      Copy full SHA for a24676b

      View code at this pointBrowse repository at this point
24. Loading