Skip to content
Navigation Menu
Sign in
Products
Platform
GitHub
Repository hosting, code review, and collaboration
Copilot
AI coding agent for tasks, projects and automated work
Build & Ship
Actions
CI/CD and automation
Code Quality
Quality analysis, fixes, and enforcement
Codespaces
Cloud development environments
Secure
Code Security
Vulnerability detection and remediation
Secret Protection
Secret scanning and leak prevention
All Features
Developers
Learn
Documentation
Training
Certifications
Build
Build with Copilot
Customize Copilot
Integrations
Explore
Trending repos
GitHub Sponsors
Developer articles
Changelog
Changelog
Your source for the latest features, improvements, and fixes across GitHub products, all in one place.
Businesses
By Stage
Enterprises
Team
Startups
Nonprofits
By Industry
Healthcare
Financial services
Manufacturing
Government
See all industries
Evaluate GitHub
Why GitHub
Customer Stories
Business insights
Trust Center
Add-ons
GitHub Advanced Security
Enterprise-grade code security
Copilot for business
Enterprise-grade AI features
Premium Support
Enterprise-grade 24/7 support
Resources
Learn & Connect
Documentation
Resource center
Blog
Events & webinars
Community Forum
Customer Stories
Integrations
Support
Customer support
Training
GitHub Status
Company
About
Partners
Changelog
GitHub Universe
GitHub Universe
The event for developers, by developers — talks, workshops, and what’s next for GitHub.
Pricing
Search
/
Sign in
Sign up
Appearance settings
You signed in with another tab or window.
Reload
to refresh your session.
You signed out in another tab or window.
Reload
to refresh your session.
You switched accounts on another tab or window.
Reload
to refresh your session.
Dismiss alert
{{ message }}
krassowski
ipython
Repository navigation
Code
Pull requests
Actions
Projects
Security and quality
Insights
More
items
Commits
Breadcrumbs
History for
ipython
IPython
utils
tokenutil.py
on
python-3.14-dev
User selector
All users
Datepicker
All time
Commit history
Commits on Feb 23, 2025
unsafe ruff fixes
Carreau
committed
f2da2a2
View commit details
Copy full SHA for f2da2a2
View code at this point
Browse repository at this point
Commits on Jan 12, 2025
maintain state in iterator
smacke
committed
dd4c4ed
View commit details
Copy full SHA for dd4c4ed
View code at this point
Browse repository at this point
dont mutate tokens
smacke
committed
620f75d
View commit details
Copy full SHA for 620f75d
View code at this point
Browse repository at this point
Revert "remove unnecessary append"
Show description for 32b2bf1
smacke
committed
32b2bf1
View commit details
Copy full SHA for 32b2bf1
View code at this point
Browse repository at this point
remove unnecessary append
smacke
committed
a8190e2
View commit details
Copy full SHA for a8190e2
View code at this point
Browse repository at this point
Commits on Dec 27, 2024
address comments
smacke
committed
7824b3c
View commit details
Copy full SHA for 7824b3c
View code at this point
Browse repository at this point
token at cursor improvements
smacke
committed
177b14a
View commit details
Copy full SHA for 177b14a
View code at this point
Browse repository at this point
Commits on Oct 27, 2023
please linter
Carreau
committed
87ab1c5
View commit details
Copy full SHA for 87ab1c5
View code at this point
Browse repository at this point
Commits on Oct 26, 2023
some more typing
Carreau
committed
71bfc9d
View commit details
Copy full SHA for 71bfc9d
View code at this point
Browse repository at this point
Commits on Jul 5, 2023
run formatter
Carreau
committed
124787e
View commit details
Copy full SHA for 124787e
View code at this point
Browse repository at this point
Commits on Jun 28, 2023
Fix issues due to breaking tokenize changes in 3.12
lysnikolaou
committed
1098b2c
View commit details
Copy full SHA for 1098b2c
View code at this point
Browse repository at this point
Commits on Apr 6, 2021
reformat docstring in IPython utils
Carreau
committed
7663c52
View commit details
Copy full SHA for 7663c52
View code at this point
Browse repository at this point
Commits on Mar 11, 2018
Drop bundled, outdated copy of the tokenize module
takluyver
committed
14e53cd
View commit details
Copy full SHA for 14e53cd
View code at this point
Browse repository at this point
Commits on Sep 28, 2017
Fix line_at_cursor for end of last line without trailing newline
takluyver
committed
8a2041e
View commit details
Copy full SHA for 8a2041e
View code at this point
Browse repository at this point
Commits on Sep 27, 2017
Identify position after a newline as the start of the next line
Show description for 3aff1e3
takluyver
committed
3aff1e3
View commit details
Copy full SHA for 3aff1e3
View code at this point
Browse repository at this point
Commits on May 18, 2017
remove python2 specific cast_unicode_py2 function
srinivasreddy
committed
10821c6
View commit details
Copy full SHA for 10821c6
View code at this point
Browse repository at this point
Commits on Mar 9, 2017
Fix a couple of warnings/errors in doc builds.
Carreau
committed
df4f862
View commit details
Copy full SHA for df4f862
View code at this point
Browse repository at this point
Commits on Feb 17, 2017
Update a couple of iteration idioms.
Show description for 76f8d4f
Carreau
committed
76f8d4f
View commit details
Copy full SHA for 76f8d4f
View code at this point
Browse repository at this point
Commits on Oct 22, 2016
the __future__ is now.
ivanov
committed
2961b53
View commit details
Copy full SHA for 2961b53
View code at this point
Browse repository at this point
Commits on Jun 7, 2016
Fix argument type in docsting
klonuo
committed
fc6d290
View commit details
Copy full SHA for fc6d290
View code at this point
Browse repository at this point
Commits on Oct 2, 2015
handle multi-line tokens in token_at_cursor
Show description for a85e1dc
minrk
committed
a85e1dc
View commit details
Copy full SHA for a85e1dc
View code at this point
Browse repository at this point
Commits on Sep 13, 2015
Correctly count newline in tokenize.
Show description for 764d4f4
Carreau
committed
764d4f4
View commit details
Copy full SHA for 764d4f4
View code at this point
Browse repository at this point
Commits on Feb 19, 2015
prioritize function token for inspection
Show description for 240eef9
minrk
committed
240eef9
View commit details
Copy full SHA for 240eef9
View code at this point
Browse repository at this point
Commits on Nov 15, 2014
TAB on empty line causes crash; with test
Doug Blank
committed
17a3bb9
View commit details
Copy full SHA for 17a3bb9
View code at this point
Browse repository at this point
Commits on Oct 25, 2014
only complete on current line
Show description for bc33ecb
minrk
committed
bc33ecb
View commit details
Copy full SHA for bc33ecb
View code at this point
Browse repository at this point
Commits on Oct 22, 2014
don't pick up tokens right of cursor
Show description for c04db18
minrk
committed
c04db18
View commit details
Copy full SHA for c04db18
View code at this point
Browse repository at this point
Commits on May 7, 2014
update completion_ and objection_info_request
Show description for de473a1
minrk
committed
de473a1
View commit details
Copy full SHA for de473a1
View code at this point
Browse repository at this point
add utils.tokenutil for getting the token at a cursor offset
minrk
committed
c21ac70
View commit details
Copy full SHA for c21ac70
View code at this point
Browse repository at this point
Loading
You can’t perform that action at this time.