Repository navigation
Master build failure on Windows getting file system encoding #87885
Description
| BPO | 43719 |
|---|---|
| Nosy | @terryjreedy, @pfmoore, @db3l, @vstinner, @tjguk, @zware, @zooba, @pablogsal, @sweeneyde |
Note: these values reflect the state of the issue at the time it was migrated and might not reflect the current state.
Show more details
GitHub fields:
assignee = None
closed_at = <Date 2021-04-04.12:28:02.094>
created_at = <Date 2021-04-03.20:15:48.193>
labels = ['build', '3.10', 'OS-windows']
title = 'Master build failure on Windows getting file system encoding'
updated_at = <Date 2021-04-04.12:28:02.093>
user = 'https://github.com/terryjreedy'bugs.python.org fields:
activity = <Date 2021-04-04.12:28:02.093>
actor = 'pablogsal'
assignee = 'none'
closed = True
closed_date = <Date 2021-04-04.12:28:02.094>
closer = 'pablogsal'
components = ['Build', 'Windows']
creation = <Date 2021-04-03.20:15:48.193>
creator = 'terry.reedy'
dependencies = []
files = []
hgrepos = []
issue_num = 43719
keywords = ['3.10regression']
message_count = 10.0
messages = ['390140', '390144', '390150', '390153', '390155', '390156', '390162', '390163', '390167', '390185']
nosy_count = 9.0
nosy_names = ['terry.reedy', 'paul.moore', 'db3l', 'vstinner', 'tim.golden', 'zach.ware', 'steve.dower', 'pablogsal', 'Dennis Sweeney']
pr_nums = []
priority = 'critical'
resolution = 'fixed'
stage = 'resolved'
status = 'closed'
superseder = None
type = 'compile error'
url = 'https://bugs.python.org/issue43719'
versions = ['Python 3.10']
Activity
terryjreedy commentedon Apr 3, 2021
After a fresh update from upstream
python.vcxproj -> f:\dev\3x\PCbuild\amd64\python_d.pdb (Full PDB) Python path configuration: PYTHONHOME = (not set) PYTHONPATH = 'f:\dev\3x\Lib' program name = 'f:\dev\3x\PCbuild\amd64\python_d.exe' isolated = 0 environment = 1 user site = 1 import site = 1 sys._base_executable = 'f:\\dev\\3x\\PCbuild\\amd64\\python_d.exe' sys.base_prefix = 'f:\\dev\\3x' sys.base_exec_prefix = 'f:\\dev\\3x' sys.platlibdir = 'lib' sys.executable = 'f:\\dev\\3x\\PCbuild\\amd64\\python_d.exe' sys.prefix = 'f:\\dev\\3x' sys.exec_prefix = 'f:\\dev\\3x' sys.path = [ 'f:\\dev\\3x\\Lib', 'f:\\dev\\3x\\PCbuild\\amd64\\python310_d.zip', 'f:\\dev\\3x\\DLLs', 'f:\\dev\\3x\\lib', 'f:\\dev\\3x\\PCbuild\\amd64', ] EXEC : Fatal Python warning : init_fs_encoding: failed to get the Python codec of the filesystem encoding [f:\dev\3x\PCbuild\python.vcxproj] Python runtime state: core initialized Traceback (most recent call last): File "f:\dev\3x\Lib\encodings\__init__.py", line 31, in <module> f:\dev\3x\PCbuild\python.vcxproj(123,5): warning MSB3073: The command "setlocal \r f:\dev\3x\PCbuild\python.vcxproj(123,5): warning MSB3073: set PYTHONPATH=f:\dev \3x\Lib\r f:\dev\3x\PCbuild\python.vcxproj(123,5): warning MSB3073: "f:\dev\3x\PCbuild\am d64\python_d.exe" "f:\dev\3x\PC\validate_ucrtbase.py" ucrtbased" exited with co de -1073741819. pythonw.vcxproj -> f:\dev\3x\PCbuild\amd64\pythonw_d.exe pythonw.vcxproj -> f:\dev\3x\PCbuild\amd64\pythonw_d.pdb (Full PDB)EXEC : Fatal Python warning : init_fs_encoding: failed to get the Python codec
of the filesystem encoding [f:\dev\3x\PCbuild\python.vcxproj]
f:\dev\3x\PCbuild\python.vcxproj(123,5): warning MSB3073: The command "setlocal
\r
f:\dev\3x\PCbuild\python.vcxproj(123,5): warning MSB3073: set PYTHONPATH=f:\dev
\3x\Lib\r
f:\dev\3x\PCbuild\python.vcxproj(123,5): warning MSB3073: "f:\dev\3x\PCbuild\am
d64\python_d.exe" "f:\dev\3x\PC\validate_ucrtbase.py" ucrtbased" exited with co
de -1073741819.
I believe I pulled and rebuilt fine just a few days ago. Subsequently running
Running > chkdsk F: /scan revealed no obvious disk error, but there could be corrupted bytes in some file, but I don't know what file(s) to check (if text) or delete and have git redownload. Anyone else have a similar problem?
terryjreedy commentedon Apr 3, 2021
Re ""f:\dev\3x\PC\validate_ucrtbase.py" ucrtbased" exited with co
de -1073741819."
f:\dev\3x>py -3.10 PC\validate_ucrtbase.py ucrtbased
C:\WINDOWS\SYSTEM32\ucrtbased.DLL is version 10.0.14393.33
so the failure is due to running the file with the nonfunctional python_d.exe.
In a text editor, encodings/init.py looks fine.
f:\dev\3x>py -3.10 f:\dev\3x\\lib\encodings\init.py
(to check text further) fails at line 33
from . import alias
In any case, line 31 is 'import codecs'. codecs.py looks fine and
f:\dev\3x>py -3.10 f:\dev\3x\\lib\codecs.py
runs without error, so its text appears to be intact. Perhaps one of the imports of compiled C fail drastically.
vstinner commentedon Apr 3, 2021
IMO it's https://bugs.python.org/issue27129#msg389991
db3l commentedon Apr 3, 2021
Terry, it's not clear to me if this is the same issue (at first blush it appears different) but could you see if you have any pyc files in __pycache__ folders within the Tools or Parser directories in your tree that could be from prior builds? If so, remove them and try a new build?
The build.bat script's clean process is not currently cleaning them up, which can lead to various oddities if you reuse a source tree across the commit Victor references, as that invalidates the older files but they aren't regenerated.
sweeneyde commentedon Apr 3, 2021
I ran into the same issue on Windows 10 and git bisected it to the same first bad commit, fcb55c0
The issue persists after rm .\Parser\pycache\*
My .\Tools directory has no __pycache__.
db3l commentedon Apr 3, 2021
Dennis, just to make sure I wasn't too literal, some of the __pycache__ folders are in subdirectories (at least in Tools), so just to double check, you did a recursive search beneath Tools and Parser right?
sweeneyde commentedon Apr 4, 2021
I could not successfully build even with deletion of __pycache__ in subfolders. I finally got the build to succeed after changing the magic number, so I opened #69255.
sweeneyde commentedon Apr 4, 2021
Correction: I opened #69359
terryjreedy commentedon Apr 4, 2021
Thanks everyone for the rapid responses. The PR fixes the build for me, with a clean test suite pass, so I added reviewers who could merge, a blurb, and my approval. This can be closed as out-of-date as soon as the (or a) fix is merged.
pablogsal commentedon Apr 4, 2021
Fixed by #25172