You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Note: these values reflect the state of the issue at the time it was migrated and might not reflect the current state.
Show more details
GitHub fields:
assignee=Noneclosed_at=<Date2016-09-11.19:09:12.723>created_at=<Date2015-02-27.22:29:43.909>labels= ['type-feature', 'build']
title='Turn on extra warnings on GCC'updated_at=<Date2016-09-13.05:32:13.488>user='https://github.com/serhiy-storchaka'
will make GCC emit all warnings except few types that would produce too many warnings. With these options the compilation is almost clean on 32-bit Linux.
-Wall is already added (unconditionally) to $OPT above. What’s the point of also adding it to $CFLAGS_NODIST as well? Does it have to be added to both?
The proposed options add exactly one warning for me (ignoring warnings from libffi). How would you work around this:
./Include/pymem.h:136:18: warning: comparison is always false due to limited range of data type [-Wtype-limits]
( ((size_t)(n) > PY_SSIZE_T_MAX / sizeof(type)) ? NULL : \
^
/media/disk/home/proj/python/cpython/Modules/_ssl.c:4435:22: note: in expansion of macro ‘PyMem_New’
_ssl_locks = PyMem_New(PyThread_type_lock, _ssl_locks_count);
^~~~~~~~~
I don't think adding -Wno-type-limits is a good idea.
The good question is how that can be happening, e.g. how PY_SSIZE_T_MAX divided by sizeof anything can be *more* than max(size_t)? E.g now that I stare at the code, *that* warning should be impossible if everything is correct. It means either that the RHS is negative or size_t is defined to be 32-bit in this compilation unit whereas PY_SSIZE_T is 64-bit. Neither sound like a good idea.
I didn’t look too closely, but I did see that _ssl_locks_count is unsigned int. I was compiling for x86-64 Linux, where int is 32 bits and size_t is 64. So maybe GCC was optimizing the (size_t) cast away, and then rightfully warning that the largest unsigned int will never exceed the largest possible array size.
Seems GCC is such smart, that can deduce that the maximal value of _ssl_locks_count is never larger than PY_SSIZE_T_MAX / sizeof(PyThread_type_lock). The other workaround is making _ssl_locks_count of type size_t instead of unsigned int, but I wouldn't do this with good reasons.
ztane commented on Aug 12, 2016
ztanemannequin
Mannequin
More actions
Ah, indeed, I somehow missed that. Though, there is no good reason for it being unsigned either; as the actual type in SSL API's is of type int. Another argument of type int is cast to unsigned just for the comparison on line 4419, and unsigned int counters i and j are used in function _setup_ssl_threads.
The variable could be safely changed to size_t (along with those index variables) without it affecting anything at all, as it is a static variable within that module and only used to hold a size of an array, and never passed back to another function.
AFAIK $CFLAGS_NODIST is used only for compiling the core and standard modules, $OPT is included in $CFLAGS and also used for compiling third-party extensions. Since -Wall is already included in $OPT, there is no need of it in $CFLAGS_NODIST. Removed this part. Thank you for your review Martin.
All warnings were resolved at the moment of providing previous version, but the code was changed too much last days. New warnings was added and disappeared in these days. Now we can just sit and resolve the leftover.
I think Silent Ghost is talking about my -Wtype-limits warning, which is still present. That is the only warning I am getting. I suspect you won’t see it with a 32-bit build.
Activity
serhiy-storchaka commentedon Feb 27, 2015
What if make GCC emit extra warnings? Adding following options:
-Wall -Wextra -Wno-unused-result -Wno-unused-parameter -Wno-missing-field-initializers
will make GCC emit all warnings except few types that would produce too many warnings. With these options the compilation is almost clean on 32-bit Linux.
skrah commentedon Feb 28, 2015
+1. I think the flags should go into CFLAGS_NODIST.
serhiy-storchaka commentedon Mar 18, 2015
I'm not well experienced with autoconf. Here is my attempt.
serhiy-storchaka commentedon Jun 21, 2016
Could anyone please make a review?
vadmium commentedon Jul 24, 2016
-Wall is already added (unconditionally) to $OPT above. What’s the point of also adding it to $CFLAGS_NODIST as well? Does it have to be added to both?
vadmium commentedon Aug 11, 2016
The proposed options add exactly one warning for me (ignoring warnings from libffi). How would you work around this:
./Include/pymem.h:136:18: warning: comparison is always false due to limited range of data type [-Wtype-limits]
( ((size_t)(n) > PY_SSIZE_T_MAX / sizeof(type)) ? NULL : \
^
/media/disk/home/proj/python/cpython/Modules/_ssl.c:4435:22: note: in expansion of macro ‘PyMem_New’
_ssl_locks = PyMem_New(PyThread_type_lock, _ssl_locks_count);
^~~~~~~~~
serhiy-storchaka commentedon Aug 11, 2016
Just add -Wno-type-limits.
ztane commentedon Aug 12, 2016
I don't think adding -Wno-type-limits is a good idea.
The good question is how that can be happening, e.g. how PY_SSIZE_T_MAX divided by sizeof anything can be *more* than max(size_t)? E.g now that I stare at the code, *that* warning should be impossible if everything is correct. It means either that the RHS is negative or size_t is defined to be 32-bit in this compilation unit whereas PY_SSIZE_T is 64-bit. Neither sound like a good idea.
vadmium commentedon Aug 12, 2016
I didn’t look too closely, but I did see that _ssl_locks_count is unsigned int. I was compiling for x86-64 Linux, where int is 32 bits and size_t is 64. So maybe GCC was optimizing the (size_t) cast away, and then rightfully warning that the largest unsigned int will never exceed the largest possible array size.
serhiy-storchaka commentedon Aug 12, 2016
Seems GCC is such smart, that can deduce that the maximal value of _ssl_locks_count is never larger than PY_SSIZE_T_MAX / sizeof(PyThread_type_lock). The other workaround is making _ssl_locks_count of type size_t instead of unsigned int, but I wouldn't do this with good reasons.
ztane commentedon Aug 12, 2016
Ah, indeed, I somehow missed that. Though, there is no good reason for it being unsigned either; as the actual type in SSL API's is of type int. Another argument of type int is cast to unsigned just for the comparison on line 4419, and unsigned int counters i and j are used in function _setup_ssl_threads.
The variable could be safely changed to
size_t(along with those index variables) without it affecting anything at all, as it is a static variable within that module and only used to hold a size of an array, and never passed back to another function.serhiy-storchaka commentedon Sep 9, 2016
Rebased patch. Removed save_CFLAGS="$CFLAGS" and CFLAGS="$save_CFLAGS" lines as Marin suggested.
Benjamin, seems you are experienced with autoconf. Could you please make a review?
vadmium commentedon Sep 10, 2016
Can one of the -Wall flags be dropped? What is the difference between $OPT and $CFLAGS_NODIST?
gcc -pthread -c -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -std=c99 -Wall -Wextra -Wno-unused-result -Wno-unused-parameter -Wno-missing-field-initializers -I. -IInclude -I./Include -DPy_BUILD_CORE -o Programs/python.o ./Programs/python.c
python-dev commentedon Sep 11, 2016
New changeset 99adb5df8cb6 by Serhiy Storchaka in branch 'default':
Issue bpo-23545: Turn on extra warnings on GCC.
https://hg.python.org/cpython/rev/99adb5df8cb6
serhiy-storchaka commentedon Sep 11, 2016
AFAIK $CFLAGS_NODIST is used only for compiling the core and standard modules, $OPT is included in $CFLAGS and also used for compiling third-party extensions. Since -Wall is already included in $OPT, there is no need of it in $CFLAGS_NODIST. Removed this part. Thank you for your review Martin.
SilentGhost commentedon Sep 12, 2016
The commit didn't resolve the warning though.
serhiy-storchaka commentedon Sep 12, 2016
All warnings were resolved at the moment of providing previous version, but the code was changed too much last days. New warnings was added and disappeared in these days. Now we can just sit and resolve the leftover.
python-dev commentedon Sep 12, 2016
New changeset da485c6c744e by Stefan Krah in branch 'default':
Issue bpo-23545: Adding -Wextra in setup.py is no longer necessary, since it
https://hg.python.org/cpython/rev/da485c6c744e
skrah commentedon Sep 12, 2016
Agreed. SilentGhost, it's probably best to open new issues for the warnings.
vadmium commentedon Sep 13, 2016
I think Silent Ghost is talking about my -Wtype-limits warning, which is still present. That is the only warning I am getting. I suspect you won’t see it with a 32-bit build.