4545 Commits

Author	SHA1	Message	Date
Jeff Epler	b6cd577cf6	py/mkrules.mk: Force ".pp" files to always rebuild. ... These files are only built on demand for developers, and it is a quick process. Without FORCE, a sequence like this would leave the developer with an outdated `main.pp` to inspect: make build-standard/main.pp touch input.h make build-standard/main.pp # Rebuilds now, wouldn't have before Signed-off-by: Jeff Epler <jepler@gmail.com>	2025-08-28 23:09:32 +10:00
Jeff Epler	1671977ca4	py/parsenum: Fix parsing LLONG_MIN in longlong configuration. ... Re-organize `mp_parse_num_integer()` (for longlong) slightly so that the most negative 64-bit integer can be parsed. Fixes issue #17932. Signed-off-by: Jeff Epler <jepler@gmail.com>	2025-08-28 11:31:03 +10:00
Anson Mansfield	f4f7fbf3dc	py/obj: Remove unused map new/free function declarations. ... These functions were removed in 6c9fca2 for v1.9.3. This commit removes their declarations as well. See-also: 6c9fca2aa9 Signed-off-by: Anson Mansfield <amansfield@mantaro.com>	2025-08-28 11:16:00 +10:00
David Schneider	8c47e446bf	py/obj: Fix a comment regarding make_new slot. ... This was missed as part of the transition to make_new a mp_obj_type_t slot. See also: 94beeabd2e Signed-off-by: David Schneider <schneidav81@gmail.com>	2025-08-26 23:16:01 +10:00
Damien George	a3f9dec788	py/mpconfig: Enable the sys module at all feature levels by default. ... This is a pretty fundamental module, and even minimal ports like unix and zephyr minimal have it enabled. So, enabled it by default at the lowest feature level. Most things in the `sys` module are configurable, and off by default, so it shouldn't add too much to ports that don't already have it enabled (which is just the minimal port). Also note that `sys` is still disabled on the bare-arm port, to keep that ultra minimal. It means we now have bare-arm without `sys` and the minimal port with `sys`. That will allow different code size comparisons if/when new `sys` features are added. Signed-off-by: Damien George <damien@micropython.org>	2025-08-22 13:31:10 +10:00
Damien George	14e9c00cb9	py/builtinimport: Guard code needing sys.path with MICROPY_PY_SYS_PATH. ... Signed-off-by: Damien George <damien@micropython.org>	2025-08-22 13:30:46 +10:00
Damien George	b5fcb33eaa	py/mpconfig: Enable CRYPTOLIB, HASHLIB_MD5, HASHLIB_SHA1 if SSL enabled. ... This commit unifies the configuration of MICROPY_PY_CRYPTOLIB, MICROPY_PY_HASHLIB_MD5 and MICROPY_PY_HASHLIB_SHA1, so they are enabled by default if MICROPY_PY_SSL is enabled. This matches the existing configuration of most of the ports. With this change, all ports remain the same except: - reneses-ra now enables MICROPY_PY_CRYPTOLIB, MICROPY_PY_HASHLIB_MD5 and MICROPY_PY_HASHLIB_SHA1. - rp2 now enables MICROPY_PY_HASHLIB_MD5. Signed-off-by: Damien George <damien@micropython.org>	2025-08-19 21:10:00 +10:00
Damien George	989abae12c	py/mpconfig: Move MICROPY_MODULE___ALL__ option to other module options. ... Signed-off-by: Damien George <damien@micropython.org>	2025-08-19 13:00:45 +10:00
Damien George	169d382248	py/mpconfig: Rename MICROPY_PY___FILE__ to MICROPY_MODULE___FILE__. ... For consistency with other module-related configuration options. Signed-off-by: Damien George <damien@micropython.org>	2025-08-19 13:00:45 +10:00
Damien George	3650196682	py/objtype: Use locals_ptr directly instead of getting it from the slot. ... This is a very minor code simplification, which reduces code size by about -8 bytes. It should have no functional change. Signed-off-by: Damien George <damien@micropython.org>	2025-08-19 12:58:02 +10:00
Alessandro Gatti	bd413d3d85	py/asmthumb: Fix T3 encoding of conditional branches. ... This commit fixes the encoding of conditional branch opcodes emitted for ARMv7-M targets, when the emitter decides to use the T3 encoding for said operation. Fields J1 and J2 are now present in the generated opcode word, along with correcting some minor issues in bitmasks and shifts computation. This fixes #17940. Signed-off-by: Alessandro Gatti <a.gatti@frob.it>	2025-08-19 12:40:29 +10:00
Angus Gratton	3faf229853	py/misc: Add a way to detect sanitizer builds. ... Clang and gcc>=14 can use __has_feature() to detect if a sanitizer is enabled, but older GCC has no mechanism - need to set a macro explicitly for this to be recognised. Necessary for increasing some resource limits in sanitizer builds. Important not to use to avoid real issues! This work was funded through GitHub Sponsors. Signed-off-by: Angus Gratton <angus@redyak.com.au>	2025-08-19 10:33:40 +10:00
Damien George	40cc4e4f74	py/objtype: Make mp_obj_new_type a static function. ... It's only used once, in the same file it's defined, and making it static reduces code size. Along with this, the associated example code comment in `ports/unix/main.c` has been removed. Signed-off-by: Damien George <damien@micropython.org>	2025-08-15 11:45:11 +10:00
Damien George	3efbd726eb	py/parse: Remove explicit checks for invalid folding operations. ... They are instead checked by `binary_op_maybe()`, which catches exceptions for invalid int/float operations. This is a follow-up to 69ead7d98e Signed-off-by: Damien George <damien@micropython.org>	2025-08-15 11:38:20 +10:00
Phil Howard	141f7d0c35	py/mkrules.cmake: Clean genhdr and frozen_mpy dirs. ... CMake builds relied upon the parent Makefile removing the entire build directory to successfully clean build artifacts. py/mkrules.cmake: Add ADDITIONAL_CLEAN_FILES properties to ensure a "make clean" from within the build directory removes the genhdr and frozen_mpy directories. Signed-off-by: Phil Howard <github@gadgetoid.com>	2025-08-15 01:24:53 +10:00
Jeff Epler	0615d13963	py/objringio: Detect incorrect constructor calls. ... ringbuffer.size must be at least 2, and is a 16-bit quantity. This fixes several cases including the one the fuzzer discovered, which would lead to a fatal signal when accessing the object. Fixes issue #17847. Signed-off-by: Jeff Epler <jepler@gmail.com>	2025-08-15 01:21:25 +10:00
Angus Gratton	744270ac1b	py/misc: Add explicit dependency on py/mpconfig.h. ... Macros in misc.h depend on values defined by including mpconfig.h. This work was funded through GitHub Sponsors. Signed-off-by: Angus Gratton <angus@redyak.com.au>	2025-08-13 10:13:08 +10:00
Jeff Epler	4614ee9e68	py/binary: Add MICROPY_PY_STRUCT_UNSAFE_TYPECODES. ... This adds a compile-time flag to disable some "unsafe" and non-standard typecodes in struct, array and related modules. This is useful to turn off when fuzzing, as improper use of these typecodes can crash MicroPython. Signed-off-by: Jeff Epler <jepler@gmail.com>	2025-08-12 14:34:19 +10:00
Alessandro Gatti	0ee3f99da2	py/asmrv32: Make lt/le comparisons emitter shorter. ... This commit simplifies the emitter code in charge of generating opcodes performing less-than and less-than-or-equal comparisons. By rewriting the SLT/SLTU opcode generator (handling less-than comparisons) and de-inlining the less-than comparison generator call in the less-than-or-equal generator, the output binary is ~80 bytes smaller (measurements taken from the QEMU port). Signed-off-by: Alessandro Gatti <a.gatti@frob.it>	2025-08-11 22:31:13 +10:00
Damien George	7e8705fe2b	all: Bump version to 1.27.0-preview. ... Signed-off-by: Damien George <damien@micropython.org>	2025-08-10 08:42:11 +10:00
Damien George	4ce2dd2cda	all: Bump version to 1.26.0. ... Signed-off-by: Damien George <damien@micropython.org>	2025-08-09 23:31:31 +10:00
Jeff Epler	c0252d73c6	py/parse: Fix missing nlr_pop call in complex path of binary_op_maybe. ... Reproducer (needs to be run as one compilation unit): ans = (-1) ** 2.3 aa Fixes issue #17815. Signed-off-by: Jeff Epler <jepler@gmail.com>	2025-08-03 08:29:28 +10:00
Chris Webb	f39434e9fb	py/asmthumb: Don't corrupt base register in large offset store. ... asm_thumb_store_reg_reg_offset() modifies the base register when storing with a large offset which triggers the generic path. If a variable lives in that register, this corrupts it. Fix this by saving the base register on the stack before modifying it. Signed-off-by: Chris Webb <chris@arachsys.com>	2025-08-01 14:15:39 +10:00
Yoctopuce dev	69ead7d98e	py/parse: Add support for math module constants and float folding. ... Add a new MICROPY_COMP_CONST_FLOAT feature, enabled by in mpy-cross and when compiling with MICROPY_CONFIG_ROM_LEVEL_CORE_FEATURES. The new feature leverages the code of MICROPY_COMP_CONST_FOLDING to support folding of floating point constants. If MICROPY_COMP_MODULE_CONST is defined as well, math module constants are made available at compile time. For example: _DEG_TO_GRADIANT = const(math.pi / 180) _INVALID_VALUE = const(math.nan) A few corner cases had to be handled: - The float const folding code should not fold expressions resulting into complex results, as the mpy parser for complex immediates has limitations. - The constant generation code must distinguish between -0.0 and 0.0, which are different even if C consider them as ==. This change removes previous limitations on the use of `const()` expressions that would result in floating point number, so the test cases of micropython/const_error have to be updated. Additional test cases have been added to cover the new repr() code (from a previous commit). A few other simple test cases have been added to handle the use of floats in `const()` expressions, but the float folding code itself is also tested when running general float test cases, as float expressions often get resolved at compile-time (with this change). Signed-off-by: Yoctopuce dev <dev@yoctopuce.com>	2025-08-01 13:35:44 +10:00
Yoctopuce dev	dbbaa959c8	py/formatfloat: Improve accuracy of float formatting code. ... Following discussions in PR #16666, this commit updates the float formatting code to improve the `repr` reversibility, i.e. the percentage of valid floating point numbers that do parse back to the same number when formatted by `repr` (in CPython it's 100%). This new code offers a choice of 3 float conversion methods, depending on the desired tradeoff between code size and conversion precision: - BASIC method is the smallest code footprint - APPROX method uses an iterative method to approximate the exact representation, which is a bit slower but but does not have a big impact on code size. It provides `repr` reversibility on >99.8% of the cases in double precision, and on >98.5% in single precision (except with REPR_C, where reversibility is 100% as the last two bits are not taken into account). - EXACT method uses higher-precision floats during conversion, which provides perfect results but has a higher impact on code size. It is faster than APPROX method, and faster than the CPython equivalent implementation. It is however not available on all compilers when using FLOAT_IMPL_DOUBLE. Here is the table comparing the impact of the three conversion methods on code footprint on PYBV10 (using single-precision floats) and reversibility rate for both single-precision and double-precision floats. The table includes current situation as a baseline for the comparison: PYBV10 REPR_C FLOAT DOUBLE current = 364688 12.9% 27.6% 37.9% basic = 364812 85.6% 60.5% 85.7% approx = 365080 100.0% 98.5% 99.8% exact = 366408 100.0% 100.0% 100.0% Signed-off-by: Yoctopuce dev <dev@yoctopuce.com>	2025-08-01 00:47:33 +10:00
Yoctopuce dev	e4e1c9f413	py/parsenum: Refactor float parsing code. ... This commit extracts from the current float parsing code two functions which could be reused elsewhere in MicroPython. The code used to multiply a float x by a power of 10 is also simplified by applying the binary exponent separately from the power of 5. This avoids the risk of overflow in the intermediate stage, before multiplying by x. Signed-off-by: Yoctopuce dev <dev@yoctopuce.com>	2025-08-01 00:47:33 +10:00
Damien George	241ee163c0	py/objboundmeth: Add option to use mp_is_equal instead of == comparison. ... This option is needed for ports such as webassembly where objects are proxied and can be identical without being the same C pointer. Signed-off-by: Damien George <damien@micropython.org>	2025-07-31 11:38:35 +10:00
Yanfeng Liu	ab4af2c1a6	py/mphal: Add stddef.h header for size_t. ... This includes "stddef.h" for `size_t` to resolve NuttX integration build issues. Signed-off-by: Yanfeng Liu <yfliu2008@qq.com>	2025-07-30 11:47:43 +10:00
Anson Mansfield	d5dc554742	docs: Document PEP487 __set_name__ implementation. ... Signed-off-by: Anson Mansfield <amansfield@mantaro.com>	2025-07-29 09:44:26 +10:00
Anson Mansfield	4412753f0c	py/objtype: Add support for PEP487 __set_name__. ... This commit adds support for the `__set_name__` data model method specified by PEP487 - Simpler customisation of class creation. This includes support for methods that mutate the owner class, and avoids the naive modify-while-iterating hazard possible in a naive implementation like micropython/micropython#15503. Note that based on the benchmarks in micropython/micropython#16825, this is also as fast or faster than the naive implementation, thanks to clever data layout in `setname_list_t`, and the way this allows the capture step to run during an existing loop through the class dict. Other rejected approaches for dealing with the hazard include: - python/cpython#72983 During the implementation of this feature for MicroPython, it was discovered that some versions of CPython also have this naive hazard. CPython resolved this bug in BPO-28797 and now makes a complete flat copy of the class's dict to iterate. This design decision doesn't make much sense for a microcontroller though, even if it's perfectly reasonable in the desktop world where memcpy might actually be cheaper than a hard-to-branch-predict conditional; and it's also motivated in their case by error-tracing considerations. - micropython/micropython#16816 This is an equivalent implementation to CPython's approach that places this copy directly on the stack; however it is both slower and has larger code size than the approach taken here. - micropython/micropython#15503 The simplest implementation is to just not worry about it and let the user face the consequences if they mutate the owner class. That's not a very friendly behavior, though, and it's not actually much more performant than this implementation on either time or code size. - micropython/micropython#17693 Another alternative is to do the same as #15503 but leverage MicroPython's existing `is_fixed` field in its dict type to convert attempted mutations of the owner dict into `AttributeError`s. This is safer than just leaving the open hazard, but there's still important use-cases for owner-mutating descriptors, and the performance gain is small enough that it isn't worth missing support for those cases. - combined micropython/micropython#17693 with this Another version of this feature used a new feature define, `MICROPY_PY_METACLASSES_LITE`, to control whether this algorithm or the naive version is used. This was rejected in favor of simplicity, based on the very limited performance margin the naive version has (which in some cases even goes _against_ it). Signed-off-by: Anson Mansfield <amansfield@mantaro.com>	2025-07-29 09:41:24 +10:00
Yoctopuce dev	3a72f95919	py/objint_longlong: Fix longlong interoperability with floats. ... Current longlong implementation does not allow a float as RHS of mathematic operators, as it lacks the delegation code present in mpz. Signed-off-by: Yoctopuce dev <dev@yoctopuce.com>	2025-07-29 01:14:35 +10:00
Yoctopuce dev	3c69277ba9	py/objint_longlong: Fix overflow check in mp_obj_int_get_checked. ... This is to fix an outstanding TODO. The test cases is using a range as this will exist in all builds, but `mp_obj_get_int` is used in many different parts of code where an overflow is more likely to occur. Signed-off-by: Yoctopuce dev <dev@yoctopuce.com>	2025-07-29 00:27:01 +10:00
Jeff Epler	062e82a7cd	py/objint_mpz: Fix pow3 where third argument is zero. ... This finding is based on fuzzing MicroPython. I manually minimized the test case it provided. Signed-off-by: Jeff Epler <jepler@gmail.com>	2025-07-28 23:58:46 +10:00
Jeff Epler	ab620f4084	py/mpprint: Fix printing pointers with upper bit set. ... On a build like nanbox, `mp_uint_t` is wider than `u/intptr_t`. Using a signed type for fetching pointer values resulted in erroneous results: like `<function f at 0xfffffffff7a60bc0>` instead of `<function f at 0xf7a60bc0>`. Signed-off-by: Jeff Epler <jepler@gmail.com>	2025-07-25 11:01:42 +10:00
Jeff Epler	ee4f27affa	py/objcell: Fix printing of cell ID/pointer. ... On the nanbox build, `o->obj` is a 64-bit type but `%p` formats a 32-bit type, leading to undefined behavior. Print the cell's ID as a hex integer instead. This location was found using an experimental gcc plugin for `mp_printf` error checking. Signed-off-by: Jeff Epler <jepler@gmail.com>	2025-07-25 11:00:41 +10:00
Jeff Epler	d0d111356f	py: Fix mp_printf integer size mismatches. ... The type of the argument must match the format string. Add casts to ensure that they do. It's possible that casting from `size_t` to `unsigned` loses the correct values by masking off upper bits, but it seems likely that the quantities involved in practice are small enough that the `%u` formatter (32 bits on most platforms, 16 on pic16bit) will in fact hold the correct value. The alternative, casting to a wider type, adds code size. These locations were found using an experimental gcc plugin for `mp_printf` error checking, cross-building for x64 windows on Linux. In one case there was already a cast, but it was written incorrectly and did not have the intended effect. Signed-off-by: Jeff Epler <jepler@gmail.com>	2025-07-25 10:56:57 +10:00
Jeff Epler	519cba4d05	py: Cast type names to qstr explicitly. ... The name field of type objects is of type `uint16_t` for efficiency, but when the type is passed to `mp_printf` it must be cast explicitly to type `qstr`. These locations were found using an experimental gcc plugin for `mp_printf` error checking, cross-building for x64 windows on Linux. Signed-off-by: Jeff Epler <jepler@gmail.com>	2025-07-25 10:56:02 +10:00
Jeff Epler	7493275918	py/mpconfig,ports: Define new HEX_FMT formatting macro. ... Signed-off-by: Jeff Epler <jepler@gmail.com>	2025-07-25 10:55:28 +10:00
Angus Gratton	5d9ef6bfb6	py/objint_longlong: Fix left shift of negative values. ... Previous comment was wrong, left shifting a negative value is UB in C. Use the same approach as small int shifts (from runtime.c). Signed-off-by: Angus Gratton <angus@redyak.com.au>	2025-07-24 15:50:00 +10:00
Damien George	3185bb5827	py/obj: Add new type flag to indicate subscr accepts slice-on-stack. ... The recently merged 5e9189d6d1 now allows temporary slices to be allocated on the C stack, which is much better than allocating them on the GC heap. Unfortunately there are cases where the C-allocated slice can escape and be retained as an object, which leads to crashes (because that object points to the C stack which now has other values on it). The fix here is to add a new `MP_TYPE_FLAG_SUBSCR_ALLOWS_STACK_SLICE`. Native types should set this flag if their subscr method is guaranteed not to hold on to a reference of the slice object. Fixes issue #17733 (see also #17723). Signed-off-by: Damien George <damien@micropython.org>	2025-07-24 14:55:34 +10:00
Yoctopuce dev	d6876e2273	py/obj: Fix REPR_C bias toward zero. ... Current implementation of REPR_C works by clearing the two lower bits of the mantissa to zero. As this happens after each floating point operation, this tends to bias floating point numbers towards zero, causing decimals like .9997 instead of rounded numbers. This is visible in test cases involving repeated computations, such as `tests/misc/rge_sm.py` for instance. The suggested fix fills in the missing bits by copying the previous two bits. Although this cannot recreate missing information, it fixes the bias by inserting plausible values for the lost bits, at a relatively low cost. Some float tests involving irrational numbers have to be softened in case of REPR_C, as the 30 bits are not always enough to fulfill the expectations of the original test, and the change may randomly affect the last digits. Such cases have been made explicit by testing for REPR_C or by adding a clear comment. The perf_test fft code was also missing a call to round() before casting a log_2 operation to int, which was causing a failure due to a last-decimal change. Signed-off-by: Yoctopuce dev <dev@yoctopuce.com>	2025-07-24 11:07:30 +10:00
Jeff Epler	59ee59901b	extmod/vfs_posix: Add MICROPY_VFS_POSIX_WRITABLE option. ... When this configuration flag is set, VfsPosix instances can be written. Otherwise, they will always be created "read only". This flag is useful when fuzzing micropython: Without VfsPosix, the fuzzing input script cannot be read; but with writable VfsPosix, fuzzing scripts can potentially perform undesired operations on the host filesystem. Signed-off-by: Jeff Epler <jepler@gmail.com>	2025-07-24 10:39:41 +10:00
Angus Gratton	9b7d85227e	extmod/mbedtls: Implement recommended DTLS features, make optional. ... - DTLS spec recommends HelloVerify and Anti Replay protection be enabled, and these are enabled in the default mbedTLS config. Implement them here. - To help compensate for the possible increase in code size, add a MICROPY_PY_SSL_DTLS build config macro that's enabled for EXTRA and above by default. This allows bare metal mbedTLS ports to use DTLS with HelloVerify support. This work was funded through GitHub Sponsors. Signed-off-by: Angus Gratton <angus@redyak.com.au>	2025-07-23 15:47:16 +10:00
Damien George	18f2e94846	py/modsys: Add sys.implementation._thread attribute. ... This is useful to distinguish between GIL and non-GIL builds. Signed-off-by: Damien George <damien@micropython.org>	2025-07-22 23:22:05 +10:00
Yanfeng Liu	a8d50fb653	py/mkrules.mk: Mute blobless errors. ... This mutes usage error for blobless update from older `git` to reduce noise upon submodule updating. Signed-off-by: Yanfeng Liu <yfliu2008@qq.com>	2025-07-20 22:59:06 +10:00
Anson Mansfield	ddf2c3afb1	py/objcode: Remove co_lnotab from v2 preview. ... Signed-off-by: Anson Mansfield <amansfield@mantaro.com>	2025-07-18 10:59:21 -04:00
Angus Gratton	17fbc5abdc	py/parsenum: Extend mp_parse_num_integer() to parse long long. ... If big integer support is 'long long' then mp_parse_num_integer() can parse to it directly instead of failing over from small int. This means strtoll() is no longer pulled in, and fixes some bugs parsing long long integers (i.e. can now parse negative values correctly, can now parse values which aren't NULL terminated). The (default) smallint parsing compiled code should stay the same here, macros and a typedef are used to abstract some parts of it out. When bigint is long long we parse to 'unsigned long long' first (to avoid the code size hit of pulling in signed 64-bit math routines) and the convert to signed at the end. One tricky case this routine correctly overflows on is int("9223372036854775808") which is one more than LLONG_MAX in decimal. No unit test case added for this as it's too hard to detect 64-bit long integer mode. This work was funded through GitHub Sponsors. Signed-off-by: Angus Gratton <angus@redyak.com.au>	2025-07-18 00:12:16 +10:00
Angus Gratton	e9845ab20e	py/smallint: Update mp_small_int_mul_overflow() to perform the multiply. ... Makes it compatible with the __builtin_mul_overflow() syntax, used in follow-up commit. Includes optimisation in runtime.c to minimise the code size impact from additional param. Signed-off-by: Damien George <damien@micropython.org> Signed-off-by: Angus Gratton <angus@redyak.com.au>	2025-07-18 00:12:13 +10:00
Angus Gratton	516aa02104	py/objint_longlong: Add arithmetic overflow checks. ... Long long big integer support now raises an exception on overflow rather than returning an undefined result. Also adds an error when shifting by a negative value. The new arithmetic checks are added in the misc.h header. This work was funded through GitHub Sponsors. Signed-off-by: Angus Gratton <angus@redyak.com.au>	2025-07-18 00:12:05 +10:00
Jeff Epler	0a4f9ec46b	py/mpprint: Rework integer vararg handling. ... This adds support for %llx (needed by XINT_FMT for printing cell objects) and incidentally support for capitalized output of %P. It also reduces code size due to the common handling of all integers. Signed-off-by: Jeff Epler <jepler@gmail.com>	2025-07-16 11:12:31 +10:00