4402 Commits

Author	SHA1	Message	Date
Andrew Leech	b603fa38b2	py/mkrules.mk: Reset USER_C_MODULES when building mpy-cross dependency. ... When a port automatically compiles `mpy-cross`, if `USER_C_MODULES` is provided by the user on the command line then it is also applied to the `mpy-cross` build. That can lead to build errors if the path is relative and not found when building `mpy-cross`. Fix that by explicitly resetting `USER_C_MODULES` when invoking the `mpy-cross` build. Signed-off-by: Andrew Leech <andrew.leech@planetinnovation.com.au>	2025-02-07 17:24:43 +11:00
Angus Gratton	990f50fbb8	py/gc: Reorder static functions for clarity. ... - Renamed gc_sweep to gc_sweep_free_blocks. - Call gc_sweep_run_finalisers from top level. - Reordered the gc static functions to be in approximate runtime sequence (with forward declarations) rather than in declaration order. This work was funded through GitHub Sponsors. Signed-off-by: Angus Gratton <angus@redyak.com.au>	2025-02-03 15:02:02 +11:00
Angus Gratton	4bcbe88e74	py: Add optional support for recursive mutexes, use for gc mutex. ... Enabled by default if using threading and no GIL This work was funded through GitHub Sponsors. Signed-off-by: Angus Gratton <angus@redyak.com.au>	2025-02-03 15:02:02 +11:00
Angus Gratton	40e1c111e1	py/gc: Allow gc_free from inside a gc_sweep finalizer. ... Do this by tracking being inside gc collection with a separate flag, GC_COLLECT_FLAG. In gc_free(), ignore this flag when determining if the heap is locked. * For finalisers calling gc_free() when heap is otherwise unlocked, this allows memory to be immediately freed (potentially avoiding a MemoryError). * Hard IRQs still can't call gc_free(), as heap will be locked via gc_lock(). * If finalisers are disabled then all of this code can be compiled out to save some code size. Signed-off-by: Angus Gratton <angus@redyak.com.au>	2025-02-03 15:02:02 +11:00
Angus Gratton	8a2ff2ca73	py/gc: Split out running finalizers to a separate pass. ... Currently a finalizer may run and access memory which has already been freed. (This happens mostly during gc_sweep_all() but could happen during any garbage collection pass.) Includes some speed improvement tweaks to skip empty FTB blocks. These help compensate for the inherent slowdown of having to walk the heap twice. Signed-off-by: Angus Gratton <angus@redyak.com.au>	2025-02-03 15:02:02 +11:00
Jeff Epler	bfb1bee6fe	py/parsenumbase: Favor clarity of code over manual optimisation. ... Follow up to 13b13d1fdd, based on some testing on godbolt, the manual code optimisation seems unnecessary for code size, at least on gcc x86_64 and ARM, and it's definitely not good for clarity. Signed-off-by: Jeff Epler <jepler@gmail.com>	2025-01-29 12:39:05 +11:00
Angus Gratton	22353e9e1e	py/mkrules: Add GIT_SUBMODULES_FAIL_IF_EMPTY flag for CMake ports. ... The way CMake gathers the submodule list, it can quietly be empty if the previous step fails. This makes it an explicit error. This work was funded through GitHub Sponsors. Signed-off-by: Angus Gratton <angus@redyak.com.au>	2025-01-29 11:41:32 +11:00
Alessandro Gatti	55ca3fd675	py/emitnative: Optimise Viper immediate offset load/stores on Xtensa. ... This commit introduces the ability to emit optimised code paths on Xtensa for load/store operations indexed via an immediate offset. If an immediate offset for a load/store operation is within a certain range that allows it to be embedded into an available opcode then said opcode is emitted instead of the generic code sequence. Signed-off-by: Alessandro Gatti <a.gatti@frob.it>	2025-01-26 23:42:36 +11:00
Alessandro Gatti	40585eaa8f	py/emitnative: Emit shorter exception handler entry code on RV32. ... This commit improves the RV32 code sequence that is emitted if a function needs to set up an exception handler as its prologue. The old code would clear a temporary register and then copy that value to places that needed to be initialised with zero values. On RV32 there's a dedicated register that's hardwired to be equal to zero, which allows us to bypass the extra register clear and use the zero register to initialise values. Signed-off-by: Alessandro Gatti <a.gatti@frob.it>	2025-01-26 23:42:36 +11:00
Alessandro Gatti	bfc0d7b0b9	py/emitnative: Optimise Viper register offset load/stores on Xtensa. ... This commit improves the emitted code sequences for address generation in the Viper subsystem when loading/storing 16 and 32 bit values via a register offset. The Xtensa opcodes ADDX2 and ADDX4 are used to avoid performing the extra shifts to align the final operation offset. Those opcodes are available on both xtensa and xtensawin MicroPython architectures. Signed-off-by: Alessandro Gatti <a.gatti@frob.it>	2025-01-26 23:42:36 +11:00
Jeff Epler	13b13d1fdd	py/parsenum: Throw an exception for invalid int literals like "01". ... This includes making int("01") parse in base 10 like standard Python. When a base of 0 is specified it means auto-detect based on the prefix, and literals begining with 0 (except when the literal is all 0's) like "01" are then invalid and now throw an exception. The new error message is different from CPython. It says e.g., `SyntaxError: invalid syntax for integer with base 0: '09'` Additional test cases were added to cover the changed & added code. Co-authored-by: Damien George <damien@micropython.org> Signed-off-by: Jeff Epler <jepler@gmail.com>	2025-01-26 22:54:58 +11:00
IhorNehrutsa	a4ab847688	py/persistentcode: Initialize prelude_ptr to prevent compiler warning. ... The esp32 IDF toolchain can give a "may be used uninitialized" warning, at least for ESP32-S3 with gcc 14.2.0. Silence that warning by initializing the variable with NULL. Co-authored-by: Daniel van de Giessen <daniel@dvdgiessen.nl> Signed-off-by: IhorNehrutsa <Ihor.Nehrutsa@gmail.com>	2025-01-24 23:17:05 +11:00
Damien George	6db29978ac	py/mkrules.mk: Move comment about partial clones outside make rule. ... Otherwise the comment is printed each time the rule is run. Follow up to fdd606dd53. Signed-off-by: Damien George <damien@micropython.org>	2025-01-17 16:58:54 +11:00
Alessandro Gatti	c610199f2d	py/asmarm: Fix halfword loads with larger offsets. ... This commit fixes code generation for loading halfwords using an offset greater than 255. The old code blindly encoded the offset into a `LDRH Rd, [Rn, #imm]` opcode, but only the lowest 8 bits would be put into the opcode itself. This commit instead generates a two-opcodes sequence, a constant load into R8, and then `LDRH Rd, [Rn, R8]`. This fixes `tests/extmod/vfs_rom.py` for the qemu/SABRELITE board. Signed-off-by: Alessandro Gatti <a.gatti@frob.it>	2025-01-16 12:52:32 +11:00
Alessandro Gatti	928c71638c	py/asmarm: Fix locals address loading code generation with large imm. ... This commit fixes code generation for loading a local's address if its index is greater than 63. The old code blindly encoded the offset into an `ADD Rd, Rn, #imm` opcode, but only the lowest 8 bits would be put into the opcode itself. This commit instead generates a two-opcodes sequence, a constant load into R8, and then an `ADD Rd, Rn, R8` opcode. This fixes `tests/float/math_domain.py` for the qemu/SABRELITE board. Signed-off-by: Alessandro Gatti <a.gatti@frob.it>	2025-01-16 12:51:51 +11:00
Damien George	510e055c71	py/asmarm: Allow function state to be larger than 255. ... Co-authored-by: Alessandro Gatti <a.gatti@frob.it> Signed-off-by: Damien George <damien@micropython.org>	2025-01-06 17:55:11 +11:00
Damien George	6a90e513de	py/asmarm: Fix asm_arm_ldrh_reg_reg_offset to emit correct machine code. ... Prior to this fix, the assembler generated `LDRH Rd, [Rn, #imm]!`, so the second `LDRH` from the same origin would load from the wrong base. Co-authored-by: Alessandro Gatti <a.gatti@frob.it> Signed-off-by: Damien George <damien@micropython.org>	2025-01-06 17:55:03 +11:00
Yoctopuce	5d12df51fc	py/obj: Make literals unsigned in float get/new functions. ... Fixes gcc warning when -Wsign-conversion is on. Signed-off-by: Yoctopuce <dev@yoctopuce.com>	2025-01-02 13:36:33 +11:00
Yoctopuce	9bb6b50693	py/obj: Cast float literals to 64-bit to prevent overflow warning. ... Fixes compilation warning C4307: '+': integral constant overflow. Signed-off-by: Yoctopuce <dev@yoctopuce.com>	2025-01-02 13:33:39 +11:00
Alessandro Gatti	268acb714d	py/emitinlinerv32: Add inline assembler support for RV32. ... This commit adds support for writing inline assembler functions when targeting a RV32IMC processor. Given that this takes up a bit of rodata space due to its large instruction decoding table and its extensive error messages, it is enabled by default only on offline targets such as mpy-cross and the qemu port. Signed-off-by: Alessandro Gatti <a.gatti@frob.it>	2025-01-02 11:49:10 +11:00
Alessandro Gatti	3044233ea3	py/misc: Add a popcount(uint32_t) implementation. ... This makes the existing popcount(uint32_t) implementation found in the RV32 emitter available to the rest of the codebase. This version of popcount will use intrinsic or builtin implementations if they are available, falling back to a generic implementation if that is not the case. Signed-off-by: Alessandro Gatti <a.gatti@frob.it>	2025-01-01 10:44:53 +01:00
Damien George	97518064cd	py/persistentcode: Add support for loading .mpy files from a ROM reader. ... This adds an optimisation for loading .mpy files from a reader that points to ROM. In such a case qstr, str and bytes data, along with bytecode, are all referenced in-place in ROM. Signed-off-by: Damien George <damien@micropython.org>	2024-12-23 13:04:55 +11:00
Damien George	f870e8d2d4	py/reader: Provide mp_reader_try_read_rom() function. ... This allows accessing data directly in ROM if the reader supports it. Signed-off-by: Damien George <damien@micropython.org>	2024-12-23 13:04:54 +11:00
Damien George	a1c32101ac	py/qstr: Add qstr_from_strn_static() helper function. ... Allows an interned string to reference static/ROM data, instead of allocating it on the GC heap. Signed-off-by: Damien George <damien@micropython.org>	2024-12-23 13:04:54 +11:00
Damien George	50637ff239	extmod/vfs_rom: Add VfsRom filesystem object. ... This commit defines a new ROMFS filesystem for storing read-only files that can be memory mapped, and a new VfsRom driver. Files opened from this filesystem support the buffer protocol. This allows naturally getting the memory-mapped address of the file using: - memoryview(file) - uctypes.addressof(file) Furthermore, if these files are .mpy files then their content can be referenced in-place when importing. Such imports take up a lot less RAM than importing from a normal filesystem. This is essentially dynamically frozen .mpy files, building on the revamped v6 .mpy file format. Signed-off-by: Damien George <damien@micropython.org>	2024-12-23 13:04:54 +11:00
Alessandro Gatti	4bf087b272	py/dynruntime.mk: Delete compiled module file on clean. ... This commit adds the compiled native module file to the list of files to remove when `make clean` is issued in a native module source directory. Signed-off-by: Alessandro Gatti <a.gatti@frob.it>	2024-12-23 10:03:02 +11:00
Alessandro Gatti	6760e00817	tools/mpy_ld.py: Add native modules support for RV32 code. ... This commit adds support for RV32IMC native modules, as in embedding native code into a self-contained MPY module and and make its exported functions available to the MicroPython environment. Signed-off-by: Alessandro Gatti <a.gatti@frob.it>	2024-12-23 10:02:20 +11:00
Damien George	8b6bd43eab	extmod/vfs: Guard mutating fs functions with MICROPY_VFS_WRITABLE. ... Enabled by default. Useful for ports that need the VFS but don't have any writable filesystems. Signed-off-by: Damien George <damien@micropython.org>	2024-12-20 21:58:50 +11:00
Andrew Leech	fdd606dd53	py/mkrules.mk: Use partial clone for submodules if available. ... MicroPython relies on a number of submodules for third party and chip vendor libraries. Users need to check these out before building their desired ports and Github Actions CI here needs to clone them all multiple times for every build. Many of these are getting significantly larger over time, slowing down usage and consuming more disk space. Newer versions of git have features to avoid pulling all historic / blob data which can have a significant impact of total data use. This commit uses a standard feature of git to do a partial clone, with automatic fallback to previous behavior on error. Signed-off-by: Andrew Leech <andrew.leech@planetinnovation.com.au>	2024-12-10 17:17:17 +11:00
Alessandro Gatti	2a8f6047ff	py/emitglue: Fix clear cache builtin warning on Clang for AArch32. ... This commit fixes a warning occurring on Clang when calling `__builtin___clear_cache` with non-void pointers for its start and end memory area locations. The code now uses a char pointer for the end location, and it still builds without warnings on GCC. Signed-off-by: Alessandro Gatti <a.gatti@frob.it>	2024-12-10 12:04:14 +11:00
stijn	0f7d68043f	py/misc: Fix msvc and C++ compatibility. ... Use an explicit cast to suppress the implicit conversion which started popping up in recent compiler versions (and wasn't there yet in 07bf3179). Signed-off-by: stijn <stijn@ignitron.net>	2024-12-10 11:30:59 +11:00
Angus Gratton	160a4812cd	esp32: Pass V=1 or BUILD_VERBOSE through to idf.py when building. ... Allows verbose build to work the same on esp32 port as other ports. To minimise copy/paste, split the BUILD_VERBOSE section of mkenv.mk out to its own verbose.mk and include this in the port Makefile. Signed-off-by: Angus Gratton <angus@redyak.com.au>	2024-12-10 11:28:38 +11:00
Angus Gratton	3b3b48892f	py/objfloat: Workaround non-constant NAN definition on Windows MSVC. ... Recent MSVC versions have changed the definition of NAN to a non-constant expression! This is a bug, C standard says it should be a constant. Good explanation and workaround at: https://stackoverflow.com/a/79199887 This work was funded through GitHub Sponsors. Signed-off-by: Angus Gratton <angus@redyak.com.au>	2024-11-28 23:11:24 +11:00
Andrew Leech	78d017fc4e	py/usermod.cmake: If USER_C_MODULES is a folder add micropython.cmake. ... This mirrors how it works when using a Makefile. Signed-off-by: Andrew Leech <andrew.leech@planetinnovation.com.au>	2024-11-20 17:38:39 +11:00
Andrew Leech	dccd206f4c	py/usermod.cmake: Add check that any specified USER_C_MODULES exists. ... Signed-off-by: Andrew Leech <andrew.leech@planetinnovation.com.au>	2024-11-20 17:34:41 +11:00
Andrew Leech	b65e89107c	py/py.mk: Add check that any specified USER_C_MODULES folder exists. ... Signed-off-by: Andrew Leech <andrew.leech@planetinnovation.com.au>	2024-11-20 17:34:41 +11:00
Jan Sturm	7e1098befe	py/objdeque: Fix buffer overflow in deque_subscr. ... In `deque_subscr()`, if `index_val` equals `self->alloc`, the index correction `index_val -= self->alloc` does not execute, leading to an out-of-bounds access in `self->items[index_val]`. The fix in this commit ensures that the index correction is applied whenever `index_val >= self->alloc`, preventing access beyond the allocated buffer size. Signed-off-by: Jan Sturm <jansturm92@googlemail.com>	2024-11-04 11:21:56 +11:00
Alessandro Gatti	d34b15ac6f	pic16bit: Make it build with recent XC16 versions. ... The PIC16 port didn't catch up with the other ports, so it required a bit of work to make it build with the latest version of XC16. Signed-off-by: Alessandro Gatti <a.gatti@frob.it>	2024-10-30 17:21:30 +11:00
Damien George	44dc6eb30d	all: Bump version to 1.25.0-preview. ... Signed-off-by: Damien George <damien@micropython.org>	2024-10-28 11:08:24 +11:00
Damien George	f212bbe837	all: Bump version to 1.24.0. ... Signed-off-by: Damien George <damien@micropython.org>	2024-10-26 01:43:23 +11:00
iabdalkader	2644f577f1	extmod/modtls_mbedtls: Add a thread-global ptr for current SSL context. ... This is necessary for mbedTLS callbacks that do not carry any user state, so those callbacks can be customised per SSL context. Signed-off-by: iabdalkader <i.abdalkader@gmail.com>	2024-10-25 01:12:36 +11:00
Damien George	1b89c503db	py/objtype: Don't delegate lookup of descriptor methods to __getattr__. ... When descriptors are enabled, lookup of the `__get__`, `__set__` and `__delete__` descriptor methods should not be delegated to `__getattr__`. That follows CPython behaviour. Signed-off-by: Damien George <damien@micropython.org>	2024-10-16 15:03:30 +11:00
Phil Howard	525fce7170	py/usermod.cmake: Check target exists in usermod_gather_sources. ... Check a target exists before accessing properties. Otherwise usermod_gather_sources would recurse into garbage property names and break. Signed-off-by: Phil Howard <phil@gadgetoid.com>	2024-10-15 11:51:56 +11:00
stijn	338df1ae35	py/objtype: Allow passing keyword arguments to native base __init__. ... Allowing passing keyword arguments to a native base's __init__, i.e. `make_new` in the C code. Previously only positional arguments were allowed. The main trade-off in this commit is that every call to the native base's `make_new` is now going to be preceded by a call to `mp_map_init_fixed_table` even though most of what that does is unused and instead it merely serves as a way to pass the number of keyword arguments. Fixes issue #15465. Signed-off-by: stijn <stijn@ignitron.net>	2024-10-07 11:37:52 +11:00
Alessandro Gatti	ca220b5fc5	py/nlrrv64: Add RISC-V RV64I NLR implementation. ... Add custom NLR support for 64 bits RISC-V RV64I targets. Signed-off-by: Alessandro Gatti <a.gatti@frob.it>	2024-10-03 12:06:19 +10:00
Alessandro Gatti	17d8234458	py/parse: Remove old esp32 compiler workaround. ... The ESP32 port contains a workaround to avoid having a certain function in `py/parse.c` being generated incorrectly. The compiler in question is not part of any currently supported version of ESP-IDF anymore, and the problem inside the compiler (well, assembler in this case) has been corrected a few years ago. This commit removes all traces of that workaround from the source tree. Signed-off-by: Alessandro Gatti <a.gatti@frob.it>	2024-09-27 00:03:16 +10:00
Alessandro Gatti	43b05afdf5	py/mpz: Skip separators when running out of digits to print. ... This commit fixes the addition of a stray separator before the number when printing an MPZ-backed integer and the first group is three digits long. This fixes #8984. Signed-off-by: Alessandro Gatti <a.gatti@frob.it>	2024-09-26 23:39:06 +10:00
Damien George	5b22bde044	py/persistentcode: Explicitly track native BSS/rodata when needed. ... Signed-off-by: Damien George <damien@micropython.org>	2024-09-26 22:15:28 +10:00
Andrew Leech	7e14680a83	py/objringio: Add micropython.RingIO() interface for general use. ... This commit adds a new `RingIO` type which exposes the internal ring-buffer code for general use in Python programs. It has the stream interface making it similar to `StringIO` and `BytesIO`, except `RingIO` has a fixed buffer size and is automatically safe when reads and writes are in different threads or an IRQ. This new type is enabled at the "extra features" ROM level. Signed-off-by: Andrew Leech <andrew.leech@planetinnovation.com.au>	2024-09-19 18:00:44 +10:00
Angus Gratton	52a593cdb1	py/scheduler: Only run callbacks on the main thread if GIL is disabled. ... Otherwise it's very difficult to reason about thread safety in a scheduler callback, as it can run at any time on any thread - including racing against any bytecode operation on any thread. This work was funded through GitHub Sponsors. Signed-off-by: Angus Gratton <angus@redyak.com.au>	2024-09-19 13:17:01 +10:00