When I compile ESP32 Aduino code with platform specification espressif32@3.4.0.
The code compiles fine and works, however one thing is strange:
If I compare the IDF version of the running ESP32 with ESP.getSdkVersion() function, I got:
v3.3.5-1-g85c43024c
If i look at this link Releases · platformio/platform-espressif32 · GitHub, it states:
Updated ESP-IDF to the latest 4.3.1
Do I overlook something?
This is correct for projects using the espidf framework directly (framework = espidf, example).
Arduino-ESP32 uses a precompiled ESP-IDF base and does not build ESP-IDF from source. PlatformIO is currently using Arduino-ESP32 version 1.0.6, which is not the latest 2.0 version. Supporting that is an open issue (Support for the latest Arduino v2.0 · Issue #619 · platformio/platform-espressif32 · GitHub) (with workarounds available).
As such, when using PlatformIO with framework = arduino and platform = espressif32 projects, you will have Arduino-ESP32 1.0.6, which based on a precompiled ESP-IDF v3.3 version.
Thank you, clear answer. I will give the latest coreversions an experimental try.
I managed to compile my code and run the code with core version 2.0.2.
Question: Is the IDF on this core also precompiled?
If not I want to tune the WIFI parameters as described in:
https://docs.espressif.com/projects/esp-idf/en/latest/esp32/api-guides/wifi.html
so I can improve the ESP32 server respons speed to match the performance of the ESP8266 webserver , who is remarkable faster then the ESP32 webserver.
All Arduino-ESP32 cores I know are precompiled. The precompiled core is present in v2.0.2 too in the usual form of .a library files, as e.g. in arduino-esp32/tools/sdk/esp32/lib at 2.0.2 · espressif/arduino-esp32 · GitHub. Due to ESF-IDF having a file count size of a bazillion and the compilation time nearing ∞ minutes, I don’t think this ever going to change, as linking a precompiled lib greatly speeds up compilation.
Recompiling the ESP-IDF core of Arduino-ESP32 is a path of pure pain and suffering, based on my experience when I tried it. It worked out in the end, but it really wasn’t nice. Maybe things have improved now. GitHub - espressif/esp32-arduino-lib-builder is your starting point for it – good luck. If you can obtain the needed .a files as linked above, you should be able use them to replace the old ones in C:\users\<user>\.platformio\packages\framework-arduinoespressif32@someversion\tools\sdk\esp32\lib. (Assuming chip = ESP32)
Usually PlatformIO supports the ESP-IDF and Arduino as a component better, but platform-espressif32/examples/espidf-arduino-blink at develop · platformio/platform-espressif32 · GitHub is outdated with respect to the used core and ESP-IDF version.
Ok. When I use the ESP-IDF and Arduino solution, is it possible to config the Wifi parameters?
The ESPIDF-Arduino-Blink example uses a ESP-IDF v4.0 based branch (source), I’m not even sure if that example still compiles. If it does though, yes, you can easily go into the menuconfig and adapt the WiFi settings. If not – best to open an issue and wait for official support to get Arduino Core 2.0.2 + dynamic ESP-IDF base updated in PlatformIO. Per linked issue above though, we aren’t even at the ARduino Core 2.0.2 support stage yet. The other way would be to try using my newly adapted platform and example (GitHub - maxgerhardt/pio-espidf-4.4-test) that can actually build ESP-IDF v4.4. firmwares. Maybe that already works when framework = espidf is changed to framework = espidf, arduino (with the proper menuconfig), but no guarantes or checks.
Thanks for your detailed explanation
I followed your recommendations and did some tests:
1: I tried the platform-espressif32/examples/espidf-arduino-blink at develop · platformio/platform-espressif32 · GitHub example. It compiles fine when I modify the platformio.ini file slightly.
Upload to ESP32 works and the code runs fine and as expected.
I see also sdconfig file.
But when I try to run pio run -t menuconfig to modify the options in this file. I run in an error:
Running menuconfig…
ninja: error: build.ninja:16408: expected ‘=’, got lexing error
t/.platformio/packages/tool-cmake/share/cmake-3.16/Modules/Compiler/Path…
^ near here
Error: Couldn’t execute ‘menuconfig’ target.
scons: *** [menuconfig] Explicit exit, status 1
I am using Atom with Platfom IO core 5.2.4 running on Windows 10.
2: I am trying to install your newly adapted platfrom GitHub - maxgerhardt/pio-espidf-4.4-test
But that fails:
Tool Manager: Installing platformio/toolchain-esp32ulp @ ~1.22851.0
Unpacking…
Tool Manager: toolchain-esp32ulp @ 1.22851.191205 has been installed!
Tool Manager: Installing espressif/toolchain-xtensa-esp32 @ 8.4.0+2021r2
Unpacking…
Tool Manager: toolchain-xtensa-esp32 @ 8.4.0+2021r2 has been installed!
Tool Manager: Installing espressif/toolchain-xtensa-esp32s2 @ 8.4.0+2021r1
Unpacking…
Tool Manager: toolchain-xtensa-esp32s2 @ 8.4.0+2021r1 has been installed!
Tool Manager: Installing espressif/toolchain-riscv32-esp @ 8.4.0+2021r1
Unpacking…
Tool Manager: toolchain-riscv32-esp @ 8.4.0+2021r1 has been installed!
Tool Manager: Installing git+https://github.com/maxgerhardt/esp-idf.git#release/v4.4
git version 2.31.0.windows.1
Cloning into ‘C:\Users\edaut.platformio.cache\tmp\pkg-installing-0hrb_vcy’…
Updating files: 100% (9572/9572), done.
Submodule ‘components/asio/asio’ (GitHub - espressif/asio: Asio C++ Library) registered for path ‘components/asio/asio’
Submodule ‘components/bootloader/subproject/components/micro-ecc/micro-ecc’ (GitHub - kmackay/micro-ecc: ECDH and ECDSA for 8-bit, 32-bit, and 64-bit processors.) registered for path ‘components/boo
tloader/subproject/components/micro-ecc/micro-ecc’
Submodule ‘components/bt/controller/lib_esp32’ (GitHub - espressif/esp32-bt-lib: ESP32 Bluetooth stack (below HCI layer) precompiled libraries) registered for path ‘components/bt/controller/lib_esp32’
Submodule ‘components/bt/controller/lib_esp32c3_family’ (GitHub - espressif/esp32c3-bt-lib: ESP32-C3/S3 Bluetooth stack (below HCI layer) precompiled libraries) registered for path ‘components/bt/controller/li
b_esp32c3_family’
Submodule ‘components/bt/host/nimble/nimble’ (GitHub - espressif/esp-nimble: A fork of NimBLE stack, for use with ESP32 and ESP-IDF) registered for path ‘components/bt/host/nimble/nimble’
Submodule ‘components/cbor/tinycbor’ (GitHub - intel/tinycbor: Concise Binary Object Representation (CBOR) Library) registered for path ‘components/cbor/tinycbor’
Submodule ‘components/cmock/CMock’ (GitHub - ThrowTheSwitch/CMock: CMock - Mock/stub generator for C) registered for path ‘components/cmock/CMock’
Submodule ‘components/coap/libcoap’ (GitHub - obgm/libcoap: A CoAP (RFC 7252) implementation in C) registered for path ‘components/coap/libcoap’
Submodule ‘components/esp_phy/lib’ (GitHub - espressif/esp-phy-lib: Precompiled libraries for low-level RF functions in Espressif chips) registered for path ‘components/esp_phy/lib’
Submodule ‘components/esp_wifi/lib’ (GitHub - espressif/esp32-wifi-lib: ESP32 WiFi stack precompiled libraries) registered for path ‘components/esp_wifi/lib’
Submodule ‘components/esptool_py/esptool’ (GitHub - espressif/esptool: Espressif SoC serial bootloader utility) registered for path ‘components/esptool_py/esptool’
Submodule ‘components/expat/expat’ (GitHub - libexpat/libexpat: Fast streaming XML parser written in C99; migrated from SourceForge to GitHub) registered for path ‘components/expat/expat’
Submodule ‘components/ieee802154/lib’ (GitHub - espressif/esp-ieee802154-lib: IEEE-802.15.4 precompiled libraries.) registered for path ‘components/ieee802154/lib’
Submodule ‘components/json/cJSON’ (GitHub - DaveGamble/cJSON: Ultralightweight JSON parser in ANSI C) registered for path ‘components/json/cJSON’
Submodule ‘components/libsodium/libsodium’ (GitHub - jedisct1/libsodium: A modern, portable, easy to use crypto library.) registered for path ‘components/libsodium/libsodium’
Submodule ‘components/lwip/lwip’ (GitHub - espressif/esp-lwip: Fork of lwIP (https://savannah.nongnu.org/projects/lwip/) with ESP-IDF specific patches) registered for path ‘components/lwip/lwip’
Submodule ‘components/mbedtls/mbedtls’ (GitHub - espressif/mbedtls: An open source, portable, easy to use, readable and flexible SSL library) registered for path ‘components/mbedtls/mbedtls’
Submodule ‘components/mqtt/esp-mqtt’ (GitHub - espressif/esp-mqtt: ESP32 mqtt component) registered for path ‘components/mqtt/esp-mqtt’
Submodule ‘components/nghttp/nghttp2’ (GitHub - nghttp2/nghttp2: nghttp2 - HTTP/2 C Library and tools) registered for path ‘components/nghttp/nghttp2’
Submodule ‘components/openthread/lib’ (GitHub - espressif/esp-thread-lib: Thread protocol related precompiled libraries for ESP-IDF) registered for path ‘components/openthread/lib’
Submodule ‘components/openthread/openthread’ (GitHub - espressif/openthread: Espressif fork of OpenThread project, used to maintain ESP-specific patches and release branches) registered for path ‘components/openthread/openthread’
Submodule ‘components/protobuf-c/protobuf-c’ (GitHub - protobuf-c/protobuf-c: Protocol Buffers implementation in C) registered for path ‘components/protobuf-c/protobuf-c’
Submodule ‘components/spiffs/spiffs’ (GitHub - pellepl/spiffs: Wear-leveled SPI flash file system for embedded devices) registered for path ‘components/spiffs/spiffs’
Submodule ‘components/tinyusb/tinyusb’ (GitHub - espressif/tinyusb: Fork of tinyusb project with Espressif-specific patches.) registered for path ‘components/tinyusb/tinyusb’
Submodule ‘components/unity/unity’ (GitHub - ThrowTheSwitch/Unity: Simple Unit Testing for C) registered for path ‘components/unity/unity’
Submodule ‘examples/build_system/cmake/import_lib/main/lib/tinyxml2’ (GitHub - leethomason/tinyxml2: TinyXML2 is a simple, small, efficient, C++ XML parser that can be easily integrated into other programs.) registered for path ‘examples/build_sys
tem/cmake/import_lib/main/lib/tinyxml2’
Submodule ‘examples/peripherals/secure_element/atecc608_ecdsa/components/esp-cryptoauthlib’ (GitHub - espressif/esp-cryptoauthlib: Release only fork of https://github.com/MicrochipTech/cryptoauthlib) registere
d for path ‘examples/peripherals/secure_element/atecc608_ecdsa/components/esp-cryptoauthlib’
Cloning into ‘C:/Users/edaut/.platformio/.cache/tmp/pkg-installing-0hrb_vcy/components/asio/asio’…
Cloning into ‘C:/Users/edaut/.platformio/.cache/tmp/pkg-installing-0hrb_vcy/components/bootloader/subproject/components/micro-ecc/micro-ecc’…
Cloning into ‘C:/Users/edaut/.platformio/.cache/tmp/pkg-installing-0hrb_vcy/components/bt/controller/lib_esp32’…
Cloning into ‘C:/Users/edaut/.platformio/.cache/tmp/pkg-installing-0hrb_vcy/components/bt/controller/lib_esp32c3_family’…
Cloning into ‘C:/Users/edaut/.platformio/.cache/tmp/pkg-installing-0hrb_vcy/components/bt/host/nimble/nimble’…
Cloning into ‘C:/Users/edaut/.platformio/.cache/tmp/pkg-installing-0hrb_vcy/components/cbor/tinycbor’…
Cloning into ‘C:/Users/edaut/.platformio/.cache/tmp/pkg-installing-0hrb_vcy/components/cmock/CMock’…
Cloning into ‘C:/Users/edaut/.platformio/.cache/tmp/pkg-installing-0hrb_vcy/components/coap/libcoap’…
Cloning into ‘C:/Users/edaut/.platformio/.cache/tmp/pkg-installing-0hrb_vcy/components/esp_phy/lib’…
Cloning into ‘C:/Users/edaut/.platformio/.cache/tmp/pkg-installing-0hrb_vcy/components/esp_wifi/lib’…
Cloning into ‘C:/Users/edaut/.platformio/.cache/tmp/pkg-installing-0hrb_vcy/components/esptool_py/esptool’…
Cloning into ‘C:/Users/edaut/.platformio/.cache/tmp/pkg-installing-0hrb_vcy/components/expat/expat’…
Cloning into ‘C:/Users/edaut/.platformio/.cache/tmp/pkg-installing-0hrb_vcy/components/ieee802154/lib’…
Cloning into ‘C:/Users/edaut/.platformio/.cache/tmp/pkg-installing-0hrb_vcy/components/json/cJSON’…
Cloning into ‘C:/Users/edaut/.platformio/.cache/tmp/pkg-installing-0hrb_vcy/components/libsodium/libsodium’…
Cloning into ‘C:/Users/edaut/.platformio/.cache/tmp/pkg-installing-0hrb_vcy/components/lwip/lwip’…
Cloning into ‘C:/Users/edaut/.platformio/.cache/tmp/pkg-installing-0hrb_vcy/components/mbedtls/mbedtls’…
Cloning into ‘C:/Users/edaut/.platformio/.cache/tmp/pkg-installing-0hrb_vcy/components/mqtt/esp-mqtt’…
Cloning into ‘C:/Users/edaut/.platformio/.cache/tmp/pkg-installing-0hrb_vcy/components/nghttp/nghttp2’…
Cloning into ‘C:/Users/edaut/.platformio/.cache/tmp/pkg-installing-0hrb_vcy/components/openthread/lib’…
Cloning into ‘C:/Users/edaut/.platformio/.cache/tmp/pkg-installing-0hrb_vcy/components/openthread/openthread’…
Cloning into ‘C:/Users/edaut/.platformio/.cache/tmp/pkg-installing-0hrb_vcy/components/protobuf-c/protobuf-c’…
Cloning into ‘C:/Users/edaut/.platformio/.cache/tmp/pkg-installing-0hrb_vcy/components/spiffs/spiffs’…
Cloning into ‘C:/Users/edaut/.platformio/.cache/tmp/pkg-installing-0hrb_vcy/components/tinyusb/tinyusb’…
Cloning into ‘C:/Users/edaut/.platformio/.cache/tmp/pkg-installing-0hrb_vcy/components/unity/unity’…
Cloning into ‘C:/Users/edaut/.platformio/.cache/tmp/pkg-installing-0hrb_vcy/examples/build_system/cmake/import_lib/main/lib/tinyxml2’…
Cloning into ‘C:/Users/edaut/.platformio/.cache/tmp/pkg-installing-0hrb_vcy/examples/peripherals/secure_element/atecc608_ecdsa/components/esp-cryptoauthli
b’…
From GitHub - espressif/asio: Asio C++ Library
============================================================
An unexpected error occurred. Further steps:
Verify that you have the latest version of PlatformIO using
pip install -U platformio command
Try to find answer in FAQ Troubleshooting section
Redirecting...
Report this problem to the developers
Issues · platformio/platformio-core · GitHub
============================================================
Deleted the .platformio\packages directory to eliminate any unwanted dependencies but problem still occurs.
After spending many hours searching a solution and learning a lot of the Platform IO building system.
Finally it works:
Compiling ESP32 core 2.0.2 with IDF 4.4.0 works when using:
downloading GitHub - tasmota/platform-espressif32: Tasmota Espressif 32: development platform for PlatformIO package
and modify
instead of platform = espressif32
in the platform.ini file for example in:
With pio run -t menuconfig using j & k keys scrolling through the IDF menu.
Changing settings to boost webserver performance.
→ Partition Table → Partition Table → (X) Factory app, two OTA definitions
→ Arduino Configuration → [ ] Autoconnect WiFi on boot
→ Compiler options → Optimization Level → (X) Optimize for performance (-O2)
→ Component config → ESP System Settings → [ ] Watch CPU1 Idle Task
→ Component config → Wi-Fi → (16) Max number of WiFi static RX buffers
→ Component config → Wi-Fi → (64) Max number of WiFi dynamic RX buffers
→ Component config → Wi-Fi → (64) Max number of WiFi dynamic TX buffers
→ Component config → Wi-Fi → (32) WiFi AMPDU TX BA window size
→ Component config → Wi-Fi → (32) WiFi AMPDU RX BA window size
→ Component config → Wi-Fi → [ ] WiFi NVS flash
→ Component config → LWIP → [*] Enable LWIP IRAM optimization
→ Component config → LWIP → (64) TCPIP task receive mail box size
→ Component config → LWIP → TCP → (65534) Default send buffer size
→ Component config → LWIP → TCP → (65535) Default receive window size
→ Component config → LWIP → TCP → (64) Default TCP receive mail box size
and manually change
#CONFIG_ESP32_DEFAULT_CPU_FREQ_160 is not set
CONFIG_ESP32_DEFAULT_CPU_FREQ_240=y
CONFIG_ESP32_DEFAULT_CPU_FREQ_MHZ=240
in the device sdkconfig file.
OTA is not working yet. Have to figure that out.
Thanks @jason2866 for your excellent work and @maxgerhardt for your support
Changes for a working OTA solution compatible with the standard Arduino Core:
→ Partition Table → Partition Table → (X) Custom partition table CSV
→ Partition Table → Partition Table → (default.csv) Custom partition CSV file
Put defaults.csv file from the ESP32 Arduino Core packages in the projects dir.
Added board_build.partitions = default.csv in platform.ini file
Compile and perform a serial upload. After that OTA will work.