Undefined reference to ESP-IDF component

kossnikita · March 28, 2023, 11:08am

Greetings!
I’m trying to reproduce esp-idf example storage/spiffsgen.

Getting error:

c:/users/kossn/.platformio/packages/toolchain-xtensa-esp32/bin/../lib/gcc/xtensa-esp32-elf/11.2.0/../../../../xtensa-esp32-elf/bin/ld.exe: .pio\build\esp32dev\src\spiffsgen_example_main.o:(.literal.compute_alice_txt_md5+0x14): undefined reference to `mbedtls_md5_init'
c:/users/kossn/.platformio/packages/toolchain-xtensa-esp32/bin/../lib/gcc/xtensa-esp32-elf/11.2.0/../../../../xtensa-esp32-elf/bin/ld.exe: .pio\build\esp32dev\src\spiffsgen_example_main.o:(.literal.compute_alice_txt_md5+0x18): undefined reference to `mbedtls_md5_starts'
c:/users/kossn/.platformio/packages/toolchain-xtensa-esp32/bin/../lib/gcc/xtensa-esp32-elf/11.2.0/../../../../xtensa-esp32-elf/bin/ld.exe: .pio\build\esp32dev\src\spiffsgen_example_main.o:(.literal.compute_alice_txt_md5+0x1c): undefined reference to `mbedtls_md5_update'
c:/users/kossn/.platformio/packages/toolchain-xtensa-esp32/bin/../lib/gcc/xtensa-esp32-elf/11.2.0/../../../../xtensa-esp32-elf/bin/ld.exe: .pio\build\esp32dev\src\spiffsgen_example_main.o:(.literal.compute_alice_txt_md5+0x20): undefined reference to `mbedtls_md5_finish'
c:/users/kossn/.platformio/packages/toolchain-xtensa-esp32/bin/../lib/gcc/xtensa-esp32-elf/11.2.0/../../../../xtensa-esp32-elf/bin/ld.exe: .pio\build\esp32dev\src\spiffsgen_example_main.o: in function `compute_alice_txt_md5':
D:\ESP32\spiffsgen/src/spiffsgen_example_main.c:45: undefined reference to `mbedtls_md5_init'
c:/users/kossn/.platformio/packages/toolchain-xtensa-esp32/bin/../lib/gcc/xtensa-esp32-elf/11.2.0/../../../../xtensa-esp32-elf/bin/ld.exe: D:\ESP32\spiffsgen/src/spiffsgen_example_main.c:46: undefined reference to `mbedtls_md5_starts'
c:/users/kossn/.platformio/packages/toolchain-xtensa-esp32/bin/../lib/gcc/xtensa-esp32-elf/11.2.0/../../../../xtensa-esp32-elf/bin/ld.exe: D:\ESP32\spiffsgen/src/spiffsgen_example_main.c:62: undefined reference to `mbedtls_md5_update'
c:/users/kossn/.platformio/packages/toolchain-xtensa-esp32/bin/../lib/gcc/xtensa-esp32-elf/11.2.0/../../../../xtensa-esp32-elf/bin/ld.exe: D:\ESP32\spiffsgen/src/spiffsgen_example_main.c:63: undefined reference to `mbedtls_md5_finish'

In .map file cross reference section I have wrong reference:

mbedtls_internal_sha256_process                   .pio\build\esp32dev\esp-idf\mbedtls\mbedtls\library\libmbedcrypto.a(esp_sha256.o)
mbedtls_md5_finish                                .pio\build\esp32dev\src\spiffsgen_example_main.o
mbedtls_md5_init                                  .pio\build\esp32dev\src\spiffsgen_example_main.o
mbedtls_md5_starts                                .pio\build\esp32dev\src\spiffsgen_example_main.o
mbedtls_md5_update                                .pio\build\esp32dev\src\spiffsgen_example_main.o
mbedtls_sha256_clone                              .pio\build\esp32dev\esp-idf\mbedtls\mbedtls\library\libmbedcrypto.a(esp_sha256.o)
mbedtls_sha256_finish                             .pio\build\esp32dev\esp-idf\mbedtls\mbedtls\library\libmbedcrypto.a(esp_sha256.o)
                                                  .pio\build\esp32dev\esp-idf\bootloader_support\libbootloader_support.a(bootloader_sha.o)
mbedtls_sha256_free                               .pio\build\esp32dev\esp-idf\mbedtls\mbedtls\library\libmbedcrypto.a(esp_sha256.o)
                                                  .pio\build\esp32dev\esp-idf\bootloader_support\libbootloader_support.a(bootloader_sha.o)
mbedtls_sha256_init                               .pio\build\esp32dev\esp-idf\mbedtls\mbedtls\library\libmbedcrypto.a(esp_sha256.o)
                                                  .pio\build\esp32dev\esp-idf\bootloader_support\libbootloader_support.a(bootloader_sha.o)
mbedtls_sha256_starts                             .pio\build\esp32dev\esp-idf\mbedtls\mbedtls\library\libmbedcrypto.a(esp_sha256.o)
                                                  .pio\build\esp32dev\esp-idf\bootloader_support\libbootloader_support.a(bootloader_sha.o)
mbedtls_sha256_update                             .pio\build\esp32dev\esp-idf\mbedtls\mbedtls\library\libmbedcrypto.a(esp_sha256.o)
                                                  .pio\build\esp32dev\esp-idf\bootloader_support\libbootloader_support.a(bootloader_sha.o)

But, they linked in esp-idf\mbedtls\mbedtls\library\libmbedcrypto.a

build.ninja:

#############################################
# Link the static library esp-idf\mbedtls\mbedtls\library\libmbedcrypto.a

build esp-idf/mbedtls/mbedtls/library/libmbedcrypto.a: CXX_STATIC_LIBRARY_LINKER__mbedcrypto esp-idf/mbedtls/mbedtls/library/CMakeFiles/mbedcrypto.dir/aes.c.obj esp-idf/mbedtls/mbedtls/library/CMakeFiles/mbedcrypto.dir/aesni.c.obj esp-idf/mbedtls/mbedtls/library/CMakeFiles/mbedcrypto.dir/aria.c.obj esp-idf/mbedtls/mbedtls/library/CMakeFiles/mbedcrypto.dir/asn1parse.c.obj esp-idf/mbedtls/mbedtls/library/CMakeFiles/mbedcrypto.dir/asn1write.c.obj esp-idf/mbedtls/mbedtls/library/CMakeFiles/mbedcrypto.dir/base64.c.obj esp-idf/mbedtls/mbedtls/library/CMakeFiles/mbedcrypto.dir/bignum.c.obj esp-idf/mbedtls/mbedtls/library/CMakeFiles/mbedcrypto.dir/camellia.c.obj esp-idf/mbedtls/mbedtls/library/CMakeFiles/mbedcrypto.dir/ccm.c.obj esp-idf/mbedtls/mbedtls/library/CMakeFiles/mbedcrypto.dir/chacha20.c.obj esp-idf/mbedtls/mbedtls/library/CMakeFiles/mbedcrypto.dir/chachapoly.c.obj esp-idf/mbedtls/mbedtls/library/CMakeFiles/mbedcrypto.dir/cipher.c.obj esp-idf/mbedtls/mbedtls/library/CMakeFiles/mbedcrypto.dir/cipher_wrap.c.obj esp-idf/mbedtls/mbedtls/library/CMakeFiles/mbedcrypto.dir/constant_time.c.obj esp-idf/mbedtls/mbedtls/library/CMakeFiles/mbedcrypto.dir/cmac.c.obj esp-idf/mbedtls/mbedtls/library/CMakeFiles/mbedcrypto.dir/ctr_drbg.c.obj esp-idf/mbedtls/mbedtls/library/CMakeFiles/mbedcrypto.dir/des.c.obj esp-idf/mbedtls/mbedtls/library/CMakeFiles/mbedcrypto.dir/dhm.c.obj esp-idf/mbedtls/mbedtls/library/CMakeFiles/mbedcrypto.dir/ecdh.c.obj esp-idf/mbedtls/mbedtls/library/CMakeFiles/mbedcrypto.dir/ecdsa.c.obj esp-idf/mbedtls/mbedtls/library/CMakeFiles/mbedcrypto.dir/ecjpake.c.obj esp-idf/mbedtls/mbedtls/library/CMakeFiles/mbedcrypto.dir/ecp.c.obj esp-idf/mbedtls/mbedtls/library/CMakeFiles/mbedcrypto.dir/ecp_curves.c.obj esp-idf/mbedtls/mbedtls/library/CMakeFiles/mbedcrypto.dir/entropy.c.obj esp-idf/mbedtls/mbedtls/library/CMakeFiles/mbedcrypto.dir/entropy_poll.c.obj esp-idf/mbedtls/mbedtls/library/CMakeFiles/mbedcrypto.dir/error.c.obj esp-idf/mbedtls/mbedtls/library/CMakeFiles/mbedcrypto.dir/gcm.c.obj esp-idf/mbedtls/mbedtls/library/CMakeFiles/mbedcrypto.dir/hkdf.c.obj esp-idf/mbedtls/mbedtls/library/CMakeFiles/mbedcrypto.dir/hmac_drbg.c.obj esp-idf/mbedtls/mbedtls/library/CMakeFiles/mbedcrypto.dir/md.c.obj esp-idf/mbedtls/mbedtls/library/CMakeFiles/mbedcrypto.dir/md5.c.obj esp-idf/mbedtls/mbedtls/library/CMakeFiles/mbedcrypto.dir/memory_buffer_alloc.c.obj esp-idf/mbedtls/mbedtls/library/CMakeFiles/mbedcrypto.dir/mps_reader.c.obj esp-idf/mbedtls/mbedtls/library/CMakeFiles/mbedcrypto.dir/mps_trace.c.obj esp-idf/mbedtls/mbedtls/library/CMakeFiles/mbedcrypto.dir/nist_kw.c.obj esp-idf/mbedtls/mbedtls/library/CMakeFiles/mbedcrypto.dir/oid.c.obj esp-idf/mbedtls/mbedtls/library/CMakeFiles/mbedcrypto.dir/padlock.c.obj esp-idf/mbedtls/mbedtls/library/CMakeFiles/mbedcrypto.dir/pem.c.obj esp-idf/mbedtls/mbedtls/library/CMakeFiles/mbedcrypto.dir/pk.c.obj esp-idf/mbedtls/mbedtls/library/CMakeFiles/mbedcrypto.dir/pk_wrap.c.obj esp-idf/mbedtls/mbedtls/library/CMakeFiles/mbedcrypto.dir/pkcs12.c.obj esp-idf/mbedtls/mbedtls/library/CMakeFiles/mbedcrypto.dir/pkcs5.c.obj esp-idf/mbedtls/mbedtls/library/CMakeFiles/mbedcrypto.dir/pkparse.c.obj esp-idf/mbedtls/mbedtls/library/CMakeFiles/mbedcrypto.dir/pkwrite.c.obj esp-idf/mbedtls/mbedtls/library/CMakeFiles/mbedcrypto.dir/platform.c.obj esp-idf/mbedtls/mbedtls/library/CMakeFiles/mbedcrypto.dir/platform_util.c.obj esp-idf/mbedtls/mbedtls/library/CMakeFiles/mbedcrypto.dir/poly1305.c.obj esp-idf/mbedtls/mbedtls/library/CMakeFiles/mbedcrypto.dir/psa_crypto.c.obj esp-idf/mbedtls/mbedtls/library/CMakeFiles/mbedcrypto.dir/psa_crypto_aead.c.obj esp-idf/mbedtls/mbedtls/library/CMakeFiles/mbedcrypto.dir/psa_crypto_cipher.c.obj esp-idf/mbedtls/mbedtls/library/CMakeFiles/mbedcrypto.dir/psa_crypto_client.c.obj esp-idf/mbedtls/mbedtls/library/CMakeFiles/mbedcrypto.dir/psa_crypto_driver_wrappers.c.obj esp-idf/mbedtls/mbedtls/library/CMakeFiles/mbedcrypto.dir/psa_crypto_ecp.c.obj esp-idf/mbedtls/mbedtls/library/CMakeFiles/mbedcrypto.dir/psa_crypto_hash.c.obj esp-idf/mbedtls/mbedtls/library/CMakeFiles/mbedcrypto.dir/psa_crypto_mac.c.obj esp-idf/mbedtls/mbedtls/library/CMakeFiles/mbedcrypto.dir/psa_crypto_rsa.c.obj esp-idf/mbedtls/mbedtls/library/CMakeFiles/mbedcrypto.dir/psa_crypto_se.c.obj esp-idf/mbedtls/mbedtls/library/CMakeFiles/mbedcrypto.dir/psa_crypto_slot_management.c.obj esp-idf/mbedtls/mbedtls/library/CMakeFiles/mbedcrypto.dir/psa_crypto_storage.c.obj esp-idf/mbedtls/mbedtls/library/CMakeFiles/mbedcrypto.dir/psa_its_file.c.obj esp-idf/mbedtls/mbedtls/library/CMakeFiles/mbedcrypto.dir/ripemd160.c.obj esp-idf/mbedtls/mbedtls/library/CMakeFiles/mbedcrypto.dir/rsa.c.obj esp-idf/mbedtls/mbedtls/library/CMakeFiles/mbedcrypto.dir/rsa_alt_helpers.c.obj esp-idf/mbedtls/mbedtls/library/CMakeFiles/mbedcrypto.dir/sha1.c.obj esp-idf/mbedtls/mbedtls/library/CMakeFiles/mbedcrypto.dir/sha256.c.obj esp-idf/mbedtls/mbedtls/library/CMakeFiles/mbedcrypto.dir/sha512.c.obj esp-idf/mbedtls/mbedtls/library/CMakeFiles/mbedcrypto.dir/ssl_debug_helpers_generated.c.obj esp-idf/mbedtls/mbedtls/library/CMakeFiles/mbedcrypto.dir/threading.c.obj esp-idf/mbedtls/mbedtls/library/CMakeFiles/mbedcrypto.dir/timing.c.obj esp-idf/mbedtls/mbedtls/library/CMakeFiles/mbedcrypto.dir/version.c.obj esp-idf/mbedtls/mbedtls/library/CMakeFiles/mbedcrypto.dir/version_features.c.obj esp-idf/mbedtls/mbedtls/library/CMakeFiles/mbedcrypto.dir/__/__/port/esp_hardware.c.obj esp-idf/mbedtls/mbedtls/library/CMakeFiles/mbedcrypto.dir/__/__/port/esp_mem.c.obj esp-idf/mbedtls/mbedtls/library/CMakeFiles/mbedcrypto.dir/__/__/port/esp_timing.c.obj esp-idf/mbedtls/mbedtls/library/CMakeFiles/mbedcrypto.dir/__/__/port/sha/esp_sha.c.obj esp-idf/mbedtls/mbedtls/library/CMakeFiles/mbedcrypto.dir/__/__/port/aes/esp_aes_xts.c.obj esp-idf/mbedtls/mbedtls/library/CMakeFiles/mbedcrypto.dir/__/__/port/aes/esp_aes_common.c.obj esp-idf/mbedtls/mbedtls/library/CMakeFiles/mbedcrypto.dir/__/__/port/aes/block/esp_aes.c.obj esp-idf/mbedtls/mbedtls/library/CMakeFiles/mbedcrypto.dir/__/__/port/sha/parallel_engine/sha.c.obj esp-idf/mbedtls/mbedtls/library/CMakeFiles/mbedcrypto.dir/__/__/port/esp_bignum.c.obj esp-idf/mbedtls/mbedtls/library/CMakeFiles/mbedcrypto.dir/__/__/port/esp32/bignum.c.obj esp-idf/mbedtls/mbedtls/library/CMakeFiles/mbedcrypto.dir/__/__/port/sha/parallel_engine/esp_sha1.c.obj esp-idf/mbedtls/mbedtls/library/CMakeFiles/mbedcrypto.dir/__/__/port/sha/parallel_engine/esp_sha256.c.obj esp-idf/mbedtls/mbedtls/library/CMakeFiles/mbedcrypto.dir/__/__/port/sha/parallel_engine/esp_sha512.c.obj esp-idf/mbedtls/mbedtls/library/CMakeFiles/mbedcrypto.dir/__/__/port/aes/esp_aes_gcm.c.obj esp-idf/mbedtls/mbedtls/library/CMakeFiles/mbedcrypto.dir/__/__/port/md/esp_md.c.obj || esp-idf/mbedtls/mbedtls/library/libmbedx509.a
  LANGUAGE_COMPILE_FLAGS = -mlongcalls -Wno-frame-address
  OBJECT_DIR = esp-idf\mbedtls\mbedtls\library\CMakeFiles\mbedcrypto.dir
  POST_BUILD = cd .
  PRE_LINK = cd .
  TARGET_COMPILE_PDB = esp-idf\mbedtls\mbedtls\library\CMakeFiles\mbedcrypto.dir\mbedcrypto.pdb
  TARGET_FILE = esp-idf\mbedtls\mbedtls\library\libmbedcrypto.a
  TARGET_PDB = esp-idf\mbedtls\mbedtls\library\libmbedcrypto.pdb

maxgerhardt · March 28, 2023, 11:14am

You may be running in

github.com/platformio/platform-espressif32

Cannot use mbedtls in esp-idf from main firmware

opened 12:32PM - 09 Nov 22 UTC

maxgerhardt

bug ESP-IDF

Reproduction: 1. Create a new blank ESP-IDF project for ESP32 Dev Module 2. Mo…dify the source code `src/main.c` to ```cpp #include "mbedtls/aes.h" void app_main() { mbedtls_aes_context ctx; mbedtls_aes_init(&ctx); } ``` 3, Hit compile: ``` Linking .pio/build/esp32dev/firmware.elf /home/max/.platformio/packages/toolchain-xtensa-esp32/bin/../lib/gcc/xtensa-esp32-elf/8.4.0/../../../../xtensa-esp32-elf/bin/ld: .pio/build/esp32dev/src/main.o:(.literal.app_main+0x0): undefined reference to `mbedtls_aes_init' /home/max/.platformio/packages/toolchain-xtensa-esp32/bin/../lib/gcc/xtensa-esp32-elf/8.4.0/../../../../xtensa-esp32-elf/bin/ld: .pio/build/esp32dev/src/main.o: in function `app_main': /home/max/temp/espidf_mbedtls_bug/src/main.c:6: undefined reference to `mbedtls_aes_init' collect2: error: ld returned 1 exit status *** [.pio/build/esp32dev/firmware.elf] Error 1 ``` 4. Realize when looking at the verbose compile log, that when the mbedtls library is compiled, it does so with the flag ``` -DMBEDTLS_CONFIG_FILE=\"mbedtls/esp_config.h\" ``` 5. Realize that this flag is not in the compiler invocation for the firmware files in `src/`. 6. Set source code to ```cpp #define MBEDTLS_CONFIG_FILE "mbedtls/esp_config.h" #include "mbedtls/aes.h" void app_main() { mbedtls_aes_context ctx; mbedtls_aes_init(&ctx); } ``` --> it compiles thanks to the [config file being correctly selected](https://github.com/espressif/mbedtls/blob/89da85968417ce4a163b7275cb22f159995c271d/include/mbedtls/aes.h#L43-L48) ``` Linking .pio/build/esp32dev/firmware.elf Retrieving maximum program size .pio/build/esp32dev/firmware.elf Checking size .pio/build/esp32dev/firmware.elf Advanced Memory Usage is available via "PlatformIO Home > Project Inspect" RAM: [ ] 3.5% (used 11312 bytes from 327680 bytes) Flash: [== ] 16.1% (used 169253 bytes from 1048576 bytes) Building .pio/build/esp32dev/firmware.bin esptool.py v4.2.1 Creating esp32 image... Merged 2 ELF sections Successfully created esp32 image. ============[SUCCESS] Took 7.62 seconds ============= ``` Conclusion: "Something" is preventing the `src/` files in the main PlatformIO projects from getting the critical macro for the mbedtls config file. This causes problems when calling some mbedtls functions which the actual config redefined [to have other names](https://github.com/espressif/esp-idf/blob/1cb31e50943bb757966ca91ed7f4852692a5b0ed/components/mbedtls/port/include/aes_alt.h#L30-L39). See discussion in [community topic](https://community.platformio.org/t/linking-problem-with-the-blufi-example/30365/6?u=maxgerhardt).

kossnikita · March 28, 2023, 11:17am

Thanks you very much!