Build failing - Arduino ESP32 Project

rohmer · October 23, 2020, 6:31pm

When I build, the build task just hangs at “Building”. I dont see any log files other than a couple of longcmd file.

This is my output:

Processing esp32doit-devkit-v1 (platform: espressif32; board: esp32doit-devkit-v1; framework: arduino)
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------Verbose mode can be enabled via `-v, --verbose` option
CONFIGURATION: https://docs.platformio.org/page/boards/espressif32/esp32doit-devkit-v1.html
PLATFORM: Espressif 32 (2.0.0) > DOIT ESP32 DEVKIT V1
HARDWARE: ESP32 240MHz, 320KB RAM, 4MB Flash
DEBUG: Current (esp-prog) External (esp-prog, iot-bus-jtag, jlink, minimodule, olimex-arm-usb-ocd, olimex-arm-usb-ocd-h, olimex-arm-usb-tiny-h, olimex-jtag-tiny, tumpa)
PACKAGES:
 - framework-arduinoespressif32 3.10004.201016 (1.0.4)
 - tool-esptoolpy 1.20600.0 (2.6.0)
 - toolchain-xtensa32 2.50200.80 (5.2.0)
LDF: Library Dependency Finder -> http://bit.ly/configure-pio-ldf
LDF Modes: Finder ~ chain, Compatibility ~ soft
Found 31 compatible libraries
Scanning dependencies...
Dependency Graph
|-- <lvgl> 7.1.0
|-- <lv_drivers> 7.7.0
|   |-- <lvgl> 7.1.0
|   |-- <Time> 1.5.0
|-- <NtpClientLib> 3.0.2-beta
|   |-- <Time> 1.5.0
|   |-- <ESPAsyncUDP> 0.0.0-alpha+sha.697c75a025
|   |-- <ESP32 Async UDP> 1.0.0
|   |-- <Ticker> 1.1
|   |-- <WiFi> 1.0
Building in release mode
Compiling .pio\build\esp32doit-devkit-v1\src\Logger\Logger.cpp.o
Compiling .pio\build\esp32doit-devkit-v1\src\Time\Clock.cpp.o
Compiling .pio\build\esp32doit-devkit-v1\src\Tools\RingBuf.cpp.o
Compiling .pio\build\esp32doit-devkit-v1\src\main.cpp.o
Generating partitions .pio\build\esp32doit-devkit-v1\partitions.bin
Compiling .pio\build\esp32doit-devkit-v1\lib599\lvgl\lv_core\lv_disp.c.o
Compiling .pio\build\esp32doit-devkit-v1\lib599\lvgl\lv_core\lv_group.c.o
Compiling .pio\build\esp32doit-devkit-v1\lib599\lvgl\lv_core\lv_indev.c.o
Compiling .pio\build\esp32doit-devkit-v1\lib599\lvgl\lv_core\lv_obj.c.o
Compiling .pio\build\esp32doit-devkit-v1\lib599\lvgl\lv_core\lv_refr.c.o
Compiling .pio\build\esp32doit-devkit-v1\lib599\lvgl\lv_core\lv_style.c.o
Compiling .pio\build\esp32doit-devkit-v1\lib599\lvgl\lv_draw\lv_draw_arc.c.o
Compiling .pio\build\esp32doit-devkit-v1\lib599\lvgl\lv_draw\lv_draw_blend.c.o
Compiling .pio\build\esp32doit-devkit-v1\lib599\lvgl\lv_draw\lv_draw_img.c.o
Compiling .pio\build\esp32doit-devkit-v1\lib599\lvgl\lv_draw\lv_draw_label.c.o
Compiling .pio\build\esp32doit-devkit-v1\lib599\lvgl\lv_draw\lv_draw_line.c.o
Compiling .pio\build\esp32doit-devkit-v1\lib599\lvgl\lv_draw\lv_draw_mask.c.o
Compiling .pio\build\esp32doit-devkit-v1\lib599\lvgl\lv_draw\lv_draw_rect.c.o
Compiling .pio\build\esp32doit-devkit-v1\lib599\lvgl\lv_draw\lv_draw_triangle.c.o
Compiling .pio\build\esp32doit-devkit-v1\lib599\lvgl\lv_draw\lv_img_buf.c.o
Compiling .pio\build\esp32doit-devkit-v1\lib599\lvgl\lv_draw\lv_img_cache.c.o
Compiling .pio\build\esp32doit-devkit-v1\lib599\lvgl\lv_draw\lv_img_decoder.c.o
Compiling .pio\build\esp32doit-devkit-v1\lib599\lvgl\lv_font\lv_font.c.o
Compiling .pio\build\esp32doit-devkit-v1\lib599\lvgl\lv_font\lv_font_dejavu_16_persian_hebrew.c.o
Compiling .pio\build\esp32doit-devkit-v1\lib599\lvgl\lv_font\lv_font_fmt_txt.c.o
Compiling .pio\build\esp32doit-devkit-v1\lib599\lvgl\lv_font\lv_font_montserrat_12.c.o
Compiling .pio\build\esp32doit-devkit-v1\lib599\lvgl\lv_font\lv_font_montserrat_12_subpx.c.o
Compiling .pio\build\esp32doit-devkit-v1\lib599\lvgl\lv_font\lv_font_montserrat_14.c.o
Compiling .pio\build\esp32doit-devkit-v1\lib599\lvgl\lv_font\lv_font_montserrat_16.c.o
Compiling .pio\build\esp32doit-devkit-v1\lib599\lvgl\lv_font\lv_font_montserrat_18.c.o
Compiling .pio\build\esp32doit-devkit-v1\lib599\lvgl\lv_font\lv_font_montserrat_20.c.o
Compiling .pio\build\esp32doit-devkit-v1\lib599\lvgl\lv_font\lv_font_montserrat_22.c.o
Compiling .pio\build\esp32doit-devkit-v1\lib599\lvgl\lv_font\lv_font_montserrat_24.c.o
Compiling .pio\build\esp32doit-devkit-v1\lib599\lvgl\lv_font\lv_font_montserrat_26.c.o
Exception in thread Thread-3:
Traceback (most recent call last):
  File "C:\Users\rohme\AppData\Local\Programs\Python\Python39\lib\threading.py", line 950, in _bootstrap_inner
Compiling .pio\build\esp32doit-devkit-v1\lib599\lvgl\lv_font\lv_font_montserrat_28.c.o
    self.run()
  File "C:\Users\rohme\AppData\Local\Programs\Python\Python39\lib\threading.py", line 888, in run
    self._target(*self._args, **self._kwargs)
  File "c:\users\rohme\.platformio\penv\lib\site-packages\platformio\proc.py", line 46, in run
Compiling .pio\build\esp32doit-devkit-v1\lib599\lvgl\lv_font\lv_font_montserrat_28_compressed.c.o
    self.do_reading()
  File "c:\users\rohme\.platformio\penv\lib\site-packages\platformio\proc.py", line 69, in do_reading
    for byte in iter(lambda: self._pipe_reader.read(1), ""):
  File "c:\users\rohme\.platformio\penv\lib\site-packages\platformio\proc.py", line 69, in <lambda>
    for byte in iter(lambda: self._pipe_reader.read(1), ""):
  File "C:\Users\rohme\AppData\Local\Programs\Python\Python39\lib\encodings\cp1252.py", line 23, in decode
Compiling .pio\build\esp32doit-devkit-v1\lib599\lvgl\lv_font\lv_font_montserrat_30.c.o
    return codecs.charmap_decode(input,self.errors,decoding_table)[0]
UnicodeDecodeError: 'charmap' codec can't decode byte 0x9d in position 201: character maps to <undefined>
Compiling .pio\build\esp32doit-devkit-v1\lib599\lvgl\lv_font\lv_font_montserrat_32.c.o
Compiling .pio\build\esp32doit-devkit-v1\lib599\lvgl\lv_font\lv_font_montserrat_34.c.o
Compiling .pio\build\esp32doit-devkit-v1\lib599\lvgl\lv_font\lv_font_montserrat_36.c.o
Compiling .pio\build\esp32doit-devkit-v1\lib599\lvgl\lv_font\lv_font_montserrat_38.c.o
Compiling .pio\build\esp32doit-devkit-v1\lib599\lvgl\lv_font\lv_font_montserrat_40.c.o
Compiling .pio\build\esp32doit-devkit-v1\lib599\lvgl\lv_font\lv_font_montserrat_42.c.o
Compiling .pio\build\esp32doit-devkit-v1\lib599\lvgl\lv_font\lv_font_montserrat_44.c.o
Compiling .pio\build\esp32doit-devkit-v1\lib599\lvgl\lv_font\lv_font_montserrat_46.c.o
Compiling .pio\build\esp32doit-devkit-v1\lib599\lvgl\lv_font\lv_font_montserrat_48.c.o
Compiling .pio\build\esp32doit-devkit-v1\lib599\lvgl\lv_font\lv_font_simsun_16_cjk.c.o
Compiling .pio\build\esp32doit-devkit-v1\lib599\lvgl\lv_font\lv_font_unscii_8.c.o
Compiling .pio\build\esp32doit-devkit-v1\lib599\lvgl\lv_gpu\lv_gpu_stm32_dma2d.c.o
Compiling .pio\build\esp32doit-devkit-v1\lib599\lvgl\lv_hal\lv_hal_disp.c.o
Compiling .pio\build\esp32doit-devkit-v1\lib599\lvgl\lv_hal\lv_hal_indev.c.o
Compiling .pio\build\esp32doit-devkit-v1\lib599\lvgl\lv_hal\lv_hal_tick.c.o
Compiling .pio\build\esp32doit-devkit-v1\lib599\lvgl\lv_misc\lv_anim.c.o
Compiling .pio\build\esp32doit-devkit-v1\lib599\lvgl\lv_misc\lv_area.c.o
Compiling .pio\build\esp32doit-devkit-v1\lib599\lvgl\lv_misc\lv_async.c.o
Compiling .pio\build\esp32doit-devkit-v1\lib599\lvgl\lv_misc\lv_bidi.c.o
Compiling .pio\build\esp32doit-devkit-v1\lib599\lvgl\lv_misc\lv_color.c.o
Compiling .pio\build\esp32doit-devkit-v1\lib599\lvgl\lv_misc\lv_debug.c.o
Compiling .pio\build\esp32doit-devkit-v1\lib599\lvgl\lv_misc\lv_fs.c.o
Compiling .pio\build\esp32doit-devkit-v1\lib599\lvgl\lv_misc\lv_gc.c.o
Compiling .pio\build\esp32doit-devkit-v1\lib599\lvgl\lv_misc\lv_ll.c.o
Compiling .pio\build\esp32doit-devkit-v1\lib599\lvgl\lv_misc\lv_log.c.o
Compiling .pio\build\esp32doit-devkit-v1\lib599\lvgl\lv_misc\lv_math.c.o
Compiling .pio\build\esp32doit-devkit-v1\lib599\lvgl\lv_misc\lv_mem.c.o
Compiling .pio\build\esp32doit-devkit-v1\lib599\lvgl\lv_misc\lv_printf.c.o
Compiling .pio\build\esp32doit-devkit-v1\lib599\lvgl\lv_misc\lv_task.c.o
Compiling .pio\build\esp32doit-devkit-v1\lib599\lvgl\lv_misc\lv_templ.c.o
Compiling .pio\build\esp32doit-devkit-v1\lib599\lvgl\lv_misc\lv_txt.c.o
Compiling .pio\build\esp32doit-devkit-v1\lib599\lvgl\lv_misc\lv_txt_ap.c.o

It just sits there. In verbose there arent any errors shown either.

I havent the faintest idea about the encodings issue (Dont know what file its on either :()

Any suggestions? Ive reinstalled VS.Code, PlatformIO, tried the beta, done clean rebuilds, tried creating a new project

maxgerhardt · October 23, 2020, 6:35pm

rohmer:

Compiling .pio\build\esp32doit-devkit-v1\lib599\lvgl\lv_font\lv_font_montserrat_26.c.o
Exception in thread Thread-3:
Traceback (most recent call last):
  File "C:\Users\rohme\AppData\Local\Programs\Python\Python39\lib\threading.py", line 950, in _bootstrap_inner
    self.run()
  File "C:\Users\rohme\AppData\Local\Programs\Python\Python39\lib\threading.py", line 888, in run
    self._target(*self._args, **self._kwargs)
  File "c:\users\rohme\.platformio\penv\lib\site-packages\platformio\proc.py", line 46, in run
    self.do_reading()
  File "c:\users\rohme\.platformio\penv\lib\site-packages\platformio\proc.py", line 69, in do_reading
    for byte in iter(lambda: self._pipe_reader.read(1), ""):
  File "c:\users\rohme\.platformio\penv\lib\site-packages\platformio\proc.py", line 69, in <lambda>
    for byte in iter(lambda: self._pipe_reader.read(1), ""):
  File "C:\Users\rohme\AppData\Local\Programs\Python\Python39\lib\encodings\cp1252.py", line 23, in decode
    return codecs.charmap_decode(input,self.errors,decoding_table)[0]
UnicodeDecodeError: 'charmap' codec can't decode byte 0x9d in position 201: character maps to <undefined>

A python thread crashed when it attempted to read a weird character encoded by 0x9d at position 201 in some file or stream.

… suspicious maybe due to encoded characters…

Do you have the project uploaded or a minimal-reproducable-example of it?

rohmer · October 23, 2020, 6:50pm

Ok, I think it may be just that. I am looking at the files and they have things like:
/* U+F00C “” */

The files are encoded to UTF-8, so its a bit odd.

rohmer · October 23, 2020, 6:55pm

Ok, this is weird… I have removed lvgl, which had the suspect files.

------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------Verbose mode can be enabled via `-v, --verbose` option
CONFIGURATION: https://docs.platformio.org/page/boards/espressif32/esp32doit-devkit-v1.html
PLATFORM: Espressif 32 (2.0.0) > DOIT ESP32 DEVKIT V1
HARDWARE: ESP32 240MHz, 320KB RAM, 4MB Flash
DEBUG: Current (esp-prog) External (esp-prog, iot-bus-jtag, jlink, minimodule, olimex-arm-usb-ocd, olimex-arm-usb-ocd-h, olimex-arm-usb-tiny-h, olimex-jtag-tiny, tumpa)
PACKAGES:
 - framework-arduinoespressif32 3.10004.201016 (1.0.4)
 - tool-esptoolpy 1.20600.0 (2.6.0)
 - toolchain-xtensa32 2.50200.80 (5.2.0)
LDF: Library Dependency Finder -> http://bit.ly/configure-pio-ldf
LDF Modes: Finder ~ chain, Compatibility ~ soft
Found 29 compatible libraries
Scanning dependencies...
Dependency Graph
|-- <NtpClientLib> 3.0.2-beta
|   |-- <Time> 1.5.0
|   |-- <ESPAsyncUDP> 0.0.0-alpha+sha.697c75a025
|   |-- <ESP32 Async UDP> 1.0.0
|   |-- <Ticker> 1.1
|   |-- <WiFi> 1.0
Building in release mode
Compiling .pio\build\esp32doit-devkit-v1\src\Logger\Logger.cpp.o
Compiling .pio\build\esp32doit-devkit-v1\src\Time\Clock.cpp.o
Compiling .pio\build\esp32doit-devkit-v1\src\Tools\RingBuf.cpp.o
Compiling .pio\build\esp32doit-devkit-v1\src\main.cpp.o
Generating partitions .pio\build\esp32doit-devkit-v1\partitions.bin
Compiling .pio\build\esp32doit-devkit-v1\lib503\Time\DateStrings.cpp.o
Compiling .pio\build\esp32doit-devkit-v1\lib503\Time\Time.cpp.o
Exception in thread Thread-3:
Traceback (most recent call last):
  File "C:\Users\rohme\AppData\Local\Programs\Python\Python37\lib\threading.py", line 926, in _bootstrap_inner
    self.run()
  File "C:\Users\rohme\AppData\Local\Programs\Python\Python37\lib\threading.py", line 870, in run
    self._target(*self._args, **self._kwargs)
  File "c:\users\rohme\.platformio\penv\lib\site-packages\platformio\proc.py", line 46, in run
    self.do_reading()
  File "c:\users\rohme\.platformio\penv\lib\site-packages\platformio\proc.py", line 69, in do_reading
    for byte in iter(lambda: self._pipe_reader.read(1), ""):
  File "c:\users\rohme\.platformio\penv\lib\site-packages\platformio\proc.py", line 69, in <lambda>
    for byte in iter(lambda: self._pipe_reader.read(1), ""):
  File "C:\Users\rohme\AppData\Local\Programs\Python\Python37\lib\encodings\cp1252.py", line 23, in decode
    return codecs.charmap_decode(input,self.errors,decoding_table)[0]
UnicodeDecodeError: 'charmap' codec can't decode byte 0x9d in position 210: character maps to <undefined>

Compiling .pio\build\esp32doit-devkit-v1\lib4c3\ESPAsyncUDP\AsyncUDP.cpp.o
Compiling .pio\build\esp32doit-devkit-v1\lib94c\AsyncUDP\AsyncUDP.cpp.o
Compiling .pio\build\esp32doit-devkit-v1\lib151\Ticker\Ticker.cpp.o
Compiling .pio\build\esp32doit-devkit-v1\lib1de\WiFi\ETH.cpp.o
Compiling .pio\build\esp32doit-devkit-v1\lib1de\WiFi\WiFi.cpp.o

maxgerhardt · October 23, 2020, 6:57pm

Well somehow it reads the pipe in CP1252 encoding, which is just 8-bit extended ASCII (Windows-1252 - Wikipedia) and not UTF-8. Can you temparily move font files which have problematic comments in them to somewhere else to see if the build goes further (but then of course errors out with undefined symbols at the very end)?

rohmer · October 23, 2020, 6:58pm

Yeah, I removed them completely. Thats the baffling part

rohmer · October 23, 2020, 6:59pm

If I could just figure out WHERE it was dying, I’d be golden

maxgerhardt · October 23, 2020, 7:05pm

Yeah the multi-threaded nature of the compilation doesn’t make this easy, but it’s got to be in one of the last #number of CPU threads your computer has files. If assuming 16 threads, candidates are

rohmer:

Compiling .pio\build\esp32doit-devkit-v1\lib599\lvgl\lv_draw\lv_draw_triangle.c.o
Compiling .pio\build\esp32doit-devkit-v1\lib599\lvgl\lv_draw\lv_img_buf.c.o
Compiling .pio\build\esp32doit-devkit-v1\lib599\lvgl\lv_draw\lv_img_cache.c.o
Compiling .pio\build\esp32doit-devkit-v1\lib599\lvgl\lv_draw\lv_img_decoder.c.o
Compiling .pio\build\esp32doit-devkit-v1\lib599\lvgl\lv_font\lv_font.c.o
Compiling .pio\build\esp32doit-devkit-v1\lib599\lvgl\lv_font\lv_font_dejavu_16_persian_hebrew.c.o
Compiling .pio\build\esp32doit-devkit-v1\lib599\lvgl\lv_font\lv_font_fmt_txt.c.o
Compiling .pio\build\esp32doit-devkit-v1\lib599\lvgl\lv_font\lv_font_montserrat_12.c.o
Compiling .pio\build\esp32doit-devkit-v1\lib599\lvgl\lv_font\lv_font_montserrat_12_subpx.c.o
Compiling .pio\build\esp32doit-devkit-v1\lib599\lvgl\lv_font\lv_font_montserrat_14.c.o
Compiling .pio\build\esp32doit-devkit-v1\lib599\lvgl\lv_font\lv_font_montserrat_16.c.o
Compiling .pio\build\esp32doit-devkit-v1\lib599\lvgl\lv_font\lv_font_montserrat_18.c.o
Compiling .pio\build\esp32doit-devkit-v1\lib599\lvgl\lv_font\lv_font_montserrat_20.c.o
Compiling .pio\build\esp32doit-devkit-v1\lib599\lvgl\lv_font\lv_font_montserrat_22.c.o
Compiling .pio\build\esp32doit-devkit-v1\lib599\lvgl\lv_font\lv_font_montserrat_24.c.o
Compiling .pio\build\esp32doit-devkit-v1\lib599\lvgl\lv_font\lv_font_montserrat_26.c.o

I’ll shorty try to compile an example project from PlatformIO Registry to see if it’s replicatable.

rohmer · October 23, 2020, 7:08pm

Yeah, I removed all of those. Thats the weird part.

I have now stripped everything out of the project…
DF: Library Dependency Finder → Library Dependency Finder (LDF) — PlatformIO latest documentation
LDF Modes: Finder ~ chain, Compatibility ~ soft
Found 29 compatible libraries
Scanning dependencies…
No dependencies
Building in release mode
Compiling .pio\build\esp32doit-devkit-v1\src\main.cpp.o
Generating partitions .pio\build\esp32doit-devkit-v1\partitions.bin
Archiving .pio\build\esp32doit-devkit-v1\libFrameworkArduinoVariant.a
Compiling .pio\build\esp32doit-devkit-v1\FrameworkArduino\Esp.cpp.o
Compiling .pio\build\esp32doit-devkit-v1\FrameworkArduino\FunctionalInterrupt.cpp.o
Compiling .pio\build\esp32doit-devkit-v1\FrameworkArduino\HardwareSerial.cpp.o
Compiling .pio\build\esp32doit-devkit-v1\FrameworkArduino\IPAddress.cpp.o
Compiling .pio\build\esp32doit-devkit-v1\FrameworkArduino\IPv6Address.cpp.o
Compiling .pio\build\esp32doit-devkit-v1\FrameworkArduino\MD5Builder.cpp.o
Compiling .pio\build\esp32doit-devkit-v1\FrameworkArduino\Print.cpp.o
Compiling .pio\build\esp32doit-devkit-v1\FrameworkArduino\Stream.cpp.o
Compiling .pio\build\esp32doit-devkit-v1\FrameworkArduino\StreamString.cpp.o
Compiling .pio\build\esp32doit-devkit-v1\FrameworkArduino\WMath.cpp.o
Compiling .pio\build\esp32doit-devkit-v1\FrameworkArduino\WString.cpp.o
Exception in thread Thread-3:
Traceback (most recent call last):
File “C:\Users\rohme\AppData\Local\Programs\Python\Python37\lib\threading.py”, line 926, in _bootstrap_inner
self.run()
File “C:\Users\rohme\AppData\Local\Programs\Python\Python37\lib\threading.py”, line 870, in run
self._target(*self._args, **self._kwargs)
File “c:\users\rohme.platformio\penv\lib\site-packages\platformio\proc.py”, line 46, in run
self.do_reading()
File “c:\users\rohme.platformio\penv\lib\site-packages\platformio\proc.py”, line 69, in do_reading
for byte in iter(lambda: self._pipe_reader.read(1), “”):
File “c:\users\rohme.platformio\penv\lib\site-packages\platformio\proc.py”, line 69, in
for byte in iter(lambda: self._pipe_reader.read(1), “”):
File “C:\Users\rohme\AppData\Local\Programs\Python\Python37\lib\encodings\cp1252.py”, line 23, in decode
return codecs.charmap_decode(input,self.errors,decoding_table)[0]
UnicodeDecodeError: ‘charmap’ codec can’t decode byte 0x9d in position 201: character maps to

Compiling .pio\build\esp32doit-devkit-v1\FrameworkArduino\base64.cpp.o
Compiling .pio\build\esp32doit-devkit-v1\FrameworkArduino\cbuf.cpp.o
Compiling .pio\build\esp32doit-devkit-v1\FrameworkArduino\esp32-hal-adc.c.o
Compiling .pio\build\esp32doit-devkit-v1\FrameworkArduino\esp32-hal-bt.c.o
Compiling .pio\build\esp32doit-devkit-v1\FrameworkArduino\esp32-hal-cpu.c.o
Compiling .pio\build\esp32doit-devkit-v1\FrameworkArduino\esp32-hal-dac.c.o
Compiling .pio\build\esp32doit-devkit-v1\FrameworkArduino\esp32-hal-gpio.c.o
Compiling .pio\build\esp32doit-devkit-v1\FrameworkArduino\esp32-hal-i2c.c.o
Compiling .pio\build\esp32doit-devkit-v1\FrameworkArduino\esp32-hal-ledc.c.o
Compiling .pio\build\esp32doit-devkit-v1\FrameworkArduino\esp32-hal-matrix.c.o
Compiling .pio\build\esp32doit-devkit-v1\FrameworkArduino\esp32-hal-misc.c.o
Compiling .pio\build\esp32doit-devkit-v1\FrameworkArduino\esp32-hal-psram.c.o
Compiling .pio\build\esp32doit-devkit-v1\FrameworkArduino\esp32-hal-rmt.c.o
Compiling .pio\build\esp32doit-devkit-v1\FrameworkArduino\esp32-hal-sigmadelta.c.o
Compiling .pio\build\esp32doit-devkit-v1\FrameworkArduino\esp32-hal-spi.c.o
Compiling .pio\build\esp32doit-devkit-v1\FrameworkArduino\esp32-hal-time.c.o
Compiling .pio\build\esp32doit-devkit-v1\FrameworkArduino\esp32-hal-timer.c.o
Compiling .pio\build\esp32doit-devkit-v1\FrameworkArduino\esp32-hal-touch.c.o
Compiling .pio\build\esp32doit-devkit-v1\FrameworkArduino\esp32-hal-uart.c.o
Compiling .pio\build\esp32doit-devkit-v1\FrameworkArduino\libb64\cdecode.c.o
Compiling .pio\build\esp32doit-devkit-v1\FrameworkArduino\libb64\cencode.c.o
Compiling .pio\build\esp32doit-devkit-v1\FrameworkArduino\main.cpp.o
Compiling .pio\build\esp32doit-devkit-v1\FrameworkArduino\stdlib_noniso.c.o
Compiling .pio\build\esp32doit-devkit-v1\FrameworkArduino\wiring_pulse.c.o
Compiling .pio\build\esp32doit-devkit-v1\FrameworkArduino\wiring_shift.c.o
Archiving .pio\build\esp32doit-devkit-v1\libFrameworkArduino.a
Linking .pio\build\esp32doit-devkit-v1\firmware.elf
Building .pio\build\esp32doit-devkit-v1\firmware.bin
Retrieving maximum program size .pio\build\esp32doit-devkit-v1\firmware.elf
Checking size .pio\build\esp32doit-devkit-v1\firmware.elf
Advanced Memory Usage is available via “PlatformIO Home > Project Inspect”
RAM: [ ] 4.5% (used 14700 bytes from 327680 bytes)
Flash: [== ] 16.0% (used 209799 bytes from 1310720 bytes)
esptool.py v2.6
================================================================================================ [SUCCESS] Took 9.84 seconds ================================================================================================

Terminal will be reused by tasks, press any key to close it.

Its building now, but I still get that python error.

rohmer · October 23, 2020, 7:18pm

I removed everything and am slowly adding stuff back, recompiling after each try.

rohmer · October 23, 2020, 7:35pm

https://raw.githubusercontent.com/wizard97/ArduinoRingBuffer/master/RingBuf.h

That is the offending file. Why I have no clue, but it is.

maxgerhardt · October 23, 2020, 7:38pm

This file has “smart quotes” which differ from ASCII quotes:

        #warning “This library only fully supports AVR and ESP8266 Boards.”
        #warning "Operations on the buffer in ISRs are not safe!"

can you replace the “ with "?

rohmer · October 23, 2020, 7:41pm

Ahhh… I missed em.

Well, I suppose this exposes something that could definitely be added to platformio, and that is hardening of the input.

maxgerhardt · October 23, 2020, 7:44pm

How does this library get in the project anyway? It’s a ring buffer library which doesn’t support the ESP32 architecture you’re compiling for. It’s not thread-safe, which is pretty much one of the main points for a ringbuffer.

github.com

wizard97/ArduinoRingBuffer/blob/9d7d0a75a75c1e334d8b861d25762c4fc5ab1496/RingBuf.h#L31-L52


      
          #elif defined(ARDUINO_ARCH_ESP8266)
              #ifndef __STRINGIFY
                  #define __STRINGIFY(a) #a
              #endif
          
          
    #ifndef xt_rsil
                  #define xt_rsil(level) (__extension__({uint32_t state; __asm__ __volatile__("rsil %0," __STRINGIFY(level) : "=a" (state)); state;}))
              #endif
          
          
    #ifndef xt_wsr_ps
                  #define xt_wsr_ps(state)  __asm__ __volatile__("wsr %0,ps; isync" :: "a" (state) : "memory")
              #endif
          
          
    #define RB_ATOMIC_START do { uint32_t _savedIS = xt_rsil(15) ;
              #define RB_ATOMIC_END xt_wsr_ps(_savedIS); } while(0);
          
          
#else
              #define RB_ATOMIC_START {
              #define RB_ATOMIC_END }
              #warning “This library only fully supports AVR and ESP8266 Boards.”

This file has been truncated. show original

maxgerhardt · October 23, 2020, 7:47pm

I also don’t see ArduinoRingBuffer in your library depedency graph.

Or did you install this as a global library?

maxgerhardt · October 23, 2020, 7:55pm

@ivankravets the following error is reproducable: If GCC emits a warning which has non-ASCII / CP1252 encoded characters in it, PIO crashes when reading the GCC output.

platformio.ini

[env:uno]
platform = atmelavr
board = uno
framework = arduino

main.cpp

#include <Arduino.h>

#warning "Normal warning. Does not crash PIO"
#warning “This warning with smart quotes crashes PIO.”

void setup() { }

void loop() { }

The project must be cleaned and built again to trigger the GCC output and crash. GCC still creates the object file, so building the project twice works… but every time the source code is changed and the file is recompiled and the warning is outputted, it crashes again.

Exception in thread Thread-3:
Traceback (most recent call last):
  File "c:\users\maxi\appdata\local\programs\python\python37\lib\threading.py", line 926, in _bootstrap_inner
    self.run()
  File "c:\users\maxi\appdata\local\programs\python\python37\lib\threading.py", line 870, in run
    self._target(*self._args, **self._kwargs)
  File "c:\users\maxi\appdata\local\programs\python\python37\lib\site-packages\platformio\proc.py", line 46, in run
    self.do_reading()
  File "c:\users\maxi\appdata\local\programs\python\python37\lib\site-packages\platformio\proc.py", line 69, in do_reading
    for byte in iter(lambda: self._pipe_reader.read(1), ""):
  File "c:\users\maxi\appdata\local\programs\python\python37\lib\site-packages\platformio\proc.py", line 69, in <lambda>
    for byte in iter(lambda: self._pipe_reader.read(1), ""):
  File "c:\users\maxi\appdata\local\programs\python\python37\lib\encodings\cp1252.py", line 23, in decode
    return codecs.charmap_decode(input,self.errors,decoding_table)[0]
UnicodeDecodeError: 'charmap' codec can't decode byte 0x9d in position 84: character maps to <undefined>

Latest pio upgrade --dev core is used.

ivankravets · October 23, 2020, 8:07pm

Does it seem like a bug of Python 3.8+? We ship PlatformIO Core installer with Python 3.7 for Windows. Could you try the latest Python 3.7?

rohmer · October 23, 2020, 8:07pm

This happens in python 3.7 as well, that was one of the attempted “fixes” I tried

maxgerhardt · October 23, 2020, 8:09pm

Running 3.7.6 here, 2 minors away from the 3.7.8 highest possible one, but still.

manuelbl · October 23, 2020, 8:13pm

I guess it’s this bug (ignore the title, it’s misleading):

github.com/platformio/platformio-core

Problem with Python 3.8+ on Windows when network drive is used

opened 08:09AM - 12 Mar 20 UTC

closed 03:58PM - 20 Apr 23 UTC

Hofei90

bug build system

The cause of the issue: https://bugs.python.org/issue37993 ## Solution 1 1…. [Open Windows Registry `regedit.exe`](https://support.microsoft.com/en-us/windows/how-to-open-registry-editor-in-windows-10-deab38e6-91d6-e0aa-4b7c-8878d9e07b11) 2. Create a new key named `Command Processor` at `HKEY_CURRENT_USER\Software\Microsoft` ![Screen Shot 2021-03-31 at 18 14 29](https://user-images.githubusercontent.com/1760209/113168160-13f6a380-924d-11eb-8274-a8f8783eb0f6.png) 3. Create a new `DWORD (32-bit) Value` named `DisableUNCCheck` ![Screen Shot 2021-03-31 at 18 16 50](https://user-images.githubusercontent.com/1760209/113168432-561fe500-924d-11eb-9bec-7276bf9dfa35.png) 4. Set the value of `DisableUNCCheck` to `1` (Hex) ![Screen Shot 2021-03-31 at 18 21 32](https://user-images.githubusercontent.com/1760209/113169172-04c42580-924e-11eb-9817-82f273bf6da9.png) 5. Restart your Windows machine. ## Solution 2 1. Download [our portable Python 3.7](https://dl.registry.platformio.org/download/platformio/tool/python-portable/1.30707.0/python-portable-windows_amd64-1.30707.0.tar.gz) 2. Extract and replace contents in `%HOMEPATH%/.platformio/python3`. 3. Remove `%HOMEPATH%/.platformio/penv` folder. 4. Restart VSCode. ------------------- ### Configuration **Operating system**: Windows_NT x64 10.0.17763 **PlatformIO Version** (`platformio --version`): 4.2.2b1 and 4.2.1 **Python Version** 3.8 32bit ### Description of problem During compilation I get the Python Traceback UnicodeDecodeError: 'charmap' codec can't decode byte. Full Message: ``` > Executing task in folder IR_Sender_WB: C:\Users\***\.platformio\penv\Scripts\platformio.exe run < Processing nodemcuv2 (platform: espressif8266; board: nodemcuv2; framework: arduino) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ Verbose mode can be enabled via `-v, --verbose` option CONFIGURATION: https://docs.platformio.org/page/boards/espressif8266/nodemcuv2.html PLATFORM: Espressif 8266 2.3.3 > NodeMCU 1.0 (ESP-12E Module) HARDWARE: ESP8266 80MHz, 80KB RAM, 4MB Flash PACKAGES: - framework-arduinoespressif8266 3.20603.200130 (2.6.3) - tool-esptool 1.413.0 (4.13) - tool-esptoolpy 1.20800.0 (2.8.0) - toolchain-xtensa 2.40802.191122 (4.8.2) LDF: Library Dependency Finder -> http://bit.ly/configure-pio-ldf LDF Modes: Finder ~ chain, Compatibility ~ soft Found 31 compatible libraries Scanning dependencies... Dependency Graph |-- <IRremoteESP8266> 2.7.4 Building in release mode Compiling .pio\build\nodemcuv2\src\main.cpp.o Generating LD script .pio\build\nodemcuv2\ld\local.eagle.app.v6.common.ld Exception in thread Thread-3: Traceback (most recent call last): File "C:\Users\***\AppData\Local\Programs\Python\Python38-32\lib\threading.py", line 932, in _bootstrap_inner self.run() File "C:\Users\***\AppData\Local\Programs\Python\Python38-32\lib\threading.py", line 870, in run self._target(*self._args, **self._kwargs) File "c:\users\***\.platformio\penv\lib\site-packages\platformio\proc.py", line 46, in run self.do_reading() File "c:\users\***\.platformio\penv\lib\site-packages\platformio\proc.py", line 69, in do_reading for byte in iter(lambda: self._pipe_reader.read(1), ""): File "c:\users\***\.platformio\penv\lib\site-packages\platformio\proc.py", line 69, in <lambda> for byte in iter(lambda: self._pipe_reader.read(1), ""): File "C:\Users\***\AppData\Local\Programs\Python\Python38-32\lib\encodings\cp1252.py", line 23, in decode return codecs.charmap_decode(input,self.errors,decoding_table)[0] UnicodeDecodeError: 'charmap' codec can't decode byte 0x81 in position 167: character maps to <undefined> Compiling .pio\build\nodemcuv2\lib70a\IRremoteESP8266\IRac.cpp.o Compiling .pio\build\nodemcuv2\lib70a\IRremoteESP8266\IRrecv.cpp.o Compiling .pio\build\nodemcuv2\lib70a\IRremoteESP8266\IRsend.cpp.o Compiling .pio\build\nodemcuv2\lib70a\IRremoteESP8266\IRtext.cpp.o Compiling .pio\build\nodemcuv2\lib70a\IRremoteESP8266\IRtimer.cpp.o Compiling .pio\build\nodemcuv2\lib70a\IRremoteESP8266\IRutils.cpp.o ======================================================================================== [FAILED] Took 5.42 seconds ======================================================================================== The terminal process terminated with exit code: 1 Terminal will be reused by tasks, press any key to close it. ``` ### If problems with PlatformIO Build System: **The content of `platformio.ini`:** ```ini ; PlatformIO Project Configuration File ; ; Build options: build flags, source filter ; Upload options: custom upload port, speed and extra flags ; Library options: dependencies, extra library storages ; Advanced options: extra scripting ; ; Please visit documentation for the other options and examples ; https://docs.platformio.org/page/projectconf.html [env:nodemcuv2] platform = espressif8266 board = nodemcuv2 framework = arduino monitor_speed = 115200 ``` ### Additional info On another PC with Python version 3.7 there are no problems compiling. Here are the data of the PC where there is no problem: Version: 1.43.0 (user setup) Commit: 78a4c91400152c0f27ba4d363eb56d2835f9903a Date: 2020-03-09T19:47:57.235Z Electron: 7.1.11 Chrome: 78.0.3904.130 Node.js: 12.8.1 V8: 7.8.279.23-electron.0 OS: Windows_NT x64 10.0.17763 PlatformIO: Core 4.2.1, Home 3.1.1

It has quite a history (fixed, reverted, reopened)…