Something like `make -jN` for building?

PlatformIO Core
8

So your saying I just have to live with 2 min build times when build clean? I have 8 cores on my system ;).

9

What’s the native ESP-IDF performance with make -j8 for the same project configuration?

10

How do you add the -j command using platformio?

11

No, I mean, the native ESP-IDF. From their build system, as instructed in GitHub - espressif/esp-idf: Espressif IoT Development Framework. Official development framework for Espressif SoCs. adn Get Started - ESP32 - — ESP-IDF Programming Guide latest documentation

1 Like
12

No idea, the native build system is totally different then PlatformIO’s, and my project is very massive and doesn’t have the component files that native IDF uses.

13

This is so fast 2 minutes for 800Mbytes of source files. I’ve never seen so massive SDK as ESP-IDF. Windows XP distribution has less size :metal:

1 Like
14

Have you run up a task manager to check what the processor core usage is? Unless you fiddle with the platformio.ini file, does platformio not only rebuild modified files? Meaning that subsequent builds are much, much faster?

15

I can confirm looking at task manager it is compiling in parallel, but the annoying part is that any new file, removing of a file, or even changing platformio.ini will cause a clean compile, and re-compile the entire IDF when really I see no reason that the IDF should have to be compiled unless you downloaded an update or modified something in the core. Most other make tools for ESP do this, you only get a single compile of the IDF libraries which is then linked against.

16

Changing the platformio.ini always triggers a re-compile, so it’s best to avoid doing that where possible. As to why adding/removing other files would trigger a re-compile I don’t know the reasoning for, but it does happen. If you simply remove the #include of another file it won’t do a complete re-compile, so it seems adding/removing files is considered a significant enough change to trigger a rebuild… whether it is needed or not. It would be nice to see if that could be made a bit smarter.

17

Hi,
I have the same problem and observation. I’m rather sure PlatformIO use one core in my compilation. I modified ini file and added this:

build_flags =
j=8

This option, as I expected, dramaticaly increase speed of compilation. But proces crashes during library linking. So two steps forward and one back.

18

See Something like `make -jN` for building? - #7 by ivankravets

How many CPUs does Python print?

python -c "from multiprocessing import cpu_count; print(cpu_count())"
19

Python said that 8……………

20

hmmm… But it was on different computer. I’ll check once again it.

21

Hi, how i can set only one job (-j1) in a multihread build?

i have some error in the code but i cant find witch fail when build it in pio because is builded in miltithread mode (40threads in my machine). i think set “-j1” when build i can able depure the code

any hint? I cant find it in the documentation

greetings

22

Implemented in PlatformIO Core 4.0. See Redirecting...

23

Hi, that is implemented in the rc releases?, Because i use platformio rc builds (used rc3 or rc4 when wrote the post)

Greetings

24

PlatformIO Core 4.0 has been just released => Releases · platformio/platformio-core · GitHub

Please switch to the stable version via pio upgrade.

25

oh!. great news

greetings

26

Hey, guys!

Please specify where I need use this option: “-j, --jobs” if I use VSCode?

Thanks!

27

When you want to do what exactly? Compile on all cores or use a single core?