Build for esp32 with `framework = arduino, espidf` fails

So maybe I should try taking a different angle. If I build with just the arduino framework the build will pick up the pre-built esp-idf from somewhere (I presume from somewhere in my ~/.platformio structure?).

Is there a way I can tell it to pick up espidf from another location, so I can prepare a build that is suited to what I want to try?