Hm, the issue is about constantly firing interrupts for GPIO36 & 39 [TW#15819] GPIO 36 & 39 input interrupt continually fires for high input when ADC1 is also in use (IDFGH-3954) · Issue #1096 · espressif/esp-idf · GitHub when ADC1 or ADC2 or WiFi is in use. One solution was to use poll those GPIO’s instead using an ISR.
Have yout tried this?