Just use build_flags to add some directory to the include path where the lv_conf.h is and -D LV_CONF_INCLUDE_SIMPLE, to achieve what they talk about in their documentation.
LVGL + ESP-IDF has also been talked about in Espidf lvgl how to use it and the threads linked therein, which is where I got the above example from.