Compile only my source code / libraries, without linking to framework

Per linked documentation about projenv, no, only src_dir.

In the case of modifying build flags for libs however one can take a very general approach as in Granular optimisation settings to modify the flags arbitrary for any file (that can then be further filtered by filename or path etc.)