I am facing the same problem. XIAO is truly a groundbreaking products given its size vs cost. However, the bootloader issues are making me doubt its reliability in the field. For me as well, the programming is a 50-50 chance thing. Sometimes it works, sometimes it doesnt !
Do you know if its possible to replace the current bootloader with a more stable one? Like the one used in Arduino (optiboot) or something?