Oh yeah, the "leftover gunk" thing is so real. I read something a while back about how brush bristles can actually hold onto old paint or varnish way down near the base, even after a wash. Then it all comes out later as a weird fleck or a sticky spot. I had that happen with a dried bit of white paint that showed up in a clear coat, looked terrible. Now I just toss them way sooner, not worth the stress.