What kind of flux are we talking about here? I learned the hard way with some cheap rosin flux that it absolutely has to be cleaned off. I used isopropyl alcohol and a stiff brush after soldering, and that kept everything clean. If you leave any residue, it gets sticky and attracts all kinds of gunk that will eat at the joints.