I assume this is a true jam...help!?

I went to change filament on the right print head, hit the unload menu, after the heating wait I heard a loud "clicking" many times...when I went to remove the filament I saw that it had broken somewhere in the extruder, clean snap.  I ran unload several times and got some oozing, rammed the thin wire up there a few times...then tried to load new filament...no deal, it doesn't even get deep enough to warm up at all.  Tried pushing on the new filament hoping to fuse it to the broken piece or just push it out (held the loading levers open while doing this).
Tried this a few times, no deal.
Do I now have to remove the print head assembly on the right and clean with acetone or something?
Any advice from any veterans?
I really am apprehensive about removing the head, but I am pretty sure that's the only way to resolve this.
Any advice would be welcome.
Just when things were starting to really work well.
Thanks.