Ok, for a few days now whenever I launched a new Firefox window on my Windows 7 box, I'd get the Error Console window pop up. This was tres annoying.
The "All-in-One Gestures" add-in was being too helpful. I disabled that and used FireGestures instead.
Now the Error Console only shows up when I enter Ctl-Shift-J.