I can't really say that's unfair... once a traitor with the hijack objective emagged me. I decapitated an IPC in three hits, and almost completed the objective for the traitor... if not Fox who hid in the shuttle command area and i failed to notice him.
But agreed, hiding under chairs + a robust weapon like the plasma cutter makes it very difficult to defeat a smart-ish drone if you don't have a ranged weapon.
Keeping them connected to the central drone console would be probably a good idea, it would force drones to be more stealthy, and the console would have a real purpose at last (currently it is mainly used to grief other drones, or kill griefer drones). Emagged borgs can be blown up and locked down just like normal borgs, if i recall correctly, so why not drones?