Borrowing from jackie chan cartoon: Perhaps each demon is weak/sealed with a specific item/material, most likely something the weapon or scabbard is made from. So exposure to that thing of power keeps the demon in check. Like a fire demon wielder has to drink holy water to quell the hellfire within so they keep it on a steel(fireproof) hipflask.