If the barricade is destroyed around the base, and the murderers aren't able to attack anyone, they will walk outside the base area and roam around leaving the raid able base radius.
Murderers walking away from the base
i have the same problem.
My easy bases dont have walls around, the npcs just wander around in a large area :D