How about voicing every other user before you devoice the muted user, so you don\'t have others muted as well.