Not notify those already scheduled when someone refuses an assignment.

I had a user refuse an assignment this week. The email went out asking for a volunteer, which it should have, but it also went out to users who were already scheduled for the week. Any way to filter those names out?