Fix some ban logic to be nicer to legit people

1 job for ban-logic-fix in 1 minute and 20 seconds (queued for 6 seconds)