This MR removes most uses of sleeps. There's still a bunch left, but these are left for another iteration.