Those servants might have to wait until midnight or later for their master. But they will be happy when their master comes in and finds them still waiting.
Remember this: If the owner of the house knew what time the thief was coming, then the owner would be ready for him. The owner would watch and not let the thief enter his house.