When you win a battle against a White Walker, return it to its pool on the White Walker Mat. This is also true if you defeat the Ice Dragon and a White Walker in the same domain (return the Ice Dragon where the Wall was, and return the White Walker back to its mat).