Always a Bigger Fish is designed to rarely run out of cards in the draw deck. Using fewer than the recommended sets for your player count will make running out much more likely. Should you choose to play with a smaller deck size, you should still follow the same rule when the deck runs out. See FAQ on when the deck runs out of cards.