When a Memory must be completed in a limited number of turns, create an Event deck with a number of cards equal to the specified number of turns. Use this deck to count the number of turns left on that Map and set aside unused Event cards. If you draw an Event card with a ?, use the deck of Event cards that were set aside to determine the direction in which the Enemies will move.
If the Memory does not end once the time limit is reached, play the next turns by drawing Event cards from the deck that was set aside.