When you lose Prestige Points, you must move your marker back to the previous Prestige Point Space. Because the 0 space of the Scoring Track is not a Prestige Point space, you cannot lose Prestige Points until your marker has passed the first Prestige Point space.