If you do not rule (or no longer rule) any feudums, you are not subject to point deductions. Even without a feudum, a player may still put player discs onto the military track for each successful conquer action in anticipation of becoming a vassal later.