Am I supposed to keep the spacer on my chair?

Yes, please do not remove the spacer. Spacers keep the front of the chair from tilting downward. There should only be one spacer positioned on the bottom of the seat cushion. Not all chairs require a spacer for assembly, check your assembly instructions if you are unsure.