How to remove TSRs and startup programs

Question

How to remove TSR (terminate-and-stay-resident) programs temporarily from memory, and how to prevent them from automatically loading each time your computer boots.