The Scanning Quantum Cryogenic Atom Microscope (SQCRAMscope) is a quantum sensor in which a quasi-1D quantum gas images electromagnetic fields emitted from a nearby sample. We report improvements to the microscope. Cryogen usage is reduced by replacing the liquid cryostat with a closed-cycle system and modified cold finger, and cryogenic cooling is enhanced by adding a radiation shield. The minimum accessible sample temperature is reduced from 35 K to 5.7 K while maintaining low sample vibrations. A new sample mount is easier to exchange, and quantum gas preparation is streamlined.