A new miniature panoramic diamond anvil cell (mini-pDAC) as well as a unique gas membrane-driven mechanism is developed and implemented to measure electronic, magnetic, vibrational, and thermodynamic properties of materials using the nuclear resonant inelastic X-ray scattering (NRIXS) and the synchrotron Mössbauer spectroscopy (SMS) simultaneously at high pressure (over Mbar) and low temperature (T < 10 K). The gas membrane system allows in situ pressure tuning of the mini-pDAC at low temperature. The mini-pDAC fits into a specially designed compact liquid helium flow cryostat system to achieve low temperatures, where liquid helium flows through the holder of the mini-pDAC to cool the sample more efficiently. The system has achieved sample temperatures as low as 9 K. Using the membrane, sample pressures of up to 1.4 Mbar have been generated from this mini-pDAC. The instrument has been routinely used at 3-ID, Advanced Photon Source, for NRIXS and SMS studies. The same instrument can easily be used for other X-ray techniques, such as X-ray radial diffraction, X-ray Raman scattering, X-ray emission spectroscopy, and X-ray inelastic scattering under high pressure and low temperature. In this paper, technical details of the mini-pDAC, membrane engaging mechanism, and the cryostat system are described, and some experimental results are discussed.