We have recently reported atomic spectroscopy using on-chip rubidium vapor cells based on hollow core waveguides. To make the cells more robust and capable of multiple temperature cycles, we examined several techniques for Rb introduction and sealing. To date the most successful sealing technique has been pinching off the end of a short length of copper tubing. This technique not only hermetically seals the cells, but also allows them to be evacuated to a desired pressure. We have been able to evacuate glass prototype Rb vapor cells to a pressure as low as 80 mTorr and as high as 2 Torr and successfully observe the Rb optical absorption spectrum. Along with our testing of sealing techniques we have been observing the effects of different epoxies and inert gas atmospheres on the robustness of vapor cells. With optimal parameters we have successfully observed the Rb optical absorption spectrum through multiple temperature cycles. These new Rb introduction and sealing methods will be applied to on-chip cells containing integrated hollow waveguides which can be used for a number of different optical applications, such as electromagnetically induced transparency, single-photon nonlinearities, and slow light.