Recent findings of macroscopic quantum properties in high critical temperature superconductor (HTS) Josephson junctions (JJs) point toward the need to revise the role of zero energy quasi-particles in this novel superconductor. We will discuss the possibility of designing superconducting artificial atoms in a transmon configuration to study the low energy excitation spectra of HTS. We have engineered high quality grain boundary JJs on low dielectric constant substrates. By fabricating submicron junctions, we extract values of capacitance and Josephson critical current densities that satisfy the main transmon design requirements. Moreover, the measured critical current noise power extrapolated at 1 Hz gives a dephasing time of 25 ns, which indicates that the observation of macroscopic quantum coherent effects in HTS JJ is a feasible task.