Non-equilibrium state defines physical properties of materials in many technologies, including architectural, metallic, and semiconducting amorphous glasses. In contrast, crystalline electronic and energy materials, such as transparent conductive oxides (TCO), are conventionally thought to be in equilibrium. Here, we demonstrate that high electrical conductivity of crystalline Ga-doped ZnO TCO thin films occurs by virtue of metastable state of their defects. These results imply that such defect metastability may be important in other functional oxides. This finding emphasizes the need to understand and control non-equilibrium states of materials, in particular, their metastable defects, for the design of novel functional materials.