Abstract Purpose: Cancer treatment is limited by inaccurate predictors of patient-specific therapeutic response. Therefore, some patients are exposed to unnecessary side effects and delays in starting effective therapy. A clinical tool that predicts treatment sensitivity for individual patients is needed. Experimental Design: Patient-derived cancer organoids were derived across multiple histologies. The histologic characteristics, mutation profile, clonal structure, and response to chemotherapy and radiation were assessed using bright-field and optical metabolic imaging on spheroid and single-cell levels, respectively. Results: We demonstrate that patient-derived cancer organoids represent the cancers from which they were derived, including key histologic and molecular features. These cultures were generated from numerous cancers, various biopsy sample types, and in different clinical settings. Next-generation sequencing reveals the presence of subclonal populations within the organoid cultures. These cultures allow for the detection of clonal heterogeneity with a greater sensitivity than bulk tumor sequencing. Optical metabolic imaging of these organoids provides cell-level quantification of treatment response and tumor heterogeneity allowing for resolution of therapeutic differences between patient samples. Using this technology, we prospectively predict treatment response for a patient with metastatic colorectal cancer. Conclusions: These studies add to the literature demonstrating feasibility to grow clinical patient-derived organotypic cultures for treatment effectiveness testing. Together, these culture methods and response assessment techniques hold great promise to predict treatment sensitivity for patients with cancer undergoing chemotherapy and/or radiation.