A comprehensive analysis is presented for the heterogeneous multiscale method (HMM for short) applied to various elliptic homogenization problems. These problems can be either linear or nonlinear, with deterministic or random coefficients. In most cases considered, optimal estimates are proved for the error between the HMM solutions and the homogenized solutions. Strategies for retrieving the microstructural information from the HMM solutions are discussed and analyzed.