We present a new approach to incorporate self-assembled quantum dots into a Fabry-Pérot-like microcavity. Thereby a 3$λ$/4 GaAs layer containing quantum dots is epitaxially removed and attached by van der Waals bonding to one of the microcavity mirrors. We reach a finesse as high as 4,100 with this configuration limited by the reflectivity of the dielectric mirrors and not by scattering at the semiconductor - mirror interface, demonstrating that the epitaxial lift-off procedure is a promising procedure for cavity quantum electrodynamics in the solid state. As a first step in this direction, we demonstrate a clear cavity-quantum dot interaction in the weak coupling regime with a Purcell factor in the order of 3. Estimations of the coupling strength via the Purcell factor suggests that we are close to the strong coupling regime. ; Comment: 6 pages, 4 figures