Alzheimer’s disease (AD) pathology is characterized by plaques of amyloid beta (Aβ) and neurofibrillary tangles of tau. Aβ aggregation is thought to occur at early stages of the disease, and ultimately gives way to the formation of tau tangles which track with cognitive decline in humans. Here, we report the crystal structure of an Aβ core segment determined by MicroED and in it, note characteristics of both fibrillar and oligomeric structure. Using this structure, we designed peptide-based inhibitors that reduce Aβ aggregation and toxicity of already-aggregated species. Unexpectedly, we also found that these inhibitors reduce the efficiency of Aβ-mediated tau aggregation, and moreover reduce aggregation and self-seeding of tau fibrils. The ability of these inhibitors to interfere with both Aβ and tau seeds suggests these fibrils share a common epitope, and supports the hypothesis that cross-seeding is one mechanism by which amyloid is linked to tau aggregation and could promote cognitive decline.