Seven crystal structures of alanyl aminopeptidase from Neisseria meningitides (the etiological agent of meningitis, NmAPN) complexed with organophosphorus compounds were resolved to determine the optimal inhibitor-enzyme interactions. The enantiomeric phosphonic acid analogs of Leu and hPhe, which correspond to the P1 amino acid residues of well-processed substrates, were used to assess the impact of the absolute configuration and the stereospecific hydrogen bond network formed between the aminophosphonate polar head and the active site residues on the binding affinity. For the hPhe analog, an imperfect stereochemical complementarity could be overcome by incorporating an appropriate P1 side-chain. The constitution of P1'-extended structures was rationally designed and the lead, phosphinic dipeptide hPhePΨ[CH2]Phe, was modified in a single position. Introducing a heteroatom/heteroatom-based fragment to either the P1 or P1' residue required new synthetic pathways. The compounds in the refined structure were low nanomolar and subnanomolar inhibitors of N. meningitides, porcine and human APNs, and the reference leucine aminopeptidase (LAP). The unnatural phosphinic dipeptide analogs exhibited a high affinity for mono-zinc APNs associated with a reasonable selectivity versus di-zinc LAP. Another set of crystal structures containing the NmAPN dipeptide ligand were used to verify and to confirm the predicted binding modes; furthermore, novel contacts, which were promising for inhibitor development, were identified, including a π-π stacking interaction between a pyridine ring and Tyr372.