Infection with Zika virus (ZIKV) came first to public attention after it was found to be associated with congenital microcephaly during the outbreak in Brazil (2015–2016). Diagnosis of ZIKV suffers from extensive cross-reactivity with other Flaviviruses, which are circulating in many ZIKV epidemic areas. Due to the fatal outcome of ZIKV infection during pregnancy, detailed knowledge about neutralizing and non-neutralizing epitopes is crucial for the development of robust detection systems of protective antibodies. Therefore, additional information about ZIKV immunogenicity and antibody response is required. In this project, we report the production, purification and characterization of six different polyclonal antibodies against ZIKV envelope (E) protein. The produced antibodies bind to isolated ZIKV E protein as well as to the surface of ZIKV particles, interestingly without being potently neutralizing. Surface plasmon resonance measurement showed that these antibodies bind with high affinity to ZIKV E protein. Epitope mapping revealed that the epitopes are distributed among the three ZIKV E domains with seven binding sites. These identified binding sites overlap only partially with the previously described epitopes recognized by neutralizing antibodies, which is in accordance with their lack of potent neutralizing activity. Additionally, these antibodies showed neither cross-reactivity nor potent neutralizing activity against West Nile virus, a related flavivirus. The gained set of data helps to extend our understanding about the distribution of neutralizing and non-/weak-neutralizing epitopes in ZIKV E protein, and provides a rationale for ZIKV vaccine design and development of robust detection assays for neutralizing antibodies.