We employ synoptic full disk longitudinal magnetograms to study latitudinal distribution and orientation (tilt) of magnetic bipoles in the course of sunspot activity during cycles 21, 22, and 23. The data set includes daily observations from the National Solar Observatory at Kitt Peak (1975-2002) and Michelson Doppler Imager on board the Solar and Heliospheric Observatory (MDI/SOHO, 1996-2009). Bipole pairs were selected on the basis of proximity and flux balance of two neighboring flux elements of opposite polarity. Using the area of the bipoles, we have separated them into small quiet-Sun bipoles (QSBs), ephemeral regions (ERs), and active regions (ARs). We find that in their orientation, ERs and ARs follow Hale-Nicholson polarity rule. As expected, AR tilts follow Joy's law. ERs, however, show significantly larger tilts of opposite sign for a given hemisphere. QSBs are randomly oriented. Unlike ARs, ERs also show a preference in their orientation depending on the polarity of the large-scale magnetic field. These orientation properties may indicate that some ERs may form at or near the photosphere via the random encounter of opposite polarity elements, while others may originate in the convection zone at about the same location as ARs. The combined latitudinal distribution of ERs and ARs exhibits a clear presence of Spörer's butterfly diagram (equatorward drift in the course of a solar cycle). ERs extend the ARs' "wing" of the butterfly diagram to higher latitudes. This high latitude extension of ERs suggests an extended solar cycle with the first magnetic elements of the next cycle developing shortly after the maximum of the previous cycle. The polarity orientation and tilt of ERs may suggest the presence of poloidal fields of two configurations (new cycle and old cycle) in the convection zone at the declining phase of the sunspot cycle.