Tuning carrier concentration via chemical doping is the most successful strategy to optimize the thermoelectric figure of merit. Nevertheless, how the dopants affect charge transport is not completely understood. Here we unravel the doping effects by explicitly including the scattering of charge carriers with dopants, on thermoelectric properties of poly(3,4-ethylenedioxythiophene), PEDOT, which is a p-type thermoelectric material with the highest figure of merit reported. We corroborate that the PEDOT exhibits a distinct transition from the aromatic to quinoid-like structure of backbone, and a semiconductor-to-metal transition with an increase in the level of doping. We identify a close-to-unity charge transfer from PEDOT to the dopant, and find that the ionized impurity scattering dominates over the acoustic phonon scattering in the doped PEDOT. By incorporating both scattering mechanisms, the doped PEDOT exhibits mobility, Seebeck coefficient and power factors in very good agreement with the experimental data, and the lightly doped PEDOT exhibits thermoelectric properties superior to the heavily doped one. We reveal that the thermoelectric transport is highly anisotropic in ordered crystals, and suggest to utilize large power factors in the direction of polymer backbone and low lattice thermal conductivity in the stacking and lamellar directions, which is viable in chain-oriented amorphous nanofibres.