High rate capability and long-term cycling spindle-like LiTi2(PO4)3/C anode and needle-like Li3V2(PO4)3 cathode have been evaluated in half-cell, and combined to fabricate an advanced fast cyclable all phosphate lithium-ion battery. The electrode materials with well-defined morphology were prepared by a solvothermal reaction followed by annealing, delivering capacities of 115.0 and 118.1 mAh·g−1 at 25°C over 200 cycles at 0.5 C, respectively. For the full cell assembly, no prelithiation process is needed for the selected electrode pair due to their mutually matched capacity and stoichiometric amount of lithium-ions. The fabricated full cell, with an output voltage of more than 1.5 V, inherits a superior rate capability and cycling performance of its electrodes. A discharge capacity of 36 mAh·g−1 at 30 C (about 30% of the initial discharge capacity at 0.1 C) and a capacity retention of ∼35% at 5 C over 1000 cycles has been achieved. Furthermore, one of the most important reasons for the capacity fading in the full cell during long-term cycling is found to be a decomposition and structural degradation of Li3V2(PO4)3 cathode material.