In this paper, five mathematical models of single neurons are discussed and compared. The physical meanings, derivations, and differential equations of each model are provided. Since for many applications the spiking rates of neurons are of great importance, we compare the spiking rate patterns under different sustained current inputs. Numerical stability and accuracy are also considered. The computational cost and storage requirements needed to numerically solve each of the models are also discussed.