A better basic understanding of the railroad ballast behavior is essential for mitigating track problems and failures due to ballast breakdown, powdering, and fouling. Track lateral stability requirements were studied in this paper by the use of an imaging aided Discrete Element Modeling (DEM) approach. In this micro-mechanics based approach, aggregate particles with engineered shape, surface texture and angularity properties are employed in the ballast to approximately model the load transfer mechanisms of the real particulate nature of ballasted railroad track, i.e., interaction (friction) between the discrete aggregate particles and boundary conditions such as crossties. By utilizing BLOKS3D DEM program developed at the University of Illinois, important effects of ballast fouling on ballast strength were successfully simulated through DEM models of direct shear and tie pull-out tests. Additional insight was also given into crosstie texture designs impacting railroad track lateral stability.