Passive balancing devices consist of two or more masses that are free to move along a circular race that is concentric with the geometric center of a shaft. At supercritical rotor speeds, past the first bending critical mode of the shaft, they exhibit the unique autonomous behavior of repositioning themselves in a way that can significantly reduce or eliminate vibrations due to rotor mass imbalances. The automatic balancing is a result of the dynamic relationship between the balancing mass positions and in-plane vibrations. This work characterizes the response of a passive balancing device in various configurations and in multiple shaft speed conditions. The effect of the number of concentric tracks and number of balancing masses per track is investigated numerically using a verified model where friction and mass collisions are considered. Results suggest that for a realistic system that includes rolling resistance, a 1-track configuration with any number of masses is ideal and yields lower vibration amplitudes when compared to other configurations.