It is the quality of the men, their leader, their position etc. I seem to recall some numbers being mentioned, such as Renly having 100,000, and Stannis 2,000, but the exact numbers are not really a good measure of the strength of the army. I would say: Renly > Tywin > Robb > Greyjoy > Stannis.
