I think it all depends on the reason one is composing "armies", imho:
* If it is for displaying different forces (factions) in a cabinet, a few dozen of each force (faction) would be more then sufficient. I do that with a few specific forces, like 18th C. spanish troops and french pre-revolution troops, and medieval knights.
* When for play (with or without your kids

), well then it doesn't matter, but a few dozen of each would be ideal. When more it becomes difficult to play with without having hundreds of klickies all scattered around the room, which the wife won't like much

.
* If it is to build big/huge war-dioramas, then batallion- and regiment-sizes can be required.

And if it has to be a really enormous diorama (or for having them in boxes, to show off when fellow collectors come on a visit), then you could extend into brigades and divisions, and perhaps even into complete armies!

Moving into a castle or buying a few appartments in the Burj Khalifa might then be a good idea though.
* Other option: specific purpose-build troops/factions.
For example:
My main plan-in-work is a large mid-to-late 18th-century Carribean Island, under English government. So the island's fortresses need soldiers, the harbour and city needs defensive and partrolling forces (and of course some drunk forces in the taverns

). Therefore I've decided that - for the size of the island I've in mind - my English army should be mostly composed of infantry & artillery, and I've estimated about 250 to 300 soldiers and about 50 officers should be more then sufficient.
Then there is a need for a Royal Navy fleet, with some ships anchored, and others on patrol or in battle. I'm not gonna provide details here about the full size of my English fleet (that's top-secret

), but let's say a standard-size 3940/5135-shiptype will have 5 officers (the other crewmembers are enlisted non-uniformed sailors), and there will be some navy-men in the harbour and town, and an admiralty-detachment in one of the fortresses.
I've also build up an adversary French force, including ships with naval officers and army-landing troops, to attack the island, and try to invade & conquer it. Theoretically an attacking force should be numerically superior to a defending one (unless they have far superior technology), but I'm not planning to go as far as that.
As I'm also quite interested in what was going on in the Americas in the 16th century, I'm also building up a 'conquistadores'-army, but I've not decided yet on the final numbers. I think I won't go much further then ca. 50 - 75 men, as that number should be sufficient for some beach or jungle scenes. And it is rather a spin-off of my primary 18th C. island-plan.