Then use both! There's no reason there has to be three wise men. The tradition comes from there being three gifts, but realistically there would have been more than three (three decked out guys traveling through the desert would be too easy a target for robbery). This year, I'll have the six wise men, some women, a couple of servants and whoever else looks like they could come from that time period. I need more camels though - only have four.
Ha ha, yeah that is problematic.
Here is some extra historical information regarding the wise men:
The Gospel narrative omits to mention the number of the Magi, and there is no certain tradition in this matter. Some Fathers speak of three Magi; they are very likely influenced by the number of gifts. In the Orient, tradition favours twelve. Early Christian art is no consistent witness:
a painting in the cemetery of Sts. Peter and Marcellinus shows two;
one in the Lateran Museum, three;
one in the cemetery of Domitilla, four;
a vase in the Kircher Museum, eight (Marucchi, "Eléments d'archéologie chrétienne", Paris, 1899, I 197).
From:
http://www.newadvent.org/cathen/09527a.htm