A single challenge may be issued and accepted as normal, but only models chosen as part of the two sides' assault parties can issue, accept and refuse challenges – you cannot use the challenge to increase the number of models fighting.