Mixture-of-experts Phi model providing higher capability with efficient active parameters.
Microsoft releases Phi-3.5 MoE, a mixture-of-experts small language model.
