Alibaba released the model weights for Qwen3.8-Flash-Next as a preview of the upcoming Qwen4 architecture for developers to experiment with and evaluate. It’s…
Alibaba released the model weights for Qwen3.8-Flash-Next as a preview of the upcoming Qwen4 architecture for developers to experiment with and evaluate. It’s a multimodal mixture-of-experts (MoE) model with 176B total parameters, including 51B N-gram embedding parameters, and activates 6B parameters per token. It has a native 262,144-token context window, extensible to 1M tokens with YaRN.