StepFun Releases Step 5 Preview Open Weights: 600B MoE, 27B Active, 1M Context
StepFun has released Step 5 Preview as open weights. FP8 and BF16 checkpoints are live on Hugging Face and ModelScope . Step 5 Preview is a sparse Mixture-of-Experts model from StepFun built for long-horizon agentic work. It has 600B total parameters, 27B active per token and up to 1M tokens of context. For developers, this is a new self-hostable option for coding agents, document analysis and finance workflows. TL;DR Size: 600B total, 27B active per token, up to 1M-token context....
StepFun has released Step 5 Preview as open weights. FP8 and BF16 checkpoints are live on Hugging Face and ModelScope . Step 5 Preview is a sparse Mixture-of-Experts model from StepFun built for long-horizon agentic work. It has 600B total parameters, 27B active per token and up to 1M tokens of context. For developers, this is a new self-hostable option for coding agents, document analysis and finance workflows. TL;DR Size: 600B total, 27B active per token, up to 1M-token context....