Uni-MoE-2.0-Omni: Scaling Language-Centric Omnimodal Large Model with Advanced MoE, Training and Data
Paper
•
2511.12609
•
Published
•
102
Chenyang Song
Raincleared
AI & ML interests
None yet
Recent Activity
upvoted
a
paper
4 months ago
Speed Always Wins: A Survey on Efficient Architectures for Large
Language Models
upvoted
a
paper
4 months ago
μ-Parametrization for Mixture of Experts
Organizations
upvoted
a
paper
20 days ago
upvoted
2
papers
4 months ago
authored
4
papers
5 months ago
ConPET: Continual Parameter-Efficient Tuning for Large Language Models
Paper
•
2309.14763
•
Published
•
1
ReLU$^2$ Wins: Discovering Efficient Activation Functions for Sparse LLMs
Paper
•
2402.03804
•
Published
•
4
ProSparse: Introducing and Enhancing Intrinsic Activation Sparsity within Large Language Models
Paper
•
2402.13516
•
Published
•
1
BlockFFN: Towards End-Side Acceleration-Friendly Mixture-of-Experts with Chunk-Level Activation Sparsity
Paper
•
2507.08771
•
Published
•
9
upvoted
a
paper
5 months ago
commented
a
paper
5 months ago
updated
6
models
5 months ago
SparseLLM/BlockFFN-Small
Text Generation
•
Updated
•
8
SparseLLM/BlockFFN-Medium
Text Generation
•
Updated
•
10
SparseLLM/BlockFFN-Large
Text Generation
•
Updated
•
11
SparseLLM/BlockFFN-XLarge
Text Generation
•
Updated
•
5
SparseLLM/BlockFFN-3B-SFT-EAGLE
Text Generation
•
Updated
•
8
SparseLLM/BlockFFN-3B-SFT
Text Generation
•
Updated
•
8
•
1
published
5
models
5 months ago