HOPE
1 article in the last 30 days.
-
Your Experts Have Partners. There's HOPE for Keeping Them Together
HOPE is a second-order expert pruning method for Mixture-of-Experts models that accounts for pairwise interactions between experts. At 50% pruning it gets the best average rank and up to +6.1% on agentic coding tasks.