You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
From the principle of Wanda, the method uses a general approach for selecting which weights to prune, theoretically making it applicable to all models. However, why does this code only support a limited range of models instead of being universally applicable? What makes it different when implementing this method on general LLMs?
Can anyone help resolve my confusion or share their insights?
The text was updated successfully, but these errors were encountered:
Elycyx
changed the title
Why Wanda only supports limited LLMs?
Why does Wanda only support limited LLMs?
Nov 25, 2024
Hi, guys! I have a little question here:
From the principle of Wanda, the method uses a general approach for selecting which weights to prune, theoretically making it applicable to all models. However, why does this code only support a limited range of models instead of being universally applicable? What makes it different when implementing this method on general LLMs?
Can anyone help resolve my confusion or share their insights?
The text was updated successfully, but these errors were encountered: