Shwai He

Shwai's activity

• All
• Models
• Datasets
• Spaces
• Papers
• Collections
• Community
• Posts
• Upvotes
• Likes

upvoted a collection 23 days ago

LLM-Drop

Collection

Model weights of paper "What Matters in Transformers? Not All Attention is Needed" (https://arxiv.org/abs/2406.15786) • 14 items • Updated 18 days ago • 3

upvoted a paper 25 days ago

What Matters in Transformers? Not All Attention is Needed

Paper • 2406.15786 • Published Jun 22 • 27

upvoted a collection 4 months ago

Papers - MoE

Collection

45 items • Updated Aug 23 • 3

upvoted an article 5 months ago

view article

Article

Merge Large Language Models with mergekit

By •

Jan 9

• 76

upvoted a paper over 1 year ago

AlpaGasus: Training A Better Alpaca with Fewer Data

Paper • 2307.08701 • Published Jul 17, 2023 • 22