gist-sparse-attention/GSA-PT-Qwen2-7B-Instruct-chunk16
333k • Updated • 4
GSA
Models and Datasets of paper: [Forget, Then Recall: Learnable Compression and Selective Unfolding via Gist Sparse Attention]
-
-
gist-sparse-attention/GSA-PT-Llama-3.2-1B-chunk8
1B • Updated • 2 -
gist-sparse-attention/GSA-PT-Qwen2-7B-Instruct-chunk8
333k • Updated • 2 -
gist-sparse-attention/GSA-PT-Qwen2-7B-Instruct-chunk4-chunk4
333k • Updated • 2 -
gist-sparse-attention/GSA-PT-Qwen2-7B-Instruct-chunk32
333k • Updated • 5 -
gist-sparse-attention/GSA-PT-Llama-3.2-1B-chunk4-chunk4
1B • Updated • 1 -
gist-sparse-attention/GSA-PT-Llama-3.2-1B-chunk16
1B • Updated • 2 -
gist-sparse-attention/GSA-FT-Llama-3.2-1B-chunk8
1B • Updated • 2 -
gist-sparse-attention/GSA-FT-Llama-3.2-1B-chunk4-chunk4
1B • Updated • 5 -
gist-sparse-attention/GSA-FT-Llama-3.2-1B-chunk16
1B • Updated • 5 -
gist-sparse-attention/GSA-PT-Qwen2-7B-Instruct-chunk8-chunk4
333k • Updated • 3 -
gist-sparse-attention/GSA-FT-Qwen2-7B-Instruct-chunk8
333k • Updated • 1 -
gist-sparse-attention/GSA-FT-Qwen2-7B-Instruct-chunk16
333k • Updated • 2 -
gist-sparse-attention/GSA-FT-Qwen2-7B-Instruct-chunk32
333k • Updated • 4 -
gist-sparse-attention/GSA-FT-Qwen2-7B-Instruct-chunk4-chunk4
333k • Updated • 572 -
gist-sparse-attention/GSA-FT-Qwen2-7B-Instruct-chunk8-chunk4
333k • Updated • 4 -
gist-sparse-attention/GSA-PT-Qwen2-7B-Instruct-chunk8-chunk4-data
Viewer • Updated • 88.6k • 312 -
gist-sparse-attention/GSA-FT-Qwen2-7B-Instruct-chunk8-data
Preview • Updated • 42 -
gist-sparse-attention/GSA-FT-Qwen2-7B-Instruct-chunk16-data
Preview • Updated • 107 -
gist-sparse-attention/GSA-FT-Qwen2-7B-Instruct-chunk32-data
Viewer • Updated • 25.9k • 178 -
gist-sparse-attention/GSA-FT-Qwen2-7B-Instruct-chunk4-chunk4-data
Preview • Updated • 112 -
gist-sparse-attention/GSA-FT-Qwen2-7B-Instruct-chunk8-chunk4-data
Preview • Updated • 138 -
gist-sparse-attention/GSA-FT-Llama-3.2-1B-data
Preview • Updated • 296 -
gist-sparse-attention/GSA-PT-Llama-3.2-1B-chunk16-data
Updated • 334 -
gist-sparse-attention/GSA-PT-Llama-3.2-1B-chunk8-data
Updated • 400 -
gist-sparse-attention/GSA-PT-Llama-3.2-1B-chunk4-chunk4-data
Updated • 439 -
gist-sparse-attention/GSA-PT-Qwen2-7B-Instruct-chunk8-data
Viewer • Updated • 89.9k • 223 -
gist-sparse-attention/GSA-PT-Qwen2-7B-Instruct-chunk16-data
Viewer • Updated • 88.8k • 298 -
gist-sparse-attention/GSA-PT-Qwen2-7B-Instruct-chunk32-data
Preview • Updated • 196 -
gist-sparse-attention/GSA-PT-Qwen2-7B-Instruct-chunk4-chunk4-data
Viewer • Updated • 88.5k • 272