Transformers
JunlongTong commited on
Commit
b779915
·
verified ·
1 Parent(s): 7b06e12

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +30 -3
README.md CHANGED
@@ -1,3 +1,30 @@
1
- ---
2
- license: apache-2.0
3
- ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ library_name: transformers
3
+ license: apache-2.0
4
+ ---
5
+
6
+ ### Model Details
7
+ We introduce a new streaming paradigm that enables large language models to achieve strong performance and generalization in streaming settings, without requiring any architectural modifications.
8
+ * Batch-processing: The LLMs process inputs all at once after receiving the full sequence.
9
+ * Streaming-processing: The LLMs process the input as it arrives, incrementally and in real time.
10
+
11
+
12
+ ### Model Sources
13
+ - **Paper:** https://arxiv.org/abs/2505.16983
14
+ - **Repository:** https://github.com/EIT-NLP/StreamingLLM
15
+
16
+
17
+
18
+
19
+ ### Citation
20
+ ```tex
21
+ @misc{tong2025llmeffectivestreamingprocessor,
22
+ title={LLM as Effective Streaming Processor: Bridging Streaming-Batch Mismatches with Group Position Encoding},
23
+ author={Junlong Tong and Jinlan Fu and Zixuan Lin and Yingqi Fan and Anhao Zhao and Hui Su and Xiaoyu Shen},
24
+ year={2025},
25
+ eprint={2505.16983},
26
+ archivePrefix={arXiv},
27
+ primaryClass={cs.CL},
28
+ url={https://arxiv.org/abs/2505.16983},
29
+ }
30
+ ```