Update README.md
Browse files
README.md
CHANGED
|
@@ -52,6 +52,8 @@ The high-thinking drafter is specialized for high-thinking inference. It is espe
|
|
| 52 |
|
| 53 |
## Deployment
|
| 54 |
|
|
|
|
|
|
|
| 55 |
```bash
|
| 56 |
export TARGET="<path-or-hf-repo-to-hy3-a21b-target>"
|
| 57 |
export DRAFT="<path-or-hf-repo-to-hy3-dfly-high-thinking-drafter>"
|
|
|
|
| 52 |
|
| 53 |
## Deployment
|
| 54 |
|
| 55 |
+
Set `TARGET` to the Hy3-A21B target model path or repository and `DRAFT` to the corresponding drafter checkpoint. The relevant inference code can be found in PR https://github.com/vllm-project/vllm/pull/50246.
|
| 56 |
+
|
| 57 |
```bash
|
| 58 |
export TARGET="<path-or-hf-repo-to-hy3-a21b-target>"
|
| 59 |
export DRAFT="<path-or-hf-repo-to-hy3-dfly-high-thinking-drafter>"
|