Update README.md
Browse files
README.md
CHANGED
|
@@ -199,13 +199,13 @@ The minimum hardware requirements for deploying Intern-S1 series models are:
|
|
| 199 |
|
| 200 |
You can utilize one of the following LLM inference frameworks to create an OpenAI compatible server:
|
| 201 |
|
| 202 |
-
#### [lmdeploy(>=0.9.2)](https://github.com/InternLM/lmdeploy)
|
| 203 |
|
| 204 |
```
|
| 205 |
lmdeploy serve api_server internlm/Intern-S1-FP8 --reasoning-parser intern-s1 --tool-call-parser intern-s1 --tp 4
|
| 206 |
```
|
| 207 |
|
| 208 |
-
#### [vllm](https://github.com/vllm-project/vllm)
|
| 209 |
|
| 210 |
```bash
|
| 211 |
vllm serve internlm/Intern-S1-FP8 --tensor-parallel-size 4 --trust-remote-code
|
|
|
|
| 199 |
|
| 200 |
You can utilize one of the following LLM inference frameworks to create an OpenAI compatible server:
|
| 201 |
|
| 202 |
+
#### [lmdeploy (>=0.9.2)](https://github.com/InternLM/lmdeploy)
|
| 203 |
|
| 204 |
```
|
| 205 |
lmdeploy serve api_server internlm/Intern-S1-FP8 --reasoning-parser intern-s1 --tool-call-parser intern-s1 --tp 4
|
| 206 |
```
|
| 207 |
|
| 208 |
+
#### [vllm (>=0.10.1)](https://github.com/vllm-project/vllm)
|
| 209 |
|
| 210 |
```bash
|
| 211 |
vllm serve internlm/Intern-S1-FP8 --tensor-parallel-size 4 --trust-remote-code
|