We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
There was an error while loading. Please reload this page.
1 parent 886454e commit ca53358Copy full SHA for ca53358
python/sglang/srt/entrypoints/engine.py
@@ -94,8 +94,8 @@ class Engine(EngineBase):
94
3. DetokenizerManager (subprocess): Detokenizes the output tokens and sends the result back to the Tokenizer Manager.
95
96
Note:
97
- 1. The HTTP server, Engine, and TokenizerManager both run in the main process.
98
- 2. Inter-process communication is done through ICP (each process uses a different port) via the ZMQ library.
+ 1. The HTTP server, Engine, and TokenizerManager all run in the main process.
+ 2. Inter-process communication (IPC) is handled via the ZMQ library, with each process using a different port.
99
"""
100
101
def __init__(self, **kwargs):
0 commit comments