docs: Add KV cache offloading doc#25

Sherlock113 merged 1 commit intobentoml:mainbentoml/llm-inference-handbook:mainfrom

Sherlock113:docs/kv-cache-offloadingSherlock113/llm-inference-handbook:docs/kv-cache-offloadingCopy head branch name to clipboard