Skip to content

jinyang1994/llm-inference-handbook

 
 

Repository files navigation

📖 LLM Inference Handbook

This repository contains the source content for LLM Inference Handbook, a practical guide for understanding, optimizing, scaling, and operating LLM inference.

Twitter Community

🔧 Local preview

To preview the site locally:

pnpm install
pnpm start

It will be running at http://localhost:3000/llm/.

🤝 Contributing

Contributions are welcome! Feel free to open issues, suggest improvements, or submit pull requests.

📄 License

This project is licensed under the MIT License.

About

Everything you need to know about LLM inference

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages

  • TypeScript 71.7%
  • CSS 28.3%