https://www.chenshaowen.com/en/tags/llama.cpp/Recent content in llama.cpp on Shaowen Chen's WebsiteHugo -- gohugo.ioen©2016 - {year}, All Rights Reserved.Tue, 05 Sep 2023 00:00:00 +0000weeklyhttps://www.chenshaowen.com/en/blog/llama-cpp-that-is-a-llm-deployment-tool.htmlTue, 05 Sep 2023 00:00:00 +0000Tue, 05 Sep 2023 00:00:00 +0000https://www.chenshaowen.com/en/blog/llama-cpp-that-is-a-llm-deployment-tool.html1. LLM Deployment Tool llama.cpp Research on large models is split into two parts: training and inference. The training process is essentially the process of finding model parameters that minimize the model’s loss function and optimize the inference results. Once training is complete, the model’s parameters are fixed, and at微信公众号AILLMToolsllama.cppInferenceDeployment