Operations
Running llama-Architecture LLMs on CPU
· β˜• 5 min read
1. Running Locally in Containers Start the LLM 1 docker run --security-opt apparmor=unconfined --security-opt seccomp=unconfined --rm -p 8000:8000 shaowenchen/chinese-alpaca-2-7b-gguf:Q2_K The API documentation is available at http://localhost:8000/docs, as shown below: Deploy a simple Chat UI Note that the OPENAI_API_HOST parameter must be set to your host machine’s IP address rather than localhost or 127.

Some Pitfalls When Using Cloud Infrastructure
· β˜• 6 min read
1. Quota Limits Every resource in the cloud has a cap on how much of it you can use. This is how cloud vendors prevent resource abuse and reduce the mutual impact between tenants. For example: the number of enterprise projects under one account, the number of elastic compute instances, the number of elastic public IPs, the bandwidth of an elastic public IP, and so on.

Zero-Cost Service Availability Monitoring with Upptime
· β˜• 3 min read
1. What Needs Dial Testing GPT was all the rage this year, and I deployed and developed several applications and mini programs to learn from. Of course, following the principle of helping vendors test their features, right now only the GPT 3.5 API costs a little every day β€” the

Common Problems When Using Alpine Images
· β˜• 1 min read
1. DNS Request Timeout Cause: alpine uses the musl library, which has some limitations in DNS resolution [1] Solution: Do not use an apline image, and add the options single-request-reopen setting to the container’s resolv.conf file. This is because the single-request-reopen option only takes effect for the glibc library, while apline images use the musl library.

The Scope of Credentials During Pipeline Builds
· β˜• 4 min read
In the client, we have already seen the Docker CLI passing credentials to the Docker Daemon via X-Registry-Config when sending the build context. But recent build feedback still shows some phenomena that cannot be explained. This post mainly runs some basic tests to make troubleshooting easier. 1. Building under host Docker The Docker Daemon is started with root privileges.