win11本地部署llama3测试

win11本地部署llama3测试

ollama的链接： https://ollama.com/

open webui的链接： https://github.com/open-webui/open-webui

github：https://github.com/ollama/ollama

docker：https://hub.docker.com/r/ollama/ollama

一、下载（注意！需要先登陆，不然下载过程将会失败。）

二、安装。

三、使用ollama运行llama3模型。

新建一个文件夹，使用vscode 打开该文件夹，使用终端运行ollama run llama3命令。

四、实用性。

一个基础常识性问题。回答正确，时间6min，硬件基于“Intel(R) Pentium(R)Gold G6400 CPU @4.00GHz”

>>> 地球的半径是多少千米？
🌎

The radius of the Earth is approximately 6,371 kilometers (3,959 miles). This is based on measurements from NASA's Gravity 
Recovery and Interior Laboratory (GRAIL) mission in 2018. The value can vary slightly depending on the source and method used, but      
6,371 km is a commonly accepted estimate.

Interestingly, the Earth's equatorial radius is about 6,378 kilometers (3,963 miles), which is just slightly larger than its polar      
radius of approximately 6,357 kilometers (3,949 miles). This difference is due to the Earth's slightly ellipsoidal shape. 🌊

>>> Send a message (/? for help)

本地部署Open WebUI (Formerly Ollama WebUI)

open webui的链接：https://github.com/open-webui/open-webui

win10/11安装docker：https://docker-practice.github.io/zh-cn/install/windows.html

一、Open WebUI基于docker启动，win11安装docker

二、使用docker启动Open WebUI

Installation with Default Configuration

• If Ollama is on your computer, use this command:

  docker run -d -p 3000:8080 --add-host=host.docker.internal:host-gateway -v open-webui:/app/backend/data --name open-webui --restart always ghcr.io/open-webui/open-webui:main

• If Ollama is on a Different Server, use this command:

  To connect to Ollama on another server, change the OLLAMA_BASE_URL to the server's URL:

  docker run -d -p 3000:8080 -e OLLAMA_BASE_URL=https://example.com -v open-webui:/app/backend/data --name open-webui --restart always ghcr.io/open-webui/open-webui:main

  • To run Open WebUI with Nvidia GPU support, use this command:

  docker run -d -p 3000:8080 --gpus all --add-host=host.docker.internal:host-gateway -v open-webui:/app/backend/data --name open-webui --restart always ghcr.io/open-webui/open-webui:cuda

  

访问web页面

http://localhost:3000/auth/

注册并登陆