Get access to the formular:

Czy server jest włączony? TAK/ offline

Jak się połączyć?

shell:

ssh user@3.68.82.136 -p 1049

hasło: 1234

2025-02-06

https://youtu.be/xzSCvXDcX68?t=341 nvidia-smi

wcześniej

https://www.youtube.com/watch?v=h9Z4oGN89MU GPU arch

user@srv0:~$ sudo systemctl stop ollama.service
user@srv0:~$ ps aux | grep ollama
user       34381  0.0  0.0   6432  2608 pts/0    S+   11:08   0:00 grep --color=auto ollama
user@srv0:~$ sudo systemctl start ollama.service
user@srv0:~$ ps aux | grep ollama
ollama     34385  193  0.2 2770860 233092 ?      Ssl  11:08   0:05 /usr/local/bin/ollama serve
user       34416  0.0  0.0   6432  2624 pts/0    S+   11:08   0:00 grep --color=auto ollama

https://www.thomas-krenn.com/pl/wiki/A_start_job_is_running_for_Wait_for_Network_to_be_Configured

Jak konfiguruwać usługi, żeby programy działały po restarcie serwera?

pm2

https://stackoverflow.com/a/55951300

Jak co jeśli Xorg 100%?

Czasem po odpięciu HDMI wygląda na to, że sterowniki wpadają w pętle i robią coś a'la kolejkowanie buforu do HDMI? dunno not sure

Objawy są następujące

user@srv0:~$ top

top - 13:39:02 up  2:54,  5 users,  load average: 33.39, 16.92, 14.41
Tasks: 666 total,   4 running, 662 sleeping,   0 stopped,   0 zombie
%Cpu(s):  0.0 us,  5.5 sy,  0.0 ni, 94.4 id,  0.0 wa,  0.0 hi,  0.1 si,  0.0 st
MiB Mem :  96553.1 total,  88303.4 free,   1779.1 used,   6470.5 buff/cache
MiB Swap:   8192.0 total,   8192.0 free,      0.0 used.  93851.8 avail Mem 

    PID USER      PR  NI    VIRT    RES    SHR S  %CPU  %MEM     TIME+ COMMAND                                                   
   1840 gdm       20   0   24.2g 108640  75504 R 100.0   0.1   0:45.36 Xorg                                                      
   2131 gdm       20   0 1602892 163140  95012 R 100.0   0.2   1:06.23 gnome-shell                                               
   2379 user      20   0   24.2g 109224  75964 R 100.0   0.1 152:26.80 Xorg

sudo service gdm stop

sudo service lightdm stop

user@srv0:~$ sudo killall Xorg

user@srv0:~$ sudo killall -6 Xorg

user@srv0:~$ sudo killall -7 Xorg

user@srv0:~$ sudo killall -8 Xorg

Xorg: no process found

trochę innych info https://forums.linuxmint.com/viewtopic.php?t=213970

Dalsze info tech

Lista modeli
user@srv0:~$ ollama list
NAME                	ID          	SIZE  	MODIFIED     
llama2:70b-text-q8_0	2aa27df56a63	73 GB 	42 hours ago
mistral:latest      	61e88e884507	4.1 GB	46 hours ago
mixtral:latest      	7708c059a8bb	26 GB 	43 hours ago

Uruchomienie modelu (dostęp po API)
ollama run mixtral

Dostęp po API
curl http://3.68.82.136:11434/api/chat -d '{
  "model": "mistral",
  "messages": [
    { "role": "user", "content": "why is the sky blue?" }
  ]
}'

JavaScript
const options = {
  method: 'POST',
  body: JSON.stringify({  "model": "mistral",
  "messages": [
    { "role": "user", "content": "why is the sky blue?" }
  ]})
};
fetch('http://3.68.82.136:11434/api/chat', options)
  .then(response => response.json())
  .then(response => console.log(response))
  .catch(err => console.error(err));

Python
import requests

url = "http://3.68.82.136:11434/api/chat"

payload = "{\n  \"model\": \"mistral\",\n  \"messages\": [\n    { \"role\": \"user\", \"content\": \"why is the sky blue?\" }\n  ]\n}"
response = requests.request("POST", url, data=payload)

print(response.text)

Parametry serwera

System load: 0.0

Usage of /: 3.1% of 3.58TB

Memory usage: 3%

Swap usage: 0%

Temperature: 33.0 C

Processes: 654

Users logged in: 1

user@srv0:~$ free -h
              total        used        free      shared  buff/cache   available
Mem:           94Gi       3.3Gi        85Gi        75Mi       5.8Gi        90Gi
Swap:         8.0Gi          0B       8.0Gi

user@srv0:~$ sudo sensors
coretemp-isa-0000
Adapter: ISA adapter
Package id 0:  +32.0°C  (high = +93.0°C, crit = +103.0°C)
Core 0:        +27.0°C  (high = +93.0°C, crit = +103.0°C)
Core 1:        +27.0°C  (high = +93.0°C, crit = +103.0°C)
Core 2:        +26.0°C  (high = +93.0°C, crit = +103.0°C)
Core 3:        +27.0°C  (high = +93.0°C, crit = +103.0°C)
Core 4:        +26.0°C  (high = +93.0°C, crit = +103.0°C)
Core 5:        +27.0°C  (high = +93.0°C, crit = +103.0°C)
Core 6:        +26.0°C  (high = +93.0°C, crit = +103.0°C)
Core 8:        +25.0°C  (high = +93.0°C, crit = +103.0°C)
Core 9:        +26.0°C  (high = +93.0°C, crit = +103.0°C)
Core 10:       +27.0°C  (high = +93.0°C, crit = +103.0°C)
Core 11:       +27.0°C  (high = +93.0°C, crit = +103.0°C)
Core 12:       +25.0°C  (high = +93.0°C, crit = +103.0°C)
Core 13:       +27.0°C  (high = +93.0°C, crit = +103.0°C)
Core 14:       +25.0°C  (high = +93.0°C, crit = +103.0°C)

coretemp-isa-0001
Adapter: ISA adapter
Package id 1:  +32.0°C  (high = +93.0°C, crit = +103.0°C)
Core 0:        +25.0°C  (high = +93.0°C, crit = +103.0°C)
Core 1:        +25.0°C  (high = +93.0°C, crit = +103.0°C)
Core 2:        +26.0°C  (high = +93.0°C, crit = +103.0°C)
Core 3:        +26.0°C  (high = +93.0°C, crit = +103.0°C)
Core 4:        +25.0°C  (high = +93.0°C, crit = +103.0°C)
Core 5:        +27.0°C  (high = +93.0°C, crit = +103.0°C)
Core 6:        +26.0°C  (high = +93.0°C, crit = +103.0°C)
Core 8:        +25.0°C  (high = +93.0°C, crit = +103.0°C)
Core 9:        +24.0°C  (high = +93.0°C, crit = +103.0°C)
Core 10:       +25.0°C  (high = +93.0°C, crit = +103.0°C)
Core 11:       +25.0°C  (high = +93.0°C, crit = +103.0°C)
Core 12:       +25.0°C  (high = +93.0°C, crit = +103.0°C)
Core 13:       +25.0°C  (high = +93.0°C, crit = +103.0°C)
Core 14:       +26.0°C  (high = +93.0°C, crit = +103.0°C)

user@srv0:~$ sudo lshw -C video
  *-display                 
       description: 3D controller
       product: GV100GL [Tesla V100 PCIe 32GB]
       vendor: NVIDIA Corporation
       physical id: 0
       bus info: pci@0000:03:00.0
       version: a1
       width: 64 bits
       clock: 33MHz
       capabilities: pm msi pciexpress bus_master cap_list
       configuration: driver=nvidia latency=0
       resources: iomemory:38300-382ff iomemory:38380-3837f irq:87 memory:ca000000-caffffff memory:383000000000-3837ffffffff memory:383800000000-383801ffffff
  *-display
       description: VGA compatible controller
       product: NVIDIA Corporation
       vendor: NVIDIA Corporation
       physical id: 0
       bus info: pci@0000:04:00.0
       version: a1
       width: 64 bits
       clock: 33MHz
       capabilities: pm msi pciexpress vga_controller bus_master cap_list rom
       configuration: driver=nvidia latency=0
       resources: iomemory:38380-3837f iomemory:38380-3837f irq:88 memory:c8000000-c8ffffff memory:383810000000-38381fffffff memory:383820000000-383821ffffff ioport:7000(size=128) memory:c0000-dffff
  *-display
       description: 3D controller
       product: GV100GL [Tesla V100 PCIe 32GB]
       vendor: NVIDIA Corporation
       physical id: 0
       bus info: pci@0000:81:00.0
       version: a1
       width: 64 bits
       clock: 33MHz
       capabilities: pm msi pciexpress bus_master cap_list
       configuration: driver=nvidia latency=0
       resources: iomemory:38700-386ff iomemory:38780-3877f irq:89 memory:fa000000-faffffff memory:387000000000-3877ffffffff memory:387800000000-387801ffffff
  *-display
       description: 3D controller
       product: GV100GL [Tesla V100 PCIe 32GB]
       vendor: NVIDIA Corporation
       physical id: 0
       bus info: pci@0000:82:00.0
       version: a1
       width: 64 bits
       clock: 33MHz
       capabilities: pm msi pciexpress bus_master cap_list
       configuration: driver=nvidia latency=0
       resources: iomemory:38600-385ff iomemory:38680-3867f irq:90 memory:f9000000-f9ffffff memory:386000000000-3867ffffffff memory:386800000000-386801ffffff

Zapraszamy do kontaktu
720790994