Pi4 ubuntu 20.04.3 en ALTIJD load van 1.0

[imdos]

Ik heb op een rpi4 Ubuntu 20.04.3 (aarch64) vers geinstalleerd op een pi4 met SSD via een USB3=>SATA.

Met feitelijk geen tot weinig gebruik lukt het nooit om onder de 1.00 load te komen. Ik kom niet lager dan 0,8 als de docker service wel actief is en unifi uit staat. Ik ben druk bezig met IOTstack om alles te draaien in dockers. Maar blijf nu nogal steken.

code:

Welcome to Ubuntu 20.04.3 LTS (GNU/Linux 5.4.0-1042-raspi aarch64)

  System information as of Mon Aug 30 18:57:39 CEST 2021

  System load:                      1.28
  Usage of /:                       12.0% of 98.91GB
  Memory usage:                     26%
  Swap usage:                       0%
  Temperature:                      62.3 C
  Processes:                        174

0 updates can be applied immediately.

Linux ubuntu 5.4.0-1042-raspi #46-Ubuntu SMP PREEMPT Fri Jul 30 00:35:40 UTC 2021 aarch64 aarch64 aarch64 GNU/Linux

ubuntu@ubuntu:~$ vmstat
procs -----------memory---------- ---swap-- -----io---- -system-- ------cpu-----
 r  b   swpd   free   buff  cache   si   so    bi    bo   in   cs us sy id wa st
 0  0      0 1807528  83680 941468    0    0    20     8  190  239 10  2 88  0  0

Gek genoeg heb ik dit nog nooit meegemaakt. Ik heb al alle packages bijgewerkt. Het enige wat afwijkend is, is dat ik de unifi controller software heb geinstalleerd (unifi_6.2.26-15319-1_all.deb) die niet officeel gesupport is maar multiarchitecture is. Maar wel gewoon de 64bits openJDK. Als dit proces niet draait; dan daalt de load niet trouwens.

Ik heb me al rot gezocht op Google en hier; maar kan niet iets vinden. Ter vergelijking; de Pi3B+ die nu nog alle domoticz draait kwam nooit zo hoog. Ik heb al mongoDB tuning gedaan.

code:

ubuntu@ubuntu:~$ ps auxwww
USER         PID %CPU %MEM    VSZ   RSS TTY      STAT START   TIME COMMAND
root           1  0.4  0.2 168084 11248 ?        Ss   10:51   0:31 /sbin/init fixrtc
root           2  0.0  0.0      0     0 ?        S    10:51   0:00 [kthreadd]
root           3  0.0  0.0      0     0 ?        I<   10:51   0:00 [rcu_gp]
root           4  0.0  0.0      0     0 ?        I<   10:51   0:00 [rcu_par_gp]
root           6  0.0  0.0      0     0 ?        I<   10:51   0:00 [kworker/0:0H-kblockd]
root           8  0.0  0.0      0     0 ?        I<   10:51   0:00 [mm_percpu_wq]
root           9  0.0  0.0      0     0 ?        S    10:51   0:02 [ksoftirqd/0]
root          10  0.0  0.0      0     0 ?        I    10:51   0:07 [rcu_preempt]
root          11  0.0  0.0      0     0 ?        S    10:51   0:00 [migration/0]
root          12  0.0  0.0      0     0 ?        S    10:51   0:00 [idle_inject/0]
root          14  0.0  0.0      0     0 ?        S    10:51   0:00 [cpuhp/0]
root          15  0.0  0.0      0     0 ?        S    10:51   0:00 [cpuhp/1]
root          16  0.0  0.0      0     0 ?        S    10:51   0:00 [idle_inject/1]
root          17  0.0  0.0      0     0 ?        S    10:51   0:00 [migration/1]
root          18  0.0  0.0      0     0 ?        S    10:51   0:00 [ksoftirqd/1]
root          20  0.0  0.0      0     0 ?        I<   10:51   0:00 [kworker/1:0H-kblockd]
root          21  0.0  0.0      0     0 ?        S    10:51   0:00 [cpuhp/2]
root          22  0.0  0.0      0     0 ?        S    10:51   0:00 [idle_inject/2]
root          23  0.0  0.0      0     0 ?        S    10:51   0:00 [migration/2]
root          24  0.0  0.0      0     0 ?        S    10:51   0:00 [ksoftirqd/2]
root          26  0.0  0.0      0     0 ?        I<   10:51   0:00 [kworker/2:0H-kblockd]
root          27  0.0  0.0      0     0 ?        S    10:51   0:00 [cpuhp/3]
root          28  0.0  0.0      0     0 ?        S    10:51   0:00 [idle_inject/3]
root          29  0.0  0.0      0     0 ?        S    10:51   0:00 [migration/3]
root          30  0.0  0.0      0     0 ?        S    10:51   0:00 [ksoftirqd/3]
root          32  0.0  0.0      0     0 ?        I<   10:51   0:00 [kworker/3:0H-kblockd]
root          33  0.0  0.0      0     0 ?        S    10:51   0:00 [kdevtmpfs]
root          34  0.0  0.0      0     0 ?        I<   10:51   0:00 [netns]
root          35  0.0  0.0      0     0 ?        S    10:51   0:00 [rcu_tasks_kthre]
root          36  0.0  0.0      0     0 ?        S    10:51   0:00 [kauditd]
root          37  0.0  0.0      0     0 ?        S    10:51   0:00 [khungtaskd]
root          38  0.0  0.0      0     0 ?        S    10:51   0:00 [oom_reaper]
root          39  0.0  0.0      0     0 ?        I<   10:51   0:00 [writeback]
root          40  0.0  0.0      0     0 ?        S    10:51   0:00 [kcompactd0]
root          41  0.0  0.0      0     0 ?        SN   10:51   0:00 [ksmd]
root          90  0.0  0.0      0     0 ?        I<   10:51   0:00 [kintegrityd]
root          91  0.0  0.0      0     0 ?        I<   10:51   0:00 [kblockd]
root          92  0.0  0.0      0     0 ?        I<   10:51   0:00 [blkcg_punt_bio]
root          93  0.0  0.0      0     0 ?        I<   10:51   0:00 [tpm_dev_wq]
root          94  0.0  0.0      0     0 ?        I<   10:51   0:00 [ata_sff]
root          95  0.0  0.0      0     0 ?        I<   10:51   0:00 [md]
root          96  0.0  0.0      0     0 ?        I<   10:51   0:00 [edac-poller]
root          97  0.0  0.0      0     0 ?        I<   10:51   0:00 [devfreq_wq]
root          98  0.0  0.0      0     0 ?        S    10:51   0:00 [watchdogd]
root         101  0.0  0.0      0     0 ?        S    10:51   0:03 [kswapd0]
root         102  0.0  0.0      0     0 ?        S    10:51   0:00 [ecryptfs-kthrea]
root         104  0.0  0.0      0     0 ?        I<   10:51   0:00 [kthrotld]
root         105  0.0  0.0      0     0 ?        S    10:51   0:00 [irq/39-aerdrv]
root         107  0.0  0.0      0     0 ?        I<   10:51   0:00 [DWC Notificatio]
root         109  0.0  0.0      0     0 ?        S<   10:51   0:00 [vchiq-slot/0]
root         110  0.0  0.0      0     0 ?        S<   10:51   0:00 [vchiq-recy/0]
root         111  0.0  0.0      0     0 ?        S<   10:51   0:00 [vchiq-sync/0]
root         112  0.0  0.0      0     0 ?        I<   10:51   0:00 [ipv6_addrconf]
root         123  0.0  0.0      0     0 ?        I<   10:51   0:00 [kstrp]
root         126  0.0  0.0      0     0 ?        I<   10:51   0:00 [kworker/u9:0-sdhci]
root         131  0.0  0.0      0     0 ?        I<   10:51   0:00 [cryptd]
root         156  0.0  0.0      0     0 ?        I<   10:51   0:00 [sdhci]
root         157  0.0  0.0      0     0 ?        S    10:51   0:01 [irq/26-mmc0]
root         158  0.0  0.0      0     0 ?        I<   10:51   0:00 [charger_manager]
root         209  0.0  0.0      0     0 ?        I<   10:51   0:00 [uas]
root         210  0.0  0.0      0     0 ?        S    10:51   0:00 [scsi_eh_0]
root         211  0.0  0.0      0     0 ?        I<   10:51   0:00 [scsi_tmf_0]
root         266  0.0  0.0      0     0 ?        I<   10:51   0:01 [kworker/0:1H-kblockd]
root         756  0.0  0.0      0     0 ?        I<   10:51   0:00 [raid5wq]
root         793  0.0  0.0      0     0 ?        I<   10:51   0:01 [kworker/3:1H-kblockd]
root         821  0.0  0.0      0     0 ?        S    10:51   0:02 [jbd2/sda2-8]
root         822  0.0  0.0      0     0 ?        I<   10:51   0:00 [ext4-rsv-conver]
root         823  0.0  0.0      0     0 ?        I<   10:51   0:01 [kworker/2:1H-kblockd]
root         851  0.0  0.0      0     0 ?        I<   10:51   0:00 [kworker/1:1H-kblockd]
root         923  0.0  0.1  20204  4608 ?        Ss   10:51   0:01 /lib/systemd/systemd-udevd
root         952  0.0  0.0      0     0 ?        S    10:51   0:00 [vchiq-keep/0]
root         953  0.0  0.0      0     0 ?        S<   10:51   0:00 [SMIO]
root         957  0.0  0.0      0     0 ?        I<   10:51   0:00 [mmal-vchiq]
root         960  0.0  0.0      0     0 ?        I<   10:51   0:00 [mmal-vchiq]
root         962  0.0  0.0      0     0 ?        I<   10:51   0:00 [cfg80211]
root         964  0.0  0.0      0     0 ?        I<   10:51   0:00 [mmal-vchiq]
root         965  0.0  0.0      0     0 ?        I<   10:51   0:00 [mmal-vchiq]
root         966  0.0  0.0      0     0 ?        I<   10:51   0:00 [brcmf_wq/mmc1:0]
root         967  0.0  0.0      0     0 ?        S    10:51   0:00 [brcmf_wdog/mmc1]
root        1541  0.0  0.0      0     0 ?        I<   10:51   0:00 [kaluad]
root        1542  0.0  0.0      0     0 ?        I<   10:51   0:00 [kmpath_rdacd]
root        1543  0.0  0.0      0     0 ?        I<   10:51   0:00 [kmpathd]
root        1544  0.0  0.0      0     0 ?        I<   10:51   0:00 [kmpath_handlerd]
root        1545  0.0  0.4 280368 16740 ?        SLsl 10:51   0:01 /sbin/multipathd -d -s
root        1556  0.0  0.0      0     0 ?        S<   10:51   0:00 [loop0]
root        1561  0.0  0.0      0     0 ?        S<   10:51   0:00 [loop1]
root        1564  0.0  0.0      0     0 ?        S<   10:51   0:00 [loop2]
root        1565  0.0  0.0      0     0 ?        S<   10:51   0:00 [loop3]
root        1566  0.0  0.0      0     0 ?        S<   10:51   0:00 [loop4]
root        1568  0.0  0.0      0     0 ?        S<   10:51   0:00 [loop5]
root        1632  0.0  0.2  46460 11496 ?        S<s  10:51   0:04 /lib/systemd/systemd-journald
systemd+    1635  0.0  0.1  89944  6244 ?        Ssl  10:51   0:00 /lib/systemd/systemd-timesyncd
root        1637  0.0  0.0      0     0 ?        I<   10:51   0:00 [kworker/u9:1]
systemd+    1651  0.0  0.1  26392  6868 ?        Ss   10:51   0:02 /lib/systemd/systemd-networkd
systemd+    1653  0.1  0.2  23880 11560 ?        Ss   10:51   0:07 /lib/systemd/systemd-resolved
root        1686  0.0  0.2 240736  8364 ?        Ssl  10:51   0:01 /usr/lib/accountsservice/accounts-daemon
message+    1687  0.0  0.1   8428  4516 ?        Ss   10:51   0:04 /usr/bin/dbus-daemon --system --address=systemd: --nofork --nopidfile --systemd-activation --syslog-only
root        1694  0.0  0.0  80932  3028 ?        Ssl  10:51   0:01 /usr/sbin/irqbalance --foreground
root        1695  0.0  0.4  29364 16936 ?        Ss   10:51   0:02 /usr/bin/python3 /usr/bin/networkd-dispatcher --run-startup-triggers
root        1698  0.0  0.0   1932   468 ?        Ss   10:51   0:00 /usr/sbin/rngd -r /dev/hwrng -f
syslog      1701  0.0  0.1 221180  4148 ?        Ssl  10:51   0:01 /usr/sbin/rsyslogd -n -iNONE
root        1704  0.0  0.1   9320  4576 ?        Ss   10:51   0:00 /usr/sbin/smartd -n
root        1706  0.0  0.6 1216508 24992 ?       Ssl  10:51   0:07 /usr/lib/snapd/snapd
root        1707  0.0  0.1  16296  6592 ?        Ss   10:51   0:01 /lib/systemd/systemd-logind
root        1708  0.0  0.3 396008 14664 ?        Ssl  10:51   0:04 /usr/lib/udisks2/udisksd
root        1711  0.0  0.1  12376  4760 ?        Ss   10:51   0:00 /sbin/wpa_supplicant -u -s -O /run/wpa_supplicant
root        1782  0.0  0.0   8336  2480 ?        Ss   10:51   0:00 /usr/sbin/cron -f
root        1797  0.3  1.1 1555928 45464 ?       Ssl  10:51   0:25 /usr/bin/containerd
daemon      1799  0.0  0.0   3592  1852 ?        Ss   10:51   0:00 /usr/sbin/atd -f
root        1804  0.0  0.4 107832 19380 ?        Ssl  10:51   0:00 /usr/bin/python3 /usr/share/unattended-upgrades/unattended-upgrade-shutdown --wait-for-signal
root        1820  0.0  0.2 236156  8204 ?        Ssl  10:51   0:00 /usr/lib/policykit-1/polkitd --no-debug
root        1835  0.0  0.0   6836  1900 ttyS0    Ss+  10:51   0:00 /sbin/agetty -o -p -- \u --keep-baud 115200,38400,9600 ttyS0 vt220
root        1844  0.0  0.0   5312  1424 tty1     Ss+  10:51   0:00 /sbin/agetty -o -p -- \u --noclear tty1 linux
root        1856  0.0  0.1  12208  6072 ?        Ss   10:51   0:00 sshd: /usr/sbin/sshd -D [listener] 0 of 10-100 startups
www-data    1899  0.0  0.0   8676  3876 ?        Ss   10:51   0:00 /usr/sbin/lighttpd -D -f /etc/lighttpd/lighttpd.conf
pihole      1930  0.1  0.2  19408  9932 ?        Ss   10:51   0:10 /lib/systemd/systemd --user
pihole      1935  0.0  0.1 169772  5664 ?        S    10:51   0:00 (sd-pam)
www-data    1944  0.0  0.5 197980 20084 ?        Ss   10:51   0:00 /usr/bin/php-cgi
www-data    1970  0.0  0.1 197980  4188 ?        S    10:51   0:00 /usr/bin/php-cgi
www-data    1971  0.0  0.1 197980  4188 ?        S    10:51   0:00 /usr/bin/php-cgi
www-data    1972  0.0  0.1 197980  4188 ?        S    10:51   0:00 /usr/bin/php-cgi
www-data    1973  0.0  0.1 197980  4188 ?        S    10:51   0:00 /usr/bin/php-cgi
root        1981  4.9  2.0 2988076 78120 ?       Ssl  10:51   6:28 /usr/bin/dockerd -H fd:// --containerd=/run/containerd/containerd.sock
pihole      2008  0.5  0.2 387236  8124 ?        S<l  10:51   0:39 /usr/bin/pihole-FTL
root        2064  0.0  0.0   1920   420 ?        S    10:51   0:00 bpfilter_umh
root        4781  0.0  0.2  15592  7940 ?        Ss   11:01   0:00 sshd: ubuntu [priv]
ubuntu      4804  0.1  0.2  19480  9948 ?        Ss   11:01   0:10 /lib/systemd/systemd --user
ubuntu      4805  0.0  0.1 169800  5768 ?        S    11:01   0:00 (sd-pam)
ubuntu      4931  0.0  0.1  15728  4920 ?        R    11:01   0:02 sshd: ubuntu@pts/0
ubuntu      4932  0.0  0.1  10168  5176 pts/0    Ss   11:01   0:01 -bash
root       15516  0.0  0.0   3504  2880 ?        Ss   11:21   0:01 /usr/sbin/dhcpcd
root       31718  0.0  0.0      0     0 ?        I    11:47   0:02 [kworker/1:1-events]
root       35304  0.0  0.0      0     0 ?        I    11:56   0:01 [kworker/2:3-events]
root       36173  0.0  0.0      0     0 ?        I    11:57   0:01 [kworker/3:8-events]
root       39291  0.0  0.0      0     0 ?        I    12:34   0:00 [kworker/u8:0-events_unbound]
root       39418  0.0  0.0      0     0 ?        I    12:42   0:00 [kworker/1:0-events]
root       39429  0.0  0.0      0     0 ?        I    12:43   0:00 [kworker/u8:3-events_unbound]
root       39552  0.0  0.0      0     0 ?        I    12:47   0:00 [kworker/3:2-mm_percpu_wq]
root       39561  0.0  0.0      0     0 ?        I    12:49   0:00 [kworker/u8:2-events_power_efficient]
root       39562  0.0  0.0      0     0 ?        I    12:49   0:00 [kworker/0:1-events]
root       39565  0.0  0.0      0     0 ?        I    12:50   0:00 [kworker/2:0-events]
root       39593  0.0  0.0      0     0 ?        I    12:52   0:00 [kworker/3:1-events]
root       39606  0.0  0.0      0     0 ?        I    12:55   0:00 [kworker/0:2-events]
root       39615  0.0  0.0      0     0 ?        D    12:57   0:00 [kworker/3:0+events_freezable]
root       39623  0.0  0.0      0     0 ?        I    12:58   0:00 [kworker/1:2-mm_percpu_wq]
root       39629  0.0  0.0      0     0 ?        I    12:58   0:00 [kworker/2:1-mm_percpu_wq]
root       39747  0.0  0.0   2380   124 ?        Ss   13:00   0:00 unifi -cwd /usr/lib/unifi -home /usr/lib/jvm/java-8-openjdk-arm64 -cp /usr/share/java/commons-daemon.jar:/usr/lib/unifi/lib/ace.jar -pidfile /var/run/unifi.pid -procname unifi -outfile SYSLOG -errfile SYSLOG -umask 027 -user unifi -Dunifi.datadir=/var/lib/unifi -Dunifi.logdir=/var/log/unifi -Dunifi.rundir=/var/run/unifi -Dunifi.core.enabled=false -Xmx1024M -Djava.awt.headless=true -Dfile.encoding=UTF-8 com.ubnt.ace.Launcher start
root       39748  0.0  0.0   2380   124 ?        S    13:00   0:00 unifi -cwd /usr/lib/unifi -home /usr/lib/jvm/java-8-openjdk-arm64 -cp /usr/share/java/commons-daemon.jar:/usr/lib/unifi/lib/ace.jar -pidfile /var/run/unifi.pid -procname unifi -outfile SYSLOG -errfile SYSLOG -umask 027 -user unifi -Dunifi.datadir=/var/lib/unifi -Dunifi.logdir=/var/log/unifi -Dunifi.rundir=/var/run/unifi -Dunifi.core.enabled=false -Xmx1024M -Djava.awt.headless=true -Dfile.encoding=UTF-8 com.ubnt.ace.Launcher start
unifi      39749  5.9  2.9 3434124 116448 ?      Sl   13:00   0:07 unifi -cwd /usr/lib/unifi -home /usr/lib/jvm/java-8-openjdk-arm64 -cp /usr/share/java/commons-daemon.jar:/usr/lib/unifi/lib/ace.jar -pidfile /var/run/unifi.pid -procname unifi -outfile SYSLOG -errfile SYSLOG -umask 027 -user unifi -Dunifi.datadir=/var/lib/unifi -Dunifi.logdir=/var/log/unifi -Dunifi.rundir=/var/run/unifi -Dunifi.core.enabled=false -Xmx1024M -Djava.awt.headless=true -Dfile.encoding=UTF-8 com.ubnt.ace.Launcher start
unifi      39779  108 16.1 4645556 626412 ?      Sl   13:00   2:14 /usr/lib/jvm/java-8-openjdk-arm64/jre/bin/java -Dfile.encoding=UTF-8 -Djava.awt.headless=true -Dapple.awt.UIElement=true -Dunifi.core.enabled=false -Xmx1024M -XX:+ExitOnOutOfMemoryError -XX:+CrashOnOutOfMemoryError -XX:ErrorFile=/usr/lib/unifi/logs/hs_err_pid%p.log -jar /usr/lib/unifi/lib/ace.jar start
unifi      39826  4.6  2.2 1062344 86620 ?       Sl   13:00   0:04 bin/mongod --dbpath /usr/lib/unifi/data/db --port 27117 --unixSocketPrefix /usr/lib/unifi/run --logRotate reopen --logappend --logpath /usr/lib/unifi/logs/mongod.log --pidfilepath /usr/lib/unifi/run/mongod.pid --wiredTigerCacheSizeGB=1 --bind_ip 127.0.0.1
ubuntu     39945  0.0  0.0  10188  2848 pts/0    R+   13:02   0:00 ps auxwww

[amx]

code:

unifi      39779  108 16.1 4645556 626412 ?      Sl   13:00   2:14 /usr/lib/jvm/java-8-openjdk-arm64/jre/bin/java -Dfile.encoding=UTF-8 -Djava.awt.headless=true -Dapple.awt.UIElement=true -Dunifi.core.enabled=false -Xmx1024M -XX:+ExitOnOutOfMemoryError -XX:+CrashOnOutOfMemoryError -XX:ErrorFile=/usr/lib/unifi/logs/hs_err_pid%p.log -jar /usr/lib/unifi/lib/ace.jar start

Het is toch echt Java/Unifi dat het probleem veroorzaakt.
Wellicht eens kijken of je resources die worden toegewezen aan deze applicatie kan inperken, of onderliggende oorzaak vinden?

[imdos]

@amx Ja; dat dacht ik eerst ook; maar als ik unifi stop.

code:

top - 16:01:38 up  2:26,  1 user,  load average: 0.95, 0.96, 1.00
Tasks: 147 total,   1 running, 146 sleeping,   0 stopped,   0 zombie
%Cpu(s):  0.2 us,  0.0 sy,  0.0 ni, 99.8 id,  0.0 wa,  0.0 hi,  0.0 si,  0.0 st
MiB Mem :   3792.3 total,   2586.9 free,    265.4 used,    939.9 buff/cache
MiB Swap:  10792.5 total,  10792.5 free,      0.0 used.   3382.9 avail Mem
  4559 root      20   0       0      0      0 D   0.7   0.0   0:03.74 kworker/0:3+events_freezable
   5770 ubuntu    20   0   10724   3224   2716 R   0.7   0.1   0:00.99 top
     10 root      20   0       0      0      0 I   0.3   0.0   0:06.00 rcu_preempt

Dan blijft alleen dit nog over...

code:

pihole      2715  0.2  0.1 386228  7520 ?        S<l  13:36   0:19 /usr/bin/pihole-FTL
root           1  0.3  0.2 167992 11276 ?        Ss   13:35   0:30 /sbin/init fixrtc

code:

ubuntu@ubuntu:~$ w
 16:09:35 up  2:34,  1 user,  load average: 1.00, 0.98, 1.00
USER     TTY      FROM             LOGIN@   IDLE   JCPU   PCPU WHAT
ubuntu   pts/0    192.168.22.233   13:47    0.00s  0.61s  0.02s w

[Hero of Time]

Zie je echt alleen maar 2 processen draaien? Dat geloof ik niet. Kijk dus nog eens goed naar wat er draait. Let er ook op dat zombie processen of defunct processen de load standaard met 1 kunnen verhogen. Je systeem kan dus echt volledig idle zijn en net zo goed uit staan, het zal dan alsnog een load van 1 hebben.

[Lizard]

Misschien ook het pollen van de sd-kaart uitzetten? https://jamesachambers.co...age-when-ssd-msd-booting/
Ik vermoed niet dat dit het helemaal oplost, maar alle beetjes helpen.

[imdos]

@Lizard Dat was de oplossing. Meteen even geprobeerd met een SDcard erin. Nu na een reboot en de fix werkt het ook. Daarom gemarkeerd als de oplossing.