[Kea-users] High memory utilization for Kea server / Stork agent

Mon May 13 18:16:34 UTC 2024

Looking at the historic utilization over the week 

you can clearly see a rather dramatic increase in memory utilization
starting 5/10, with no specific changes to what the node is doing. 

Marek

From: Marek Hajduczenia <mxhajduczenia at gmail.com> 
Sent: Monday, May 13, 2024 12:12 PM
To: 'Kea user's list' <kea-users at lists.isc.org>
Subject: High memory utilization for Kea server / Stork agent 

Dear colleagues, 

I have been observing very high memory utilization for Kea VMs. In ~4 days,
the memory utilization has grown from ~2 GB to close to 8GB for no good
reason. 

I seem to be running multiple copies of processes for some reason, with
stork-agent likely being the primary culprit, and Kea DHCP servers being
likely the second culprit. I have the very same situation on both lab nodes.
I have to restart the server / stork agent periodically to eliminate the
memory bloat. 

    634 stork-age  20   0 1866M 26240 15824 S  0.0  0.3  7:35.77
/usr/bin/stork-agent

    709 stork-age  20   0 1866M 26240 15824 S  0.0  0.3  0:18.34
/usr/bin/stork-agent

    710 stork-age  20   0 1866M 26240 15824 S  0.0  0.3  0:34.27
/usr/bin/stork-agent

    711 stork-age  20   0 1866M 26240 15824 S  0.0  0.3  0:00.00
/usr/bin/stork-agent

    713 stork-age  20   0 1866M 26240 15824 S  0.0  0.3  0:00.01
/usr/bin/stork-agent

    727 stork-age  20   0 1866M 26240 15824 S  0.0  0.3  0:00.00
/usr/bin/stork-agent

    740 stork-age  20   0 1866M 26240 15824 S  0.0  0.3  1:29.63
/usr/bin/stork-agent

    894 stork-age  20   0 1866M 26240 15824 S  0.0  0.3  1:24.96
/usr/bin/stork-agent

   1921 stork-age  20   0 1866M 26240 15824 S  0.0  0.3  1:29.49
/usr/bin/stork-agent

  15986 stork-age  20   0 1866M 26240 15824 S  0.0  0.3  0:53.26
/usr/bin/stork-agent

   1340 _kea       20   0  507M 23864 16784 S  0.0  0.3  4:54.19
/usr/sbin/kea-dhcp6 -c /etc/kea/kea-dhcp6.conf

   1341 _kea       20   0  507M 23864 16784 S  0.0  0.3  0:00.00
/usr/sbin/kea-dhcp6 -c /etc/kea/kea-dhcp6.conf

   1342 _kea       20   0  507M 23864 16784 S  0.0  0.3  0:00.00
/usr/sbin/kea-dhcp6 -c /etc/kea/kea-dhcp6.conf

   1343 _kea       20   0  507M 23864 16784 S  0.0  0.3  0:00.00
/usr/sbin/kea-dhcp6 -c /etc/kea/kea-dhcp6.conf

   1344 _kea       20   0  507M 23864 16784 S  0.0  0.3  0:00.00
/usr/sbin/kea-dhcp6 -c /etc/kea/kea-dhcp6.conf

   1352 _kea       20   0  507M 23864 16784 S  0.0  0.3  0:05.43
/usr/sbin/kea-dhcp6 -c /etc/kea/kea-dhcp6.conf

   1353 _kea       20   0  507M 23864 16784 S  0.0  0.3  0:05.49
/usr/sbin/kea-dhcp6 -c /etc/kea/kea-dhcp6.conf

   1354 _kea       20   0  507M 23864 16784 S  0.0  0.3  0:08.22
/usr/sbin/kea-dhcp6 -c /etc/kea/kea-dhcp6.conf

   1355 _kea       20   0  507M 23864 16784 S  0.0  0.3  0:08.25
/usr/sbin/kea-dhcp6 -c /etc/kea/kea-dhcp6.conf

  20544 _kea       20   0  507M 23864 16784 S  0.0  0.3  0:00.00
/usr/sbin/kea-dhcp6 -c /etc/kea/kea-dhcp6.conf

  20545 _kea       20   0  507M 23864 16784 S  0.0  0.3  0:00.00
/usr/sbin/kea-dhcp6 -c /etc/kea/kea-dhcp6.conf

    679 root       20   0  107M 20736 12596 S  0.0  0.3  0:00.04
/usr/bin/python3 /usr/share/unattended-upgrades/unattended-upgrade-shutdown
--wait-for-signal

    732 root       20   0  107M 20736 12596 S  0.0  0.3  0:00.00
/usr/bin/python3 /usr/share/unattended-upgrades/unattended-upgrade-shutdown
--wait-for-signal

   1889 _kea       20   0  507M 19292 14552 S  0.0  0.2  3:05.41
/usr/sbin/kea-dhcp4 -c /etc/kea/kea-dhcp4.conf

   1890 _kea       20   0  507M 19292 14552 S  0.0  0.2  0:00.00
/usr/sbin/kea-dhcp4 -c /etc/kea/kea-dhcp4.conf

   1891 _kea       20   0  507M 19292 14552 S  0.0  0.2  0:00.00
/usr/sbin/kea-dhcp4 -c /etc/kea/kea-dhcp4.conf

   1892 _kea       20   0  507M 19292 14552 S  0.0  0.2  0:00.00
/usr/sbin/kea-dhcp4 -c /etc/kea/kea-dhcp4.conf

   1893 _kea       20   0  507M 19292 14552 S  0.0  0.2  0:00.00
/usr/sbin/kea-dhcp4 -c /etc/kea/kea-dhcp4.conf

   1897 _kea       20   0  507M 19292 14552 S  0.0  0.2  0:05.47
/usr/sbin/kea-dhcp4 -c /etc/kea/kea-dhcp4.conf

   1898 _kea       20   0  507M 19292 14552 S  0.0  0.2  0:05.15
/usr/sbin/kea-dhcp4 -c /etc/kea/kea-dhcp4.conf

   1899 _kea       20   0  507M 19292 14552 S  0.0  0.2  0:10.02
/usr/sbin/kea-dhcp4 -c /etc/kea/kea-dhcp4.conf

   1900 _kea       20   0  507M 19292 14552 S  0.0  0.2  0:09.95
/usr/sbin/kea-dhcp4 -c /etc/kea/kea-dhcp4.conf

  20586 _kea       20   0  507M 19292 14552 S  0.0  0.2  0:00.09
/usr/sbin/kea-dhcp4 -c /etc/kea/kea-dhcp4.conf

 20587 _kea       20   0  507M 19292 14552 S  0.0  0.2  0:00.08
/usr/sbin/kea-dhcp4 -c /etc/kea/kea-dhcp4.conf

Regards

Marek

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://lists.isc.org/pipermail/kea-users/attachments/20240513/1cccf722/attachment-0001.htm>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image003.png
Type: image/png
Size: 11974 bytes
Desc: not available
URL: <https://lists.isc.org/pipermail/kea-users/attachments/20240513/1cccf722/attachment-0003.png>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image004.png
Type: image/png
Size: 7776 bytes
Desc: not available
URL: <https://lists.isc.org/pipermail/kea-users/attachments/20240513/1cccf722/attachment-0004.png>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image005.png
Type: image/png
Size: 12762 bytes
Desc: not available
URL: <https://lists.isc.org/pipermail/kea-users/attachments/20240513/1cccf722/attachment-0005.png>