[stork-users] stork issue

[Corby Stephens]

Is kea-ctrl-agent still running?



Corby Stephens, Fiber Network Administrator | ACCESS Anacortes Fiber Internet | P.O. Box 547 | 904 Sixth Street | Anacortes, WA  98221

Office:  360.588.8362 | Cell:  360.873.3770 | corbys at anacorteswa.<mailto:corbys at anacorteswa.>gov | www.anacorteswa.gov/fiber<http://www.anacorteswa.gov/fiber>

[cid:1f9798bb-ab31-4127-a840-513997b667c9]

________________________________
From: Stork-users <stork-users-bounces at lists.isc.org> on behalf of fbcadmin <fbcadmin at fantinibakery.com>
Sent: Wednesday, July 23, 2025 7:05 PM
To: stork-users at lists.isc.org <stork-users at lists.isc.org>
Subject: Re: [stork-users] stork issue


*****    This email is from outside the City of Anacortes network.  Please use caution when clicking on links, opening attachments, or replying.   *****

also I can ping from stork to the dhcp servers.  and ssh in to them.

On 7/23/25 20:15, fbcadmin wrote:

We have 10+ kea dhcp servers monitored by stork.   for some unknown yet reason 7 of them are out of communication with stork .    this issue started last night.  there were no communication issues for the last month.

I've checked software version and configs.  The systems in comm with stork have the same software versions  and base configuration.  All systems are giving out dhcp addresses.  per systemclt all is well.

 I tried restoring a backup on one of the dhcp servers to no solution yet.

A few hours before the issue started I did a hardware upgrade to one of our nodes in proxmox cluster.   So there could be something with our network etc.  I looked but will look again..

I did notice the following in /var/log/daemon.log on stork.   these repeat often - the log fills 2MB per hour.

looking at the logs,  does anyone notice something to be fixed in our configuration?


Update -  I checked earlier in logs this started on :  so this may be unrelated.  However they are coming a lot faster  ' Jul 21 15:41:33 stork stork-server[284003]: time="2025-07-21 15:41:33" level="error" msg="Problem populating configuration review repo>'


Jul 23 19:58:34 stork stork-server[132]: time="2025-07-23 19:58:34" level="warning" msg="Problem getting state from Kea CA: cannot find Kea app" file="           appkea.go:303  "

Jul 23 19:58:34 stork stork-server[132]: time="2025-07-23 19:58:34" level="warning" msg="Problem getting state from Kea daemons: cannot find Kea app" file="           appkea.go:309  "


Jul 23 19:58:34 stork stork-server[132]: time="2025-07-23 19:58:34" level="error" msg="Problem populating configuration review reports
to the database for daemon 70103: ERROR #23502 null value in column \"config_hash\" of relation \"config_review\" violates not-null constraint\nproblem upserting the configuration review entry for daemon 70103\//nisc.org/stork/server/database/model.AddConfigReview\n\t/builds/isc-projects/stork/backend/server/database/model/configreview.go:42\nisc.org/stork/server/configreview<https://linkprotect.cudasvc.com/url?a=https%3a%2f%2f%2f%2fnisc.org%2fstork%2fserver%2fdatabase%2fmodel.AddConfigReview%5cn%5ct%2fbuilds%2fisc-projects%2fstork%2fbackend%2fserver%2fdatabase%2fmodel%2fconfigreview.go%3a42%5cnisc.org%2fstork%2fserver%2fconfigreview&c=E,1,-zCAGUJ1rC38w68vivnRf1qZlrScUcJP4PR4jXAfV2LBQZbN2bZjZifw6Yr0ZSFWLsluExbxVvCtSdP67rdshhmHiutwYWQCKEBRc0J76v2EX-A,&typo=1&ancr_add=1>.(*dispatcherImpl).populateReports\n\t/builds/isc-projects/stork/backend/server/configreview/dispatcher.go:664\//nisc.org/stork/server/configreview<https://linkprotect.cudasvc.com/url?a=https%3a%2f%2f%2f%2fnisc.org%2fstork%2fserver%2fconfigreview&c=E,1,hBKOHQkA5jShHrRxErNrtbGky6PsQAwLF_ZzuRf0r1WgRBuh1t2CZnW9SSthpJ7C6pvdIL0EPrCCCV7jWTPw8yWAq5I4bkMWx-RNVDHJCGdpktqfViTd20o,&typo=1&ancr_add=1>.(*dispatcherImpl).
awaitReports\n\t/builds/isc-projects/stork/backend/server/configreview/dispatcher.go:359\nruntime.goexit\n\t/builds/isc-projects/stork/tools/golang/go/src/runtime/asm_amd64.s:1700" file="       dispatcher.go:361  "


-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://lists.isc.org/pipermail/stork-users/attachments/20250724/44f6b079/attachment-0001.htm>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: Outlook-tdsn2eut.png
Type: image/png
Size: 21886 bytes
Desc: Outlook-tdsn2eut.png
URL: <https://lists.isc.org/pipermail/stork-users/attachments/20250724/44f6b079/attachment-0001.png>