[stork-users] stork issue

[fbcadmin]

We have 10+ kea dhcp servers monitored by stork.   for some unknown yet 
reason 7 of them are out of communication with stork .    this issue 
started last night.  there were no communication issues for the last month.

I've checked software version and configs.  The systems in comm with 
stork have the same software versions  and base configuration.  All 
systems are giving out dhcp addresses.  per systemclt all is well.

  I tried restoring a backup on one of the dhcp servers to no solution yet.

A few hours before the issue started I did a hardware upgrade to one of 
our nodes in proxmox cluster.   So there could be something with our 
network etc.  I looked but will look again..

I did notice the following in /var/log/daemon.log on stork. these repeat 
often - the log fills 2MB per hour.

looking at the logs,  does anyone notice something to be fixed in our 
configuration?


Update -  I checked earlier in logs this started on :  so this may be 
unrelated.  However they are coming a lot faster  ' Jul 21 15:41:33 
stork stork-server[284003]: time="2025-07-21 15:41:33" level="error" 
msg="Problem populating configuration review repo>'


Jul 23 19:58:34 stork stork-server[132]: time="2025-07-23 19:58:34" 
level="warning" msg="Problem getting state from Kea CA: cannot find Kea 
app" file=" appkea.go:303  "

Jul 23 19:58:34 stork stork-server[132]: time="2025-07-23 19:58:34" 
level="warning" msg="Problem getting state from Kea daemons: cannot find 
Kea app" file=" appkea.go:309  "


Jul 23 19:58:34 stork stork-server[132]: time="2025-07-23 19:58:34" 
level="error" msg="Problem populating configuration review reports
to the database for daemon 70103: ERROR #23502 null value in column 
\"config_hash\" of relation \"config_review\" violates not-null 
constraint\nproblem upserting the configuration review entry for daemon 
70103\nisc.org/stork/server/database/model.AddConfigReview\n\t/builds/isc-projects/stork/backend/server/database/model/configreview.go:42\nisc.org/stork/server/configreview.(*dispatcherImpl).populateReports\n\t/builds/isc-projects/stork/backend/server/configreview/dispatcher.go:664\nisc.org/stork/server/configreview.(*dispatcherImpl).
awaitReports\n\t/builds/isc-projects/stork/backend/server/configreview/dispatcher.go:359\nruntime.goexit\n\t/builds/isc-projects/stork/tools/golang/go/src/runtime/asm_amd64.s:1700" 
file="       dispatcher.go:361  "
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://lists.isc.org/pipermail/stork-users/attachments/20250723/8a33d309/attachment.htm>