[stork-users] stork issue

[fbcadmin]

It looks like the original issue was caused by an auto configuration I 
had made which changed permissions on /etc/kea/     .



On 7/26/25 09:36, fbcadmin wrote:
>
> I did these steps to fix.
>
>
> chgrp _kea /etc/kea
>
> chmod 750 /etc/kea
>
>
> on most systems for some unknown reason had this at most systems
>
> aptitude  search isc-kea-ctrl-agent
>
> idA isc-kea-ctrl-agent - ISC Kea DHCP server REST API service
>
>
> did this to fix:
>
> apt-get -y install isc-kea-ctrl-agent
> systemctl  enable  isc-kea-ctrl-agent.service
>
> ystemctl  start   isc-kea-ctrl-agent.service
>
>
> then rebooted
>
>
>
> On 7/24/25 10:29, Corby Stephens wrote:
>> Is kea-ctrl-agent still running?
>>
>>
>> *Corby Stephens, Fiber Network Administrator* | *ACCESS* Anacortes 
>> Fiber Internet | P.O. Box 547 | 904 Sixth Street | Anacortes, WA  98221
>>
>> Office: 360.588.8362 | Cell:  360.873.3770 | corbys at anacorteswa. 
>> <mailto:corbys at anacorteswa.>gov | www.anacorteswa.gov/fiber 
>> <http://www.anacorteswa.gov/fiber>
>>
>> ------------------------------------------------------------------------
>> *From:* Stork-users <stork-users-bounces at lists.isc.org> on behalf of 
>> fbcadmin <fbcadmin at fantinibakery.com>
>> *Sent:* Wednesday, July 23, 2025 7:05 PM
>> *To:* stork-users at lists.isc.org <stork-users at lists.isc.org>
>> *Subject:* Re: [stork-users] stork issue
>>
>> ****** This email is from outside the City of Anacortes network.  
>> Please use caution when clicking on links, opening attachments, or 
>> replying.   ******
>>
>> also I can ping from stork to the dhcp servers.  and ssh in to them.
>>
>> On 7/23/25 20:15, fbcadmin wrote:
>>>
>>> We have 10+ kea dhcp servers monitored by stork.   for some unknown 
>>> yet reason 7 of them are out of communication with stork .    this 
>>> issue started last night.  there were no communication issues for 
>>> the last month.
>>>
>>> I've checked software version and configs.  The systems in comm with 
>>> stork have the same software versions  and base configuration.  All 
>>> systems are giving out dhcp addresses.  per systemclt all is well.
>>>
>>>  I tried restoring a backup on one of the dhcp servers to no 
>>> solution yet.
>>>
>>> A few hours before the issue started I did a hardware upgrade to one 
>>> of our nodes in proxmox cluster.   So there could be something with 
>>> our network etc.  I looked but will look again..
>>>
>>> I did notice the following in /var/log/daemon.log on stork.   these 
>>> repeat often - the log fills 2MB per hour.
>>>
>>> looking at the logs,  does anyone notice something to be fixed in 
>>> our configuration?
>>>
>>>
>>> Update -  I checked earlier in logs this started on : so this may be 
>>> unrelated.  However they are coming a lot faster  ' Jul 21 15:41:33 
>>> stork stork-server[284003]: time="2025-07-21 15:41:33" level="error" 
>>> msg="Problem populating configuration review repo>'
>>>
>>>
>>> Jul 23 19:58:34 stork stork-server[132]: time="2025-07-23 19:58:34" 
>>> level="warning" msg="Problem getting state from Kea CA: cannot find 
>>> Kea app" file=" appkea.go:303  "
>>>
>>> Jul 23 19:58:34 stork stork-server[132]: time="2025-07-23 19:58:34" 
>>> level="warning" msg="Problem getting state from Kea daemons: cannot 
>>> find Kea app" file=" appkea.go:309  "
>>>
>>>
>>> Jul 23 19:58:34 stork stork-server[132]: time="2025-07-23 19:58:34" 
>>> level="error" msg="Problem populating configuration review reports
>>> to the database for daemon 70103: ERROR #23502 null value in column 
>>> \"config_hash\" of relation \"config_review\" violates not-null 
>>> constraint\nproblem upserting the configuration review entry for 
>>> daemon 
>>> 70103\//nisc.org/stork/server/database/model.AddConfigReview\n\t/builds/isc-projects/stork/backend/server/database/model/configreview.go:42\nisc.org/stork/server/configreview 
>>> <https://linkprotect.cudasvc.com/url?a=https%3a%2f%2f%2f%2fnisc.org%2fstork%2fserver%2fdatabase%2fmodel.AddConfigReview%5cn%5ct%2fbuilds%2fisc-projects%2fstork%2fbackend%2fserver%2fdatabase%2fmodel%2fconfigreview.go%3a42%5cnisc.org%2fstork%2fserver%2fconfigreview&c=E,1,-zCAGUJ1rC38w68vivnRf1qZlrScUcJP4PR4jXAfV2LBQZbN2bZjZifw6Yr0ZSFWLsluExbxVvCtSdP67rdshhmHiutwYWQCKEBRc0J76v2EX-A,&typo=1&ancr_add=1>.(*dispatcherImpl).populateReports\n\t/builds/isc-projects/stork/backend/server/configreview/dispatcher.go:664\//nisc.org/stork/server/configreview 
>>> <https://linkprotect.cudasvc.com/url?a=https%3a%2f%2f%2f%2fnisc.org%2fstork%2fserver%2fconfigreview&c=E,1,hBKOHQkA5jShHrRxErNrtbGky6PsQAwLF_ZzuRf0r1WgRBuh1t2CZnW9SSthpJ7C6pvdIL0EPrCCCV7jWTPw8yWAq5I4bkMWx-RNVDHJCGdpktqfViTd20o,&typo=1&ancr_add=1>.(*dispatcherImpl).
>>> awaitReports\n\t/builds/isc-projects/stork/backend/server/configreview/dispatcher.go:359\nruntime.goexit\n\t/builds/isc-projects/stork/tools/golang/go/src/runtime/asm_amd64.s:1700" 
>>> file="       dispatcher.go:361  "
>>>
>>>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://lists.isc.org/pipermail/stork-users/attachments/20250726/4c36710e/attachment.htm>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: Outlook-tdsn2eut.png
Type: image/png
Size: 21886 bytes
Desc: not available
URL: <https://lists.isc.org/pipermail/stork-users/attachments/20250726/4c36710e/attachment.png>