[Resolved?] Re: ovsqlite - bug?

Kamil Jońca kjonca at op.pl
Sun Nov 20 21:48:43 UTC 2022


Julien ÉLIE <julien at trigofacile.com> writes:

> Hi Kamil,
>
>>> Are there plenty of these messages or only a very few?
>> makehistory: cannot write overview data "@03FF30000000000000000000004400000008@"
>> makehistory: cannot write overview data "@03FF31000000000000000000004400000008@"
>> makehistory: cannot write overview data "@03FF32000000000000000000004400000008@"
>> makehistory: cannot write overview data "@03FF33000000000000000000004400000008@"
>> makehistory: cannot write overview data "@03FF35000000000000000000004400000007@"
>> makehistory: cannot write overview data "@03FF36000000000000000000004400000007@"
>> makehistory: cannot write overview data "@03FF37000000000000000000004400000007@"
>> 7 ( for 4.8 million articles in spool)
>
> OK, I thought there were far more errors than that.

Well, it seems that problem is with spool not with sqlite.
I dig somewhat deeper into overview database (with sqlite3 cli tool) and I
have some suspections about duplicates of (group,artnum) in spool 
These suspections makes me to issue command:
--8<---------------cut here---------------start------------->8---
sudo -u news env PATH=$PATH:/usr/lib/news/bin makehistory -O -x -S|grep'\(linux.debian.user:464806\|gmane.linux.debian.packages.ocaml.scm:21155\|gmane.comp.file-systems.gluster.user:28781\|gmane.comp.emulators.qemu:799173\|gmane.comp.java.jenkins.user:48616\)'|tee /tmp/spool
--8<---------------cut here---------------end--------------->8---
As a result I have:

--8<---------------cut here---------------start------------->8---
@03FF32000000000000000000004400000008@ 1643431380 0 Antipatterns and Handcuffs [was: Re: Resolved (without understanding  ...]	<tomas at tuxteam.de>	Fri, 24 Jul 2020 11:30:01 +0200	<Aw2bD-5Ad-7 at gated-at.bofh.it>	<AvcmJ-7vA-1 at gated-at.bofh.it> <AvkNk-4fy-9 at gated-at.bofh.it> <AvrON-8nC-1 at gated-at.bofh.it> <AvsBb-s0-9 at gated-at.bofh.it> <AvECm-7Y9-1 at gated-at.bofh.it> <AvT8l-8ch-1 at gated-at.bofh.it> <Aw1IB-5bc-3 at gated-at.bofh.it> <Aw1Si-5tS-7 at gated-at.bofh.it>	4818	57	Xref: news.kjonca linux.debian.user:464806
@03FF32000000000000000000004400000008@ 1643431380 0 Antipatterns and Handcuffs [was: Re: Resolved (without understanding  ...]	<tomas at tuxteam.de>	Fri, 24 Jul 2020 11:30:01 +0200	<Aw2bD-5Ad-7 at gated-at.bofh.it>	<AvcmJ-7vA-1 at gated-at.bofh.it> <AvkNk-4fy-9 at gated-at.bofh.it> <AvrON-8nC-1 at gated-at.bofh.it> <AvsBb-s0-9 at gated-at.bofh.it> <AvECm-7Y9-1 at gated-at.bofh.it> <AvT8l-8ch-1 at gated-at.bofh.it> <Aw1IB-5bc-3 at gated-at.bofh.it> <Aw1Si-5tS-7 at gated-at.bofh.it>	4818	57	Xref: news.kjonca linux.debian.user:464806
@03FF33000000000000000000004400000008@ 1643433853 0 [PATCH 1/4] fuzz: adjust timeout to allow for longer inputs	Alexander Bulekov <alxndr at bu.edu>	Thu, 17 Jun 2021 15:53:50 -0400	<20210617195353.284082-2-alxndr at bu.edu>	<20210617195353.284082-1-alxndr at bu.edu>	12813	68	Xref: news.kjonca gmane.comp.emulators.qemu:799173
@03FF33000000000000000000004400000008@ 1643433853 0 [PATCH 1/4] fuzz: adjust timeout to allow for longer inputs	Alexander Bulekov <alxndr at bu.edu>	Thu, 17 Jun 2021 15:53:50 -0400	<20210617195353.284082-2-alxndr at bu.edu>	<20210617195353.284082-1-alxndr at bu.edu>	12813	68	Xref: news.kjonca gmane.comp.emulators.qemu:799173
@03FF35000000000000000000004400000007@ 1643412102 0 [ocaml-ctypes] branch master updated (e9b7f58 -> d0083e4)	=?UTF-8?Q?St=C3=A9phane_Glondu?= <glondu-Rt8N2qQyUwUVerv4eZO+jXx8IIHWJNfj at public.gmane.org>	Tue, 14 Jun 2016 09:46:35 +0000	<20160614094635.17834.92877 at moszumanska.debian.org>		15918	200	Xref: news.kjonca gmane.linux.debian.packages.ocaml.scm:21155
@03FF35000000000000000000004400000007@ 1643412102 0 [ocaml-ctypes] branch master updated (e9b7f58 -> d0083e4)	=?UTF-8?Q?St=C3=A9phane_Glondu?= <glondu-Rt8N2qQyUwUVerv4eZO+jXx8IIHWJNfj at public.gmane.org>	Tue, 14 Jun 2016 09:46:35 +0000	<20160614094635.17834.92877 at moszumanska.debian.org>		15918	200	Xref: news.kjonca gmane.linux.debian.packages.ocaml.scm:21155
@03FF36000000000000000000004400000007@ 1643417459 0 Re: volume start: data0: failed: Commit failed on localhost.	Deepak Naidu <dnaidu-DDmLM1+adcrQT0dZR+AlfA at public.gmane.org>	Fri, 24 Feb 2017 17:36:03 +0000	<a660e4e9c84f4d0485142fb7e1839fa0 at HQMAIL106.nvidia.com>	<fe80b0d1955f46e9af5b1884c600ff22 at HQMAIL106.nvidia.com> <44497c9b-607c-fe30-582e-50fc53aea164 at redhat.com>	277268	3740	Xref: news.kjonca gmane.comp.file-systems.gluster.user:28781
@03FF36000000000000000000004400000007@ 1643417459 0 Re: volume start: data0: failed: Commit failed on localhost.	Deepak Naidu <dnaidu-DDmLM1+adcrQT0dZR+AlfA at public.gmane.org>	Fri, 24 Feb 2017 17:36:03 +0000	<a660e4e9c84f4d0485142fb7e1839fa0 at HQMAIL106.nvidia.com>	<fe80b0d1955f46e9af5b1884c600ff22 at HQMAIL106.nvidia.com> <44497c9b-607c-fe30-582e-50fc53aea164 at redhat.com>	277268	3740	Xref: news.kjonca gmane.comp.file-systems.gluster.user:28781
@03FF37000000000000000000004400000007@ 1643421414 0 Re: location of email-ext template file	Chris T <chris.truong.92-Re5JQEeQqe8AvxtiuMwx3w at public.gmane.org>	Wed, 6 Dec 2017 10:42:10 -0800 (PST)	<753c223c-90cd-4770-9c75-6de9afbc0446__19462.2635994621$1512588446$gmane$org at googlegroups.com>	<96e7e9f6-d4c9-4e77-8ca7-00bdce9462da at googlegroups.com> <CAPiUgVchzFuyQHWuw4-CsxqZ-tjSuGxteE9xZkMkWaJX=AcKcw at mail.gmail.com> <CACKaJRPcdnhiQwU0DevOju-5U=DJYxwhPKo97Zt1uTtnZUUxhg at mail.gmail.com> <CAPiUgVdaVCnstwympfdemOZJxGyF0jfpxayuDF1HVUz3B+UTUw at mail.gmail.com> <b943c080-e6af-4e56-bee2-01e17d5b17a2 at googlegroups.com> <CAPiUgVf2s_2oYGPsKMGoc1cyW-4AFEMAeYH+Cz0P5L_XXQuH+Q at mail.gmail.com>	215351	3638	Xref: news.kjonca gmane.comp.java.jenkins.user:48616
@03FF37000000000000000000004400000007@ 1643421414 0 Re: location of email-ext template file	Chris T <chris.truong.92-Re5JQEeQqe8AvxtiuMwx3w at public.gmane.org>	Wed, 6 Dec 2017 10:42:10 -0800 (PST)	<753c223c-90cd-4770-9c75-6de9afbc0446__19462.2635994621$1512588446$gmane$org at googlegroups.com>	<96e7e9f6-d4c9-4e77-8ca7-00bdce9462da at googlegroups.com> <CAPiUgVchzFuyQHWuw4-CsxqZ-tjSuGxteE9xZkMkWaJX=AcKcw at mail.gmail.com> <CACKaJRPcdnhiQwU0DevOju-5U=DJYxwhPKo97Zt1uTtnZUUxhg at mail.gmail.com> <CAPiUgVdaVCnstwympfdemOZJxGyF0jfpxayuDF1HVUz3B+UTUw at mail.gmail.com> <b943c080-e6af-4e56-bee2-01e17d5b17a2 at googlegroups.com> <CAPiUgVf2s_2oYGPsKMGoc1cyW-4AFEMAeYH+Cz0P5L_XXQuH+Q at mail.gmail.com>	215351	3638	Xref: news.kjonca gmane.comp.java.jenkins.user:48616
--8<---------------cut here---------------end--------------->8---

So makehistory sometimes  generate two lines for spool entry.

It is worth noting, that greping /var/lib/news/history for these storage
tokesn returns nothing.
(for example)
--8<---------------cut here---------------start------------->8---
kjonca at alfa:~%grep 03FF32000000000000000000004400000008 /var/lib/news/history
kjonca at alfa:~%
--8<---------------cut here---------------end--------------->8---

So the first thigs I should do is to make history consistent with spool
and then test further.
But for now I am pretty sure, that sqlite worked properly as, it forces
uniqueness of  (group,artnum )  in overview (and other methods not) -
and this causes error messages.
Sorry for bothering you.

KJ


-- 
http://wolnelektury.pl/wesprzyj/teraz/


More information about the inn-workers mailing list