<html xmlns:v="urn:schemas-microsoft-com:vml" xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns:m="http://schemas.microsoft.com/office/2004/12/omml" xmlns="http://www.w3.org/TR/REC-html40">
<head>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
<meta name="Generator" content="Microsoft Word 15 (filtered medium)">
<style><!--
/* Font Definitions */
@font-face
{font-family:Wingdings;
panose-1:5 0 0 0 0 0 0 0 0 0;}
@font-face
{font-family:"Cambria Math";
panose-1:2 4 5 3 5 4 6 3 2 4;}
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}
@font-face
{font-family:"Open Sans";}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0in;
font-size:11.0pt;
font-family:"Calibri",sans-serif;}
a:link, span.MsoHyperlink
{mso-style-priority:99;
color:blue;
text-decoration:underline;}
span.EmailStyle21
{mso-style-type:personal-reply;
font-family:"Calibri",sans-serif;
color:windowtext;}
.MsoChpDefault
{mso-style-type:export-only;
font-size:10.0pt;}
@page WordSection1
{size:8.5in 11.0in;
margin:1.0in 1.0in 1.0in 1.0in;}
div.WordSection1
{page:WordSection1;}
/* List Definitions */
@list l0
{mso-list-id:1309868581;
mso-list-type:hybrid;
mso-list-template-ids:-1013516838 68176708 67698691 67698693 67698689 67698691 67698693 67698689 67698691 67698693;}
@list l0:level1
{mso-level-number-format:bullet;
mso-level-text:;
mso-level-tab-stop:none;
mso-level-number-position:left;
margin-left:20.4pt;
text-indent:-.25in;
font-family:Wingdings;
mso-fareast-font-family:Calibri;
mso-bidi-font-family:Arial;}
@list l0:level2
{mso-level-number-format:bullet;
mso-level-text:o;
mso-level-tab-stop:none;
mso-level-number-position:left;
margin-left:56.4pt;
text-indent:-.25in;
font-family:"Courier New";}
@list l0:level3
{mso-level-number-format:bullet;
mso-level-text:;
mso-level-tab-stop:none;
mso-level-number-position:left;
margin-left:92.4pt;
text-indent:-.25in;
font-family:Wingdings;}
@list l0:level4
{mso-level-number-format:bullet;
mso-level-text:;
mso-level-tab-stop:none;
mso-level-number-position:left;
margin-left:128.4pt;
text-indent:-.25in;
font-family:Symbol;}
@list l0:level5
{mso-level-number-format:bullet;
mso-level-text:o;
mso-level-tab-stop:none;
mso-level-number-position:left;
margin-left:164.4pt;
text-indent:-.25in;
font-family:"Courier New";}
@list l0:level6
{mso-level-number-format:bullet;
mso-level-text:;
mso-level-tab-stop:none;
mso-level-number-position:left;
margin-left:200.4pt;
text-indent:-.25in;
font-family:Wingdings;}
@list l0:level7
{mso-level-number-format:bullet;
mso-level-text:;
mso-level-tab-stop:none;
mso-level-number-position:left;
margin-left:236.4pt;
text-indent:-.25in;
font-family:Symbol;}
@list l0:level8
{mso-level-number-format:bullet;
mso-level-text:o;
mso-level-tab-stop:none;
mso-level-number-position:left;
margin-left:272.4pt;
text-indent:-.25in;
font-family:"Courier New";}
@list l0:level9
{mso-level-number-format:bullet;
mso-level-text:;
mso-level-tab-stop:none;
mso-level-number-position:left;
margin-left:308.4pt;
text-indent:-.25in;
font-family:Wingdings;}
ol
{margin-bottom:0in;}
ul
{margin-bottom:0in;}
--></style><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext="edit" spidmax="1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext="edit">
<o:idmap v:ext="edit" data="1" />
</o:shapelayout></xml><![endif]-->
</head>
<body lang="EN-US" link="blue" vlink="purple" style="word-wrap:break-word">
<div class="WordSection1">
<p class="MsoNormal">Hi,<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">Sorry one more thing. It is not a memory leak . In the experiment the data is being pulled from the disk zone file and loaded into memory. Then the process sits idle. RAM utilization is stable. In other words, it is a footprint of the
file into the cache. Easy experiment -> just the time-consuming task is to generate 100 MIL A + CANME dummy records into the zone file.<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">#9.18.5<o:p></o:p></p>
<p class="MsoNormal">/usr/local/sbin/named -v<o:p></o:p></p>
<p class="MsoNormal">BIND 9.18.5 (Stable Release) <id:6593103><o:p></o:p></p>
<p class="MsoNormal">3.10.0-1160.71.1.el7.x86_64 #1 SMP Wed Jun 15 08:55:08 UTC 2022 x86_64 x86_64 x86_64 GNU/Linux<o:p></o:p></p>
<p class="MsoNormal">Virtualized AWS EC2 - Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 8 CORE / 32 GB ram<o:p></o:p></p>
<p class="MsoNormal">Named.file as simple as possible as the experiment is only to measure a memory footprint of “many” records.<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">#BIND 9.16.21<o:p></o:p></p>
<p class="MsoNormal">/usr/local/sbin/named -v<o:p></o:p></p>
<p class="MsoNormal">BIND 9.16.21 (Extended Support Version) <id:a8aa450><o:p></o:p></p>
<p class="MsoNormal">#Other parameters are the same.<o:p></o:p></p>
<p class="MsoNormal">Named.file as simple as possible as the experiment is only to measure a memory footprint of “many” records.<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">Regards,<o:p></o:p></p>
<p class="MsoNormal">Dmitri.<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<div>
<div style="border:none;border-top:solid #E1E1E1 1.0pt;padding:3.0pt 0in 0in 0in">
<p class="MsoNormal"><b>From:</b> bind-users <bind-users-bounces@lists.isc.org> <b>
On Behalf Of </b>Dmitri Pavlov<br>
<b>Sent:</b> Monday, August 1, 2022 6:19 PM<br>
<b>To:</b> Victoria Risk <vicky@isc.org><br>
<b>Cc:</b> bind-users@lists.isc.org; Ond≈ôej Sur√Ω <ondrej@isc.org><br>
<b>Subject:</b> RE: High memory consumption in bind 9.18.2<o:p></o:p></p>
</div>
</div>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">Thank you ISC,<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">New run with the same input<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">#9.18.5<o:p></o:p></p>
<p class="MsoNormal"><span lang="FR">pmap -x ... | tail -n 1<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="FR">total kB 34892476 29399048 29395316<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="FR"><o:p> </o:p></span></p>
<p class="MsoNormal"><span lang="FR">#9.16.21<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="FR">pmap -x ... | tail -n 1<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="FR">total kB 27935060 27341676 27338344<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="FR"><o:p> </o:p></span></p>
<p class="MsoNormal">The diff. Is still the same ~ 2 GB.<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">I’m pretty much sure you will get the same results in your lab. My guess the earlier experiment with 1 mil zones and small number of machines could not visualize the diff.
<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">With 100 MIL of records the diff. is more visual. <o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">Hence the same question -> Should the memory reduction apply to our experiment? Please let us know if any additional details about our experiment are required.<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">Regards,<o:p></o:p></p>
<p class="MsoNormal">Dmitri.<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<div>
<div style="border:none;border-top:solid #E1E1E1 1.0pt;padding:3.0pt 0in 0in 0in">
<p class="MsoNormal"><b>From:</b> bind-users <<a href="mailto:bind-users-bounces@lists.isc.org">bind-users-bounces@lists.isc.org</a>>
<b>On Behalf Of </b>Victoria Risk<br>
<b>Sent:</b> Monday, August 1, 2022 6:08 PM<br>
<b>To:</b> Doug Whitfield <<a href="mailto:dwhitfield@perforce.com">dwhitfield@perforce.com</a>><br>
<b>Cc:</b> <a href="mailto:bind-users@lists.isc.org">bind-users@lists.isc.org</a>; Ond≈ôej Sur√Ω <<a href="mailto:ondrej@isc.org">ondrej@isc.org</a>><br>
<b>Subject:</b> Re: High memory consumption in bind 9.18.2<o:p></o:p></p>
</div>
</div>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">Hi Doug, <o:p></o:p></p>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal">I think Ondrej is referring to this post from a prior month: <a href="https://nam12.safelinks.protection.outlook.com/?url=https%3A%2F%2Flists.isc.org%2Fpipermail%2Fbind-users%2F2022-June%2F106350.html&data=05%7C01%7Cdpavlov%40perforce.com%7C32439a5f16474cb8331608da73d1433c%7C95b666d19a7549ab95a38969fbcdc08c%7C0%7C0%7C637949639865510996%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C2000%7C%7C%7C&sdata=9gRb3fv14k1DAieNwnoJ%2BAp1T9caTv32cAKWh4YUqdY%3D&reserved=0">https://lists.isc.org/pipermail/bind-users/2022-June/106350.html</a><o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal">….<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal">For tips on how to measure memory usage you might want to look at <span style="font-size:10.0pt;font-family:"Open Sans",sans-serif;color:#1C58D9"><a href="https://nam12.safelinks.protection.outlook.com/?url=https%3A%2F%2Fstackoverflow.com%2Fquestions%2F131303%2Fhow-can-i-measure-the-actual-memory-usage-of-an-application-or-process&data=05%7C01%7Cdpavlov%40perforce.com%7C32439a5f16474cb8331608da73d1433c%7C95b666d19a7549ab95a38969fbcdc08c%7C0%7C0%7C637949639865510996%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C2000%7C%7C%7C&sdata=q7aTYA6yrB7ZjRRyJrC0y4zrUK4M7IM6UUyqxFoFp38%3D&reserved=0" target="_blank"><span style="color:#1C58D9;text-decoration:none">https://stackoverflow.com/questions/131303/how-can-i-measure-the-actual-memory-usage-of-an-application-or-process</span></a>
…..</span><o:p></o:p></p>
</div>
<div>
<p class="MsoNormal" style="margin-bottom:12.0pt"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:10.0pt;font-family:"Open Sans",sans-serif">Also note the comment about ignoring ’total’ memory.</span><o:p></o:p></p>
</div>
<div>
<p class="MsoNormal" style="margin-bottom:12.0pt"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:10.0pt;font-family:"Open Sans",sans-serif">Vicky</span><o:p></o:p></p>
</div>
<div>
<p class="MsoNormal" style="margin-bottom:12.0pt"><o:p> </o:p></p>
<blockquote style="margin-top:5.0pt;margin-bottom:5.0pt">
<div>
<p class="MsoNormal">On Aug 1, 2022, at 10:32 AM, Ondřej Surý <<a href="mailto:ondrej@isc.org">ondrej@isc.org</a>> wrote:<o:p></o:p></p>
</div>
<p class="MsoNormal"><o:p> </o:p></p>
<div>
<div>
<blockquote style="margin-top:5.0pt;margin-bottom:5.0pt">
<p class="MsoNormal">On 1. 8. 2022, at 16:14, Doug Whitfield <<a href="mailto:dwhitfield@perforce.com">dwhitfield@perforce.com</a>> wrote:<br>
<br>
as monitored from "top" RES value<o:p></o:p></p>
</blockquote>
<p class="MsoNormal"><br>
Please read the whole thread on measuring the real consumed memory.<br>
<br>
The '“top” RES value' has little or no value at all.<br>
<br>
Ondrej<br>
--<br>
Ondřej Surý (He/Him)<br>
<a href="mailto:ondrej@isc.org">ondrej@isc.org</a><br>
<br>
My working hours and your working hours may be different. Please do not feel obligated to reply outside your normal working hours.<br>
<br>
<br>
-- <br>
Visit <a href="https://nam12.safelinks.protection.outlook.com/?url=https%3A%2F%2Flists.isc.org%2Fmailman%2Flistinfo%2Fbind-users&data=05%7C01%7Cdpavlov%40perforce.com%7C32439a5f16474cb8331608da73d1433c%7C95b666d19a7549ab95a38969fbcdc08c%7C0%7C0%7C637949639865510996%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C2000%7C%7C%7C&sdata=PXqs4J3AOnLLp0KRdKhAHXgGQqd1AVWMKsge4pRtK3c%3D&reserved=0">
https://lists.isc.org/mailman/listinfo/bind-users</a> to unsubscribe from this list<br>
<br>
ISC funds the development of this software with paid support subscriptions. Contact us at
<a href="https://nam12.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww.isc.org%2Fcontact%2F&data=05%7C01%7Cdpavlov%40perforce.com%7C32439a5f16474cb8331608da73d1433c%7C95b666d19a7549ab95a38969fbcdc08c%7C0%7C0%7C637949639865510996%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C2000%7C%7C%7C&sdata=sH%2FVsjink11lqvRd58k7DXOXU7tPfAUk6g6QxqzMirc%3D&reserved=0">
https://www.isc.org/contact/</a> for more information.<br>
<br>
<br>
bind-users mailing list<br>
<a href="mailto:bind-users@lists.isc.org">bind-users@lists.isc.org</a><br>
<a href="https://nam12.safelinks.protection.outlook.com/?url=https%3A%2F%2Flists.isc.org%2Fmailman%2Flistinfo%2Fbind-users&data=05%7C01%7Cdpavlov%40perforce.com%7C32439a5f16474cb8331608da73d1433c%7C95b666d19a7549ab95a38969fbcdc08c%7C0%7C0%7C637949639865510996%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C2000%7C%7C%7C&sdata=PXqs4J3AOnLLp0KRdKhAHXgGQqd1AVWMKsge4pRtK3c%3D&reserved=0">https://lists.isc.org/mailman/listinfo/bind-users</a><o:p></o:p></p>
</div>
</div>
</blockquote>
</div>
<p class="MsoNormal" style="margin-bottom:12.0pt"><o:p> </o:p></p>
<div align="center">
<table class="MsoNormalTable" border="0" cellspacing="0" cellpadding="0" style="border-collapse:collapse">
<tbody>
<tr>
<td width="532" valign="top" style="width:399.35pt;border:double #FFC000 1.5pt;background:#FFFBEF;padding:0in 5.4pt 0in 5.4pt">
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><b><span style="color:#BF8F00">CAUTION:</span></b><span style="color:black"> This email originated from outside of the organization. Do not click on links or open attachments unless
you recognize the sender and know the content is safe.</span><o:p></o:p></p>
</td>
</tr>
</tbody>
</table>
</div>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p><i><span style="font-size:8.0pt;color:#A6A6A6">This e-mail may contain information that is privileged or confidential. If you are not the intended recipient, please delete the e-mail and any attachments and notify us immediately.</span></i><o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<br>
<p><span style="font-size:8.0pt;color:#A6A6A6;font-style:italic">This e-mail may contain information that is privileged or confidential. If you are not the intended recipient, please delete the e-mail and any attachments and notify us immediately.</span></p>
<br>
</body>
</html>