<html class="apple-mail-supports-explicit-dark-mode"><head><meta http-equiv="content-type" content="text/html; charset=utf-8"></head><body dir="auto">That can be tuned Khalid - have a look at these parameters. Implement hysteresis by adding a for clause to delay the alert trigger, use keep_firing_for to smooth out transient drops or group alert manager notifications to reduce the spam. It was a steep learning curve for me moving to the stack but it\u2019s highly configurable and confusing - but once you nail down a few tactics it\u2019ll come quick. <div><div><font color="#0a0a0a" face="Google Sans, Helvetica Neue, sans-serif" size="3"><span style="caret-color: rgb(10, 10, 10); -webkit-tap-highlight-color: rgba(0, 0, 0, 0); -webkit-text-size-adjust: 100%; background-color: rgb(255, 255, 255);"><br id="lineBreakAtBeginningOfSignature"></span></font><div dir="ltr">Sent from my iPhone</div><div dir="ltr"><br><blockquote type="cite">On May 23, 2026, at 5:40\u202fPM, Khalid Baheyeldin <kb@2bits.com> wrote:<br><br></blockquote></div><blockquote type="cite"><div dir="ltr">\ufeff<div dir="ltr"><div dir="ltr"><div dir="ltr"><div class="gmail_default" style="font-size:small">On Fri, May 22, 2026 at 9:19\u202fPM Adam Glauser <<a href="mailto:adamglauser@gmail.com" target="_blank">adamglauser@gmail.com</a>> wrote:</div></div><div class="gmail_quote"><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div><div><div dir="auto">In your case, I think the Targets are the black box-exporter services. They are responding, so are considered up, even though the SSH service they are monitoring is down (probe_status=0)</div></div></div></blockquote><div><br></div><div style="font-size:small" class="gmail_default">That makes perfect sense.</div><div style="font-size:small" class="gmail_default">Blackbox Exporter is up, but whatever it is monitoring is down.</div><div style="font-size:small" class="gmail_default"><br></div><div style="font-size:small" class="gmail_default">I had to struggle to customize the email messages, and finally got that figured out.</div><div style="font-size:small" class="gmail_default">Though they are only HTML (not plain text).</div><div style="font-size:small" class="gmail_default"><br></div><div style="font-size:small" class="gmail_default">Another thing is that it reports an outage immediately.</div><div style="font-size:small" class="gmail_default">Nagios4 made sure that the outage persists before it reported it, tuning out network glitches and such. </div><div style="font-size:small" class="gmail_default"><br></div><div style="font-size:small" class="gmail_default">And Nagios4 had the concept of flapping, when a service keeps going down then up.</div><div style="font-size:small" class="gmail_default">It is not reported as down, rather it is flagged as flapping. </div><div style="font-size:small" class="gmail_default">I can't find something like that in Prometheus. </div></div></div>
</div>
<pre>_______________________________________________<br>
kwlug-disc mailing list<br>
To unsubscribe, send an email to kwlug-disc-leave@kwlug.org<br>
with the subject "unsubscribe", or email<br>
kwlug-disc-owner@kwlug.org to contact a human being.<br>
</pre></div></blockquote></div></div></body></html>