<?xml version="1.0" encoding="utf-8" standalone="yes"?><rss version="2.0" xmlns:atom="http://www.w3.org/2005/Atom"><channel><title>Monitoring on ads' corner</title><link>https://andreas.scherbaum.la/tags/monitoring/</link><description>Recent content in Monitoring on ads' corner</description><generator>Hugo</generator><language>en-us</language><lastBuildDate>Wed, 19 Jun 2024 18:09:00 +0200</lastBuildDate><atom:link href="https://andreas.scherbaum.la/tags/monitoring/index.xml" rel="self" type="application/rss+xml"/><item><title>Understanding VACUUM, VACUUM template0, and Transaction ID Wraparound</title><link>https://andreas.scherbaum.la/post/2024-06-19_understanding-vacuum-vacuum-template0-and-transaction-id-wraparound/</link><pubDate>Wed, 19 Jun 2024 18:09:00 +0200</pubDate><guid>https://andreas.scherbaum.la/post/2024-06-19_understanding-vacuum-vacuum-template0-and-transaction-id-wraparound/</guid><description>&lt;p&gt;&lt;em&gt;PostgreSQL&lt;/em&gt; uses Multi-Version Concurrency Control (MVCC) to manage concurrent access to the database, and store each version of a tuple in a table. To keep the database efficient, &lt;em&gt;PostgreSQL&lt;/em&gt; employs a cleanup process called &lt;em&gt;VACUUM&lt;/em&gt;, which removes unnecessary tuples. This not only saves disk space and keeps the database size under control, it also prevents the dreaded &amp;ldquo;Transaction ID Wraparound&amp;rdquo; issue. Regularly running &lt;em&gt;VACUUM&lt;/em&gt; is crucial, including on the &lt;code&gt;template0&lt;/code&gt; database, which is normally handled by the &lt;em&gt;Autovacuum&lt;/em&gt; daemon. However, sometimes manual intervention is necessary.&lt;/p&gt;</description></item><item><title>Delayed service notifications in Icinga2</title><link>https://andreas.scherbaum.la/post/2024-01-29_delayed-service-notifications-in-icinga2/</link><pubDate>Mon, 29 Jan 2024 11:00:00 +0100</pubDate><guid>https://andreas.scherbaum.la/post/2024-01-29_delayed-service-notifications-in-icinga2/</guid><description>&lt;p&gt;My private infrastructure is &lt;a href="https://andreas.scherbaum.la/tags/monitoring"&gt;monitored&lt;/a&gt; using &lt;a href="https://icinga.com/docs/icinga-2/latest/doc/01-about/"&gt;Icinga2&lt;/a&gt;. The configuration is rolled out across all devices using &lt;a href="https://icinga.com/docs/icinga-director/latest/doc/01-Introduction/"&gt;Icinga Director&lt;/a&gt;. That works reliable.&lt;/p&gt;&#10;&lt;p&gt;However some services are quite noisy, for no good reason.&lt;/p&gt;</description></item><item><title>Icinga Director and disk checks for fuse mountpoints</title><link>https://andreas.scherbaum.la/post/2021-11-27_icinga-director-and-disk-checks-for-fuse-mountpoints/</link><pubDate>Sat, 27 Nov 2021 20:41:00 +0100</pubDate><guid>https://andreas.scherbaum.la/post/2021-11-27_icinga-director-and-disk-checks-for-fuse-mountpoints/</guid><description>&lt;p&gt;When I rolled out my &lt;a href="https://andreas.scherbaum.la/post/2021-11-10_how-to-configure-notifications-in-icinga2-director/"&gt;new Icinga2 installation&lt;/a&gt;, and added disk checks for all laptops, I ran into a small problem: there is a fuse mountpoint for logged in users which only the user can read. Apparently it has something to do &lt;a href="https://github.com/flatpak/xdg-desktop-portal/issues/512"&gt;with Flatpack&lt;/a&gt;.&lt;/p&gt;</description></item><item><title>How to configure notifications in Icinga2 Director</title><link>https://andreas.scherbaum.la/post/2021-11-10_how-to-configure-notifications-in-icinga2-director/</link><pubDate>Wed, 10 Nov 2021 21:55:00 +0100</pubDate><guid>https://andreas.scherbaum.la/post/2021-11-10_how-to-configure-notifications-in-icinga2-director/</guid><description>&lt;p&gt;I&amp;rsquo;m using &lt;a href="https://andreas.scherbaum.la/tags/icinga2/"&gt;Icinga2&lt;/a&gt; for a long time, but recently installed a new system and using Director for the first time. I know how to configure notifications in &lt;em&gt;Icinga2&lt;/em&gt; config files, but getting them working in Director (with Director options only) is a bit of a challenge.&lt;/p&gt;&#10;&lt;p&gt;Here is a step-by-step to get simple mail notifications working. From there it should be easier to configure more advanced notifications.&lt;/p&gt;</description></item><item><title>Huginn: Monitor changes in websites</title><link>https://andreas.scherbaum.la/post/2020-11-22_huginn-monitor-changes-in-websites/</link><pubDate>Sun, 22 Nov 2020 11:11:00 +0100</pubDate><guid>https://andreas.scherbaum.la/post/2020-11-22_huginn-monitor-changes-in-websites/</guid><description>&lt;p&gt;The &lt;a href="https://github.com/huginn/huginn"&gt;Huginn&lt;/a&gt; software is not only good for monitoring Twitter feeds, it can also be used to monitor websites for changes.&lt;/p&gt;</description></item><item><title>Monitor software version changes with Huginn</title><link>https://andreas.scherbaum.la/post/2020-10-18_monitor-software-version-changes-with-huginn/</link><pubDate>Sun, 18 Oct 2020 02:39:00 +0200</pubDate><guid>https://andreas.scherbaum.la/post/2020-10-18_monitor-software-version-changes-with-huginn/</guid><description>&lt;p&gt;&lt;a href="https://github.com/huginn/huginn"&gt;Huginn&lt;/a&gt; is a great piece of software, but the &lt;a href="https://github.com/huginn/huginn/wiki"&gt;documentation&lt;/a&gt; is &amp;hellip; a bit sparse. Especially when it comes to details of the agents. I&amp;rsquo;m going to blog about a couple more more examples in the future.&lt;/p&gt;&#10;&lt;p&gt;For another project I&amp;rsquo;m using &lt;a href="https://leafletjs.com/"&gt;Leaflet&lt;/a&gt;, a JavaScript library for rendering maps in a browser. New versions are released occasionally, and I want to know when it&amp;rsquo;s time to update the project website. &lt;em&gt;Huginn&lt;/em&gt; can do that.&lt;/p&gt;</description></item><item><title>Monitor website status with Huginn</title><link>https://andreas.scherbaum.la/post/2020-10-14_monitor-website-status-with-huginn/</link><pubDate>Wed, 14 Oct 2020 22:04:00 +0200</pubDate><guid>https://andreas.scherbaum.la/post/2020-10-14_monitor-website-status-with-huginn/</guid><description>&lt;p&gt;After setting up &lt;em&gt;&lt;a href="https://github.com/huginn/huginn"&gt;Huginn&lt;/a&gt;&lt;/em&gt;, and implementing the actions on my todo list, I had a look at the available agents and started thinking what else they can be useful for.&lt;/p&gt;&#10;&lt;p&gt;One of the ideas I came up with is monitoring if a website is available, or has some trouble. I already have a monitoring system in place, but it&amp;rsquo;s a nice exercise to learn more about the other agents.&lt;/p&gt;</description></item><item><title>Grafana: select host for a dashboard</title><link>https://andreas.scherbaum.la/post/2020-06-30_grafana-select-host-for-a-dashboard/</link><pubDate>Tue, 30 Jun 2020 00:49:00 +0200</pubDate><guid>https://andreas.scherbaum.la/post/2020-06-30_grafana-select-host-for-a-dashboard/</guid><description>&lt;p&gt;&lt;em&gt;InfluxDB&lt;/em&gt; is running on a &lt;em&gt;Raspberry Pi&lt;/em&gt; in my home network (&lt;a href="https://andreas.scherbaum.la/post/2020-06-21_move-influxdb-data-directory-to-a-sdcard/"&gt;with separate attached disk&lt;/a&gt;), and I installed a &lt;em&gt;Grafana&lt;/em&gt; on top of it, to visualize crucial data.&lt;/p&gt;</description></item><item><title>Monitor additional details in Telegraf with the "Exec" input filter</title><link>https://andreas.scherbaum.la/post/2020-06-25_monitor-additional-details-in-telegraf-with-the-exec-input-filter/</link><pubDate>Thu, 25 Jun 2020 01:14:00 +0200</pubDate><guid>https://andreas.scherbaum.la/post/2020-06-25_monitor-additional-details-in-telegraf-with-the-exec-input-filter/</guid><description>&lt;p&gt;After &lt;a href="https://andreas.scherbaum.la/post/2020-06-24_install-telegraf-using-ansible/"&gt;installing Telegraf&lt;/a&gt; and hooking up everything into &lt;a href="https://www.influxdata.com/products/influxdb-overview/"&gt;InfluxDB&lt;/a&gt;, I was missing the status of my backups. Every system here creates encrypted backups every night, and stores them on a central NAS, and off-site. But I want to know statistics about the backups, and see if something is not working.&lt;/p&gt;&#10;&lt;p&gt;I&amp;rsquo;m using &lt;a href="https://restic.net/"&gt;Restic&lt;/a&gt; for the backups (will blog about this another time). However &lt;em&gt;Telegraf&lt;/em&gt; does not support &lt;em&gt;Restic&lt;/em&gt; directly, I need a few workarounds. This blog post however is not directly about monitoring the backups, but about how to write your own plugin for &lt;em&gt;Telegraf&lt;/em&gt;.&lt;/p&gt;</description></item><item><title>Install Telegraf using Ansible</title><link>https://andreas.scherbaum.la/post/2020-06-24_install-telegraf-using-ansible/</link><pubDate>Wed, 24 Jun 2020 18:56:00 +0200</pubDate><guid>https://andreas.scherbaum.la/post/2020-06-24_install-telegraf-using-ansible/</guid><description>&lt;p&gt;I have an &lt;a href="https://www.influxdata.com/products/influxdb-overview/"&gt;InfluxDB&lt;/a&gt; up and &lt;a href="https://andreas.scherbaum.la/post/2020-06-21_move-influxdb-data-directory-to-a-sdcard/"&gt;running&lt;/a&gt; in my network, and decided to monitor all (well, all possible - the &lt;em&gt;QNAP&lt;/em&gt; seems to be a problem) devices. That&amp;rsquo;s quite easy to do by installing &lt;a href="https://www.influxdata.com/time-series-platform/telegraf/"&gt;Telegraf&lt;/a&gt; as a server agent, and add some configuration. Everything is deployed using &lt;a href="https://www.ansible.com/"&gt;Ansible&lt;/a&gt;, so I can re-use the same &lt;a href="https://docs.ansible.com/ansible/latest/user_guide/playbooks.html"&gt;Playbook&lt;/a&gt; for many devices.&lt;/p&gt;&#10;&lt;p&gt;Let&amp;rsquo;s assume I have a laptop which I want to monitor. The hostname is &lt;code&gt;sunlight&lt;/code&gt; (it&amp;rsquo;s not, I&amp;rsquo;m just using this as an example).&lt;/p&gt;</description></item><item><title>Add InfluxDB settings in Telegraf using Ansible: [WARNING]: The value [...] (type list) in a string field was converted to "[...]" (type string)</title><link>https://andreas.scherbaum.la/post/2020-06-23_add-influxdb-settings-in-telegraf-using-ansible-warning-the-value-...-type-list-in-a-string-field-was-converted-to-...-type-string/</link><pubDate>Tue, 23 Jun 2020 17:30:00 +0200</pubDate><guid>https://andreas.scherbaum.la/post/2020-06-23_add-influxdb-settings-in-telegraf-using-ansible-warning-the-value-...-type-list-in-a-string-field-was-converted-to-...-type-string/</guid><description>&lt;p&gt;I&amp;rsquo;m in the process of updating my entire home setup, and integrate everything properly. Part of this process is to automate everything, and use &lt;em&gt;Ansible&lt;/em&gt; Playbooks to deploy devices and configurations.&lt;/p&gt;</description></item><item><title>Monitor ChromeCast status in openHAB</title><link>https://andreas.scherbaum.la/post/2020-06-19_monitor-chromecast-status-in-openhab/</link><pubDate>Fri, 19 Jun 2020 13:10:00 +0200</pubDate><guid>https://andreas.scherbaum.la/post/2020-06-19_monitor-chromecast-status-in-openhab/</guid><description>&lt;p&gt;I really like to monitor things, to catch issues early on. In our home we have a couple &lt;a href="https://en.wikipedia.org/wiki/Chromecast"&gt;ChromeCasts&lt;/a&gt;, both Audio and Video. They are all connected to the &lt;a href="https://andreas.scherbaum.la/categories/openhab"&gt;openHAB&lt;/a&gt; system, Once in a while they stop working, and need to be restarted (unplugged and plugged in again). Unfortunately you usually only find that out when you want to stream something, and wonder why either the &lt;em&gt;ChromeCast&lt;/em&gt; does not show up in the device list, or does show up but does not accept the media.&lt;/p&gt;</description></item><item><title>Raspberry Pi watchdog for openHAB</title><link>https://andreas.scherbaum.la/post/2020-05-07_raspberry-pi-watchdog-for-openhab/</link><pubDate>Thu, 07 May 2020 02:27:00 +0200</pubDate><guid>https://andreas.scherbaum.la/post/2020-05-07_raspberry-pi-watchdog-for-openhab/</guid><description>&lt;p&gt;The &lt;a href="https://andreas.scherbaum.la/categories/openhab"&gt;openHAB&lt;/a&gt; display in the kitchen is still the problem child. Occasionally it just stops, other times it does not refresh the &lt;em&gt;HABpanel&lt;/em&gt;, even though it has a connection to the &lt;em&gt;openHAB&lt;/em&gt; server. Then there is the problem with the &lt;a href="https://andreas.scherbaum.la/post/2020-01-29_reboot-the-raspberry-pi-on-network-failures-brcmfmac-brcmf_cfg80211_scan-scan-error-110/"&gt;network card in the Pi&lt;/a&gt;. And - ok, that&amp;rsquo;s a server-side problem - occasionally the &lt;a href="https://andreas.scherbaum.la/post/2020-04-28_openhab2-check-if-alive/"&gt;weather stops updating&lt;/a&gt;. All in all that&amp;rsquo;s a lot of trouble for a display which is just supposed to run standalone.&lt;/p&gt;&#10;&lt;p&gt;In the latest iteration I looked into activating the integrated hardware watchdog in the &lt;em&gt;Raspberry Pi&lt;/em&gt;. Checking the temperature it never goes above ~55°C celcius, even though the display is in an almost closed frame and can&amp;rsquo;t exchange much heat with the environment. But nevertheless occasionally the &lt;em&gt;Pi&lt;/em&gt; just halts, and stops operating.&lt;/p&gt;</description></item><item><title>Reboot the Raspberry Pi on network failures (brcmfmac: brcmf_cfg80211_scan: scan error -110)</title><link>https://andreas.scherbaum.la/post/2020-01-29_reboot-the-raspberry-pi-on-network-failures-brcmfmac-brcmf_cfg80211_scan-scan-error-110/</link><pubDate>Wed, 29 Jan 2020 01:41:00 +0100</pubDate><guid>https://andreas.scherbaum.la/post/2020-01-29_reboot-the-raspberry-pi-on-network-failures-brcmfmac-brcmf_cfg80211_scan-scan-error-110/</guid><description>&lt;p&gt;In one of my &lt;a href="https://andreas.scherbaum.la/post/2020-01-18_occasional-habpanel-disconnect-from-the-openhab-server/"&gt;earlier blog posts&lt;/a&gt; I reported that occasionally the &lt;em&gt;HABpanel&lt;/em&gt; will disconnect from the server. Turns out it&amp;rsquo;s not &lt;em&gt;HABpanel&lt;/em&gt;, but it&amp;rsquo;s the Pi itself which is causing the trouble. Part of the problem why it took me so long to investigate is that the display is in the kitchen, and someone had to have a look and spot the small red error message. To work around that problem, I hooked the device up in the network monitoring, and had an alarm triggered when the device is not reachable. Sure enough, that happens occasionally.&lt;/p&gt;&#10;&lt;p&gt;Because I moved &lt;code&gt;/var/log&lt;/code&gt; to a small RAM disk to &lt;a href="https://andreas.scherbaum.la/post/2019-01-13_avoid-wear-out-of-ssd-cards-in-an-openhab-system/"&gt;avoid wearing out the SDcard&lt;/a&gt;, all logs are lost once the device is rebooted. Had to bring keyboard and mouse to the kitchen in order to save the logfiles once the device was no longer reachable over the network.&lt;/p&gt;&#10;&lt;p&gt;Turns out it&amp;rsquo;s a well-known problem with the network chip on the &lt;em&gt;Raspberry Pi&lt;/em&gt;. One of the &lt;em&gt;GitHub&lt;/em&gt; &lt;a href="https://github.com/raspberrypi/linux/issues/2453"&gt;issues is open since 2018&lt;/a&gt;, the &lt;a href="https://github.com/raspberrypi/linux/issues/3155"&gt;other one since 2019&lt;/a&gt;. So no hope for a real quick fix :-(&lt;/p&gt;</description></item><item><title>f* MySQL</title><link>https://andreas.scherbaum.la/post/2007-02-03_f-mysql/</link><pubDate>Sat, 03 Feb 2007 11:06:00 +0100</pubDate><guid>https://andreas.scherbaum.la/post/2007-02-03_f-mysql/</guid><description>&lt;p&gt;Today I woke up because the Nagios used by our ISP sent me a SMS: something does not work well on one of the association servers. According to the SMS, the webserver was not responding. Ok, the webserver is &lt;a href="https://andreas.scherbaum.la/post/2006-12-05_there-is-no-spoonmmmmmauto_increment/"&gt;never&lt;/a&gt; the cause of the problem, something else is going wrong.&lt;/p&gt;</description></item></channel></rss>