Weird Issue (possible bug)

#1

So I finally got everything going and it working well, sorta.

This is what my map looks like when everything works.

This is what it looks like when the issue pops up.

This is what shows up in the log when it happens.

2017-05-11 09:04:04 - WEATHERMAP WARNING: [Map 4] QHI.conf: ReadData: LINK 276-812, target: /var/www/html/cacti/rra/sonicwall_tz300_276_linden_decryptbytes_860.rrd:decryptbytes:encryptbytes had no valid data, according to WeatherMapDataSource_rrd [WMWARN70]
2017-05-11 09:04:04 - WEATHERMAP WARNING: [Map 4] QHI.conf: ReadData: LINK Resort-276, target: /var/www/html/cacti/rra/sonicwall_tz300_276_linden_traffic_in_434.rrd had no valid data, according to WeatherMapDataSource_rrd [WMWARN70]
2017-05-11 09:04:04 - WEATHERMAP WARNING: [Map 4] QHI.conf: ReadData: LINK 276-505, target: /var/www/html/cacti/rra/sonicwall_tz300_276_linden_decryptbytes_861.rrd:decryptbytes:encryptbytes had no valid data, according to WeatherMapDataSource_rrd [WMWARN70]
2017-05-11 09:04:04 - WEATHERMAP WARNING: [Map 4] QHI.conf: ReadData: LINK 500-505, target: /var/www/html/cacti/rra/sonicwall_tz300_500_decryptbytes_858.rrd:decryptbytes:encryptbytes had no valid data, according to WeatherMapDataSource_rrd [WMWARN70]
2017-05-11 09:04:04 - WEATHERMAP WARNING: [Map 4] QHI.conf: ReadData: LINK Hazel-505, target: /var/www/html/cacti/rra/sonicwall_soho_hazel_st_decryptbytes_855.rrd:decryptbytes:encryptbytes had no valid data, according to WeatherMapDataSource_rrd [WMWARN70]
2017-05-11 09:04:04 - WEATHERMAP WARNING: [Map 4] QHI.conf: ReadData: LINK 500-812, target: /var/www/html/cacti/rra/sonicwall_tz300_500_decryptbytes_859.rrd:decryptbytes:encryptbytes had no valid data, according to WeatherMapDataSource_rrd [WMWARN70]
2017-05-11 09:04:04 - WEATHERMAP WARNING: [Map 4] QHI.conf: ReadData: LINK 500-Resort, target: /var/www/html/cacti/rra/sonicwall_nsa_240_500_traffic_in_239.rrd had no valid data, according to WeatherMapDataSource_rrd [WMWARN70]
2017-05-11 09:04:04 - WEATHERMAP WARNING: [Map 4] QHI.conf: ReadData: LINK Hazel-Resort, target: /var/www/html/cacti/rra/sonicwall_soho_hazel_st_traffic_in_245.rrd had no valid data, according to WeatherMapDataSource_rrd [WMWARN70]
2017-05-11 09:04:04 - WEATHERMAP WARNING: [Map 4] QHI.conf: ReadData: LINK Hazel-812, target: /var/www/html/cacti/rra/sonicwall_soho_hazel_st_decryptbytes_854.rrd:decryptbytes:encryptbytes had no valid data, according to WeatherMapDataSource_rrd [WMWARN70]
2017-05-11 09:04:04 - WEATHERMAP WARNING: [Map 4] QHI.conf: ReadData: LINK 505-WETC, target: /var/www/html/cacti/rra/sonicwall_nsa_2600_router_505_traffic_in_950.rrd had no valid data, according to WeatherMapDataSource_rrd [WMWARN70]
2017-05-11 09:04:04 - SYSTEM MONITOR STATS: Time:0.08 Reboots:0 DownDevices:0 Notifications:0 Purges:0
2017-05-11 09:04:04 - WEATHERMAP WARNING: [Map 4] QHI.conf: ReadData: LINK att-505, target: /var/www/html/cacti/rra/sonicwall_nsa_2600_router_505_traffic_in_952.rrd had no valid data, according to WeatherMapDataSource_rrd [WMWARN70]

Now to resolve the issue all you have to do is open the graph’s associated with the DS and then the data will show back up in the map. Then 10 mins later it will happen again. I have repeated this several times. I also checked the graph’s and there is no missing data.

This is what is in my conf.

# Automatically generated by php-weathermap v0.98



WIDTH 1920
HEIGHT 1080
BACKGROUND images/hd-gradient-grey.jpg
HTMLSTYLE overlib

KEYTEXTCOLOR 0 0 0
KEYOUTLINECOLOR 0 0 0
KEYBGCOLOR 255 255 255
BGCOLOR 255 255 255
TITLECOLOR 0 0 0
TIMECOLOR 0 0 0

# All settings for scale DEFAULT
	KEYPOS DEFAULT 20 20 Traffic Load

	SCALE DEFAULT 0    0      192 192 192   
	SCALE DEFAULT 0    1      255 255 255   
	SCALE DEFAULT 1    10     140 0 255   
	SCALE DEFAULT 10   25     32 32 255   
	SCALE DEFAULT 25   40     0 192 255   
	SCALE DEFAULT 40   55     0 240 0   
	SCALE DEFAULT 55   70     240 240 0   
	SCALE DEFAULT 70   85     255 192 0   
	SCALE DEFAULT 85   100    255 0 0   


SET key_hidezero_DEFAULT 1

# End of global section


# TEMPLATE-only NODEs:
NODE DEFAULT
	MAXVALUE 100


# TEMPLATE-only LINKs:
LINK DEFAULT
	WIDTH 3
	BWLABEL bits
	BANDWIDTH 10M


# regular NODEs:
NODE 812
	LABEL 812 Mtn Pine
	LABELOFFSET W
	ICON images/router_[UNKNOWN].gif
	POSITION 400 450

NODE 505
	LABEL 505 W. Grand
	LABELOFFSET E
	OVERLIBGRAPH http://192.168.3.6/cacti/graph_image.php?local_graph_id=621&graph_start=1493991024&graph_end=1494012624&graph_width=600&graph_height=150
	ICON images/router_[UNKNOWN].gif
	POSITION 1600 450

NODE 276
	LABEL 276 Linden
	LABELOFFSET N
	ICON images/router_up.gif
	POSITION 1000 260

NODE 500
	LABEL 500 Quapaw
	LABELOFFSET N
	ICON images/router_up.gif
	POSITION 1000 125

NODE Hazel
	LABEL Hazel ST
	LABELOFFSET N
	ICON images/router_up.gif
	POSITION 400 75

NODE Resort
	LABEL CableLynx (Resort)
	ICON images/Cloud-Filled.png
	POSITION 400 250

NODE Enmar
	LABEL LR Enmar
	LABELOFFSET S
	ICON images/router_up.gif
	POSITION 400 700

NODE comcast
	LABEL Comcast
	ICON images/Cloud-Filled.png
	POSITION 1000 700

NODE WETC
	LABEL Wireless ETC
	ICON images/Cloud-Filled.png
	POSITION 1600 250

NODE HC
	LABEL LR Hidden Creek
	LABELOFFSET S
	ICON images/router_up.gif
	POSITION 1600 700

NODE att
	LABEL AT&T
	ICON images/Cloud-Filled.png
	POSITION 1000 375


# regular LINKs:
LINK 812-505
	INFOURL /cacti/graph.php?rra_id=all&local_graph_id=819
	OVERLIBGRAPH /cacti/graph_image.php?rra_id=0&graph_nolegend=true&graph_height=100&graph_width=300&local_graph_id=819
	TARGET /var/www/html/cacti/rra/sonicwall_tz_400_812_decryptbytes_841.rrd:decryptbytes:encryptbytes
	NODES 812:30:0 505:-30:0
	SET _tidied 1

LINK 812-att
	INFOURL /cacti/graph.php?rra_id=all&local_graph_id=97
	OVERLIBGRAPH /cacti/graph_image.php?rra_id=0&graph_nolegend=true&graph_height=100&graph_width=300&local_graph_id=97
	TARGET /var/www/html/cacti/rra/sonicwall_tz_300_812_traffic_in_122.rrd
	NODES 812:0:0 att:0:0
	SET _tidied 1

LINK att-505
	INFOURL /cacti/graph.php?rra_id=all&local_graph_id=930
	OVERLIBGRAPH /cacti/graph_image.php?rra_id=0&graph_nolegend=true&graph_height=100&graph_width=300&local_graph_id=930
	TARGET /var/www/html/cacti/rra/sonicwall_nsa_2600_router_505_traffic_in_952.rrd
	NODES att:0:0 505:0:0
	SET _tidied 1

LINK Enmar-comcast
	INFOURL /cacti/graph.php?rra_id=all&local_graph_id=240
	OVERLIBGRAPH /cacti/graph_image.php?rra_id=0&graph_nolegend=true&graph_height=100&graph_width=300&local_graph_id=240
	TARGET /var/www/html/cacti/rra/sonicwall_7600_enmar_traffic_in_265.rrd
	NODES Enmar:30:0 comcast:-46:0
	BANDWIDTH 25M 5M
	SET _tidied 1

LINK comcast-HC
	INFOURL /cacti/graph.php?rra_id=all&local_graph_id=235
	OVERLIBGRAPH /cacti/graph_image.php?rra_id=0&graph_nolegend=true&graph_height=100&graph_width=300&local_graph_id=235
	TARGET /var/www/html/cacti/rra/sonicwall_soho_router_hidden_creek_traffic_in_260.rrd
	NODES comcast:46:0 HC:-30:0
	BANDWIDTH 25M 5M
	SET _tidied 1

LINK HC-505
	INFOURL /cacti/graph.php?rra_id=all&local_graph_id=835
	OVERLIBGRAPH /cacti/graph_image.php?rra_id=0&graph_nolegend=true&graph_height=100&graph_width=300&local_graph_id=835
	TARGET /var/www/html/cacti/rra/sonicwall_soho_hidden_creek_decryptbytes_857.rrd:decryptbytes:encryptbytes
	NODES HC:0:-17 505:0:17
	SET _tidied 1

LINK Enmar-505
	INFOURL /cacti/graph.php?rra_id=all&local_graph_id=841
	OVERLIBGRAPH /cacti/graph_image.php?rra_id=0&graph_nolegend=true&graph_height=100&graph_width=300&local_graph_id=841
	TARGET /var/www/html/cacti/rra/sonicwall_tz300_7600_enmar_decryptbytes_863.rrd:decryptbytes:encryptbytes
	NODES Enmar:0:0 505:0:0
	SET _tidied 1

LINK HC-812
	INFOURL /cacti/graph.php?rra_id=all&local_graph_id=834
	OVERLIBGRAPH /cacti/graph_image.php?rra_id=0&graph_nolegend=true&graph_height=100&graph_width=300&local_graph_id=834
	TARGET /var/www/html/cacti/rra/sonicwall_soho_hidden_creek_decryptbytes_856.rrd:decryptbytes:encryptbytes
	NODES HC:0:0 812:0:0
	SET _tidied 1

LINK 505-WETC
	INFOURL /cacti/graph.php?rra_id=all&local_graph_id=928
	OVERLIBGRAPH /cacti/graph_image.php?rra_id=0&graph_nolegend=true&graph_height=100&graph_width=300&local_graph_id=928
	TARGET /var/www/html/cacti/rra/sonicwall_nsa_2600_router_505_traffic_in_950.rrd
	NODES 505:0:-17 WETC:0:31
	SET _tidied 1

LINK Hazel-812
	INFOURL /cacti/graph.php?rra_id=all&local_graph_id=832
	OVERLIBGRAPH /cacti/graph_image.php?rra_id=0&graph_nolegend=true&graph_height=100&graph_width=300&local_graph_id=832
	TARGET /var/www/html/cacti/rra/sonicwall_soho_hazel_st_decryptbytes_854.rrd:decryptbytes:encryptbytes
	NODES Hazel:0:17 812:0:-17
	VIA 307 251
	SET _tidied 1

LINK Resort-812
	INFOURL /cacti/graph.php?rra_id=all&local_graph_id=96
	OVERLIBGRAPH /cacti/graph_image.php?rra_id=0&graph_nolegend=true&graph_height=100&graph_width=300&local_graph_id=96
	TARGET /var/www/html/cacti/rra/sonicwall_tz_300_812_traffic_in_121.rrd
	NODES Resort:0:31 812:0:-17
	SET _tidied 1

LINK Hazel-Resort
	INFOURL /cacti/graph.php?rra_id=all&local_graph_id=220
	OVERLIBGRAPH /cacti/graph_image.php?rra_id=0&graph_nolegend=true&graph_height=100&graph_width=300&local_graph_id=220
	TARGET /var/www/html/cacti/rra/sonicwall_soho_hazel_st_traffic_in_245.rrd
	NODES Hazel:0:17 Resort:0:-31
	BANDWIDTH 25M 3M
	SET _tidied 1

LINK 500-Resort
	INFOURL /cacti/graph.php?rra_id=all&local_graph_id=214
	OVERLIBGRAPH /cacti/graph_image.php?rra_id=0&graph_nolegend=true&graph_height=100&graph_width=300&local_graph_id=214
	TARGET /var/www/html/cacti/rra/sonicwall_nsa_240_500_traffic_in_239.rrd
	NODES 500:0:0 Resort:0:0
	SET _tidied 1

LINK 500-812
	INFOURL /cacti/graph.php?rra_id=all&local_graph_id=837
	OVERLIBGRAPH /cacti/graph_image.php?rra_id=0&graph_nolegend=true&graph_height=100&graph_width=300&local_graph_id=837
	TARGET /var/www/html/cacti/rra/sonicwall_tz300_500_decryptbytes_859.rrd:decryptbytes:encryptbytes
	NODES 500:0:0 812:0:0
	SET _tidied 1

LINK Hazel-505
	INFOURL /cacti/graph.php?rra_id=all&local_graph_id=833
	OVERLIBGRAPH /cacti/graph_image.php?rra_id=0&graph_nolegend=true&graph_height=100&graph_width=300&local_graph_id=833
	TARGET /var/www/html/cacti/rra/sonicwall_soho_hazel_st_decryptbytes_855.rrd:decryptbytes:encryptbytes
	NODES Hazel:0:0 505:0:0
	VIA 1064 80
	SET _tidied 1

LINK 500-505
	INFOURL /cacti/graph.php?rra_id=all&local_graph_id=836
	OVERLIBGRAPH /cacti/graph_image.php?rra_id=0&graph_nolegend=true&graph_height=100&graph_width=300&local_graph_id=836
	TARGET /var/www/html/cacti/rra/sonicwall_tz300_500_decryptbytes_858.rrd:decryptbytes:encryptbytes
	NODES 500:0:0 505:0:0
	SET _tidied 1

LINK 276-505
	INFOURL /cacti/graph.php?rra_id=all&local_graph_id=839
	OVERLIBGRAPH /cacti/graph_image.php?rra_id=0&graph_nolegend=true&graph_height=100&graph_width=300&local_graph_id=839
	TARGET /var/www/html/cacti/rra/sonicwall_tz300_276_linden_decryptbytes_861.rrd:decryptbytes:encryptbytes
	NODES 276:0:0 505:0:0
	SET _tidied 1

LINK Resort-276
	INFOURL /cacti/graph.php?rra_id=all&local_graph_id=410
	OVERLIBGRAPH /cacti/graph_image.php?rra_id=0&graph_nolegend=true&graph_height=100&graph_width=300&local_graph_id=410
	TARGET /var/www/html/cacti/rra/sonicwall_tz300_276_linden_traffic_in_434.rrd
	NODES Resort:46:10 276:-30:0
	BANDWIDTH 25M
	SET _tidied 1

LINK 276-812
	INFOURL /cacti/graph.php?rra_id=all&local_graph_id=838
	OVERLIBGRAPH /cacti/graph_image.php?rra_id=0&graph_nolegend=true&graph_height=100&graph_width=300&local_graph_id=838
	TARGET /var/www/html/cacti/rra/sonicwall_tz300_276_linden_decryptbytes_860.rrd:decryptbytes:encryptbytes
	NODES 276:0:0 812:0:0
	SET _tidied 1

LINK Enmar-812
	INFOURL /cacti/graph.php?rra_id=all&local_graph_id=840
	OVERLIBGRAPH /cacti/graph_image.php?rra_id=0&graph_nolegend=true&graph_height=100&graph_width=300&local_graph_id=840
	TARGET /var/www/html/cacti/rra/sonicwall_tz300_7600_enmar_decryptbytes_862.rrd:decryptbytes:encryptbytes
	NODES Enmar:0:-17 812:0:17
	SET _tidied 1



# That's All Folks!

My System is Ubuntu 16.04, PHP 7, Cacti 1.1.6. WeatherMap 0.98a refactor branch.

I wanted to post it here before putting it on GitHub just in case it was just a dumb mistake on my part.

Also another thing to note is the hover over graph’s work flawlessly. :slight_smile:

#2

I am guessing you are using the Boost plugin, or whatever it’s called now it’s integrated, right? (something like “Performance Boost”). With that enabled, data isn’t written to the rrd files immediately. Only every 30-60 minutes, or whenever you request a graph and it needs current data, which gives the behaviour you are seeing.

If that is the answer, then you can add SET rrd_use_poller_output 1 to the top of your map file. That tells weathermap to collect the data directly from the poller, which is more complicated, but works with boost enabled. (it’s also not really tested in the github version, so it’ll be interesting to see if it actually works! :slight_smile: )

#3

I actually figured out that boost was causing this problem among other things so I turned it off. (Before reporting this) Because with boost enabled all of the links would show 0 not just the few that are. I was also getting gaps in my graph’s. I am also running the polller every 30 sec’s so in 10min. that 20 cycles before the issue happens. And I have all my interfaces set on the high data rate profile which is set for 30 secs as well. So when the map is working the data changes ever 30 secs. I can add that line to the config file and see what happens. I’ll let you know. Thanks for looking at it.

Update: I logged into my workstation @ work and added that line. First cycle it ran with 0 warnings and all links were 0. 2nd cycle and everyone after 0 warnings and the numbers are populated correctly. I will let it run like that over night and see how it does and report back.

Update #2: Ran all night checked log and no issues.

#4

The “first cycle, no data” is expected - it takes a cycle to collect all the data source ids, and initial values. It can’t actually provide data until it has two values to compare (e.g. for traffic counters).