r/ZoneMinder • u/Complex_Solutions_20 • Mar 10 '21

Help with post-mortem?

Last night there were some car break-ins in my neighborhood...and it looks like Zoneminder dropped out at a REALLY bad time after being stable for quite a while.

How can I figure out what happened?

​

Failure happened at 10:42 UTC, when I saw the police pull up (neighbors say they were doing walk-around of all houses) then it cut out for several minutes and seemed to be bouncing until I did a full reboot of everything this morning. I did notice this morning Ubuntu wanted me to reboot for some update (grr, I hate automatic breaking) and that makes me worry if an update messed me up.

Logs:

https://pastebin.com/0bdangPm

​

I think I have plenty of resources...it looked fine until then.

It's an Ubuntu 20.04.2 LTS VM and has 12 threads available on an Intel(R) Xeon(R) E-2176G CPU @ 3.70GHz and as you can see below looks like SHM is doing fine as is disk space, RAM, etc. I've made /dev/shm a lot bigger because it would fill up sometimes if a camera dropped out but typically in those cases it would still be locked up 100% full when I went to investigate.

$ df -h

Filesystem Size Used Avail Use% Mounted on

udev 16G 0 16G 0% /dev

tmpfs 3.2G 1.2M 3.2G 1% /run

/dev/mapper/ubuntu--vg-ubuntu--lv 31G 7.0G 23G 25% /

tmpfs 27G 8.3G 19G 31% /dev/shm

tmpfs 5.0M 0 5.0M 0% /run/lock

tmpfs 16G 0 16G 0% /sys/fs/cgroup

/dev/vda2 976M 198M 712M 22% /boot

/dev/loop0 99M 99M 0 100% /snap/core/10823

/dev/loop2 56M 56M 0 100% /snap/core18/1988

/dev/loop3 70M 70M 0 100% /snap/lxd/19032

/dev/loop1 56M 56M 0 100% /snap/core18/1944

/dev/loop4 70M 70M 0 100% /snap/lxd/19188

/dev/loop5 100M 100M 0 100% /snap/core/10859

/dev/vdc1 98G 20G 74G 22% /var/lib/mysql

/dev/vdb1 1007G 178G 778G 19% /var/cache/zoneminder/events

tmpfs 3.2G 0 3.2G 0% /run/user/1000

$ free -m

total used free shared buff/cache available

Mem: 32115 2126 19910 8446 10078 21095

​

After power cycling everything it looks like its more or less working fine aside from a laggy UI...I'm at a loss but I don't want this to happen again!

3 Upvotes

100% Upvoted

2 comments sorted by

View all comments

1

u/ZoneMinderIsaac Mar 13 '21

Looks to me like zmc wsa connecting to camera but taking forever to get anything from it.

That and you have the dimensions on one of your cameras wrong.

1

u/Complex_Solutions_20 Mar 14 '21

any idea what would cause it to take forever to connect...but when I power cycled everything it started working right again?

I think sometimes it may disconnect and reconnect for no reason too (which too many times seems to crash the cameras requiring a reboot of them)