15 ms·
Frigate: Open-source network video recorder with real-time AI object detection
- thedougd 3y agoI’m having really great results with Frigate. Took me a while to figure out that low resolution sub streams should be used for object detection and the high resolution for recording. Also learned that go2rtc allows me to have one connection to a camera but then restream it to homebridge, frigate, etc. I use to fumble with ffmpeg to do it but go2rtc is easier. I have a small form factor Dell desktop refurb with an m.2 coral tpu in the wifi slot. I use the coral for object detection and the Intel GPU for decode acceleration. I’m curious as to why I haven’t seen NVR software that uses cameras built in object and motion detection and listens for those alarms or events?
- jcelerier 3y agoit's amazing to me that there are countries when people can legally film random people walking in the street in front of their house and store that data without any possible legal repercussions.
- qmarchi 3y agoWhat's people's opinions on Frigate+? For anyone that uses it, can you prove since details on value?
- deleted 3y ago[deleted]
- deleted 3y ago[deleted]
- deleted 3y ago[deleted]
- bitwidget 3y agoBesides upload and annotate [1], you can technically create your own models and use that within the Frigate configs already for free (https://docs.frigate.video/configuration/objects/#custom-models https://docs.frigate.video/configuration/objects/#custom-mod...). [1]You could always mount a cloud drive within Frigate's Docker config to have frigate upload camera footage to a cloud server.
- nickm_27 3y agoA number of users have posted their experiences so far on the GitHub discussion - https://github.com/blakeblackshear/frigate/discussions/7932#discussioncomment-7189445 https://github.com/blakeblackshear/frigate/discussions/7932#... - https://github.com/blakeblackshear/frigate/discussions/7932#discussioncomment-7166293 https://github.com/blakeblackshear/frigate/discussions/7932#... - https://github.com/blakeblackshear/frigate/discussions/7932#discussioncomment-7279505 https://github.com/blakeblackshear/frigate/discussions/7932#... - https://github.com/blakeblackshear/frigate/discussions/7932#discussioncomment-7322146 https://github.com/blakeblackshear/frigate/discussions/7932#... I have found my frigate+ model to be much more accurate and crazy good even at night. Will be curious how things change when it snows here more often, since I've not submitted any examples of winter at this house yet.
- quakemaster33 3y agoGreat write up on the version 13 experience so far with custom models: https://rogerstechtalk.com/my-frigate-v13-beta-experience/ https://rogerstechtalk.com/my-frigate-v13-beta-experience/ Also an interview with the Frigate author Blake covering the custom models and the project overall: https://youtu.be/04GZBbn_nRE https://youtu.be/04GZBbn_nRE
- kyle4269 3y agoI can tell you from my experience. Since I started using frigate+, I’ve had very minimal false positives. I go days without one! Even my lpr camera picks up vehicles at night. It only sees tail/head lights and the license plate, everything else is pitch black. I still get bounding boxes. Would definitely recommend it, plus it’s only going to get better
- cchance 3y agosilly question but doesn't yolov8 (seganything) handle that kind of detection extremely well these days?
- jcrawfordor 3y agoFrigate seems like one of the most promising new NVR/VMS products out there, but still lacks the feature-completeness to replace Blue Iris. The biggest gap right now in my mind is Frigate's poor feature set for continuous recording, which seems like very basic functionality but ends up as a low priority for a lot of these "event-first" products that are more patterned off of consumer products.
- pkulak 3y agoWait, what now? I have mine set to retain 3 full days of continuous.
- jcrawfordor 3y agoPerhaps this has improved, but when I tried it out a few months ago I found that the playback for continuous recording was extremely basic and didn't have features like easy-to-use variable speed scrub to make it practical to search for things. I might try it out again today because I would like to go to something that doesn't have to run on Windows, but my use case is more around continuous recording with around a month of history than event detection. Space management for rolling retention is also a new feature in Frigate and very basic, I don't think it has a way to do different retention policies by camera group and alarm.
- Thews 3y agoI believe you can trigger recording with mqtt, so you could make an automation for it. You could try to bump this https://github.com/blakeblackshear/frigate/issues/2590#issuecomment-1067142001 https://github.com/blakeblackshear/frigate/issues/2590#issue.... You could even try to use ai to write the feature. There's only been one incident where I would have liked continuous, I've tweaked events to be more than enough.
- pkulak 3y agoAh yes, you are right. I’ll never actually look at the continuous unless I’m robbed, so it doesn’t bother me. Person and animal detection is really good, so you’d have to be very motivated to want to slop around in the space between.
- rahimnathwani 3y agoIt seems like for a basic setup I need: - an intel-based PC (can be a minipc, doesn't need a powerful CPU) - a USB Coral TPU ($60) - some wired PoE cameras (from $60 each) My question: what do people typically use to power the cameras? A single PoE switch, or multiple PoE injectors? My Arlo Pro 2 cameras are apparently EOL and might stop receiving free cloud services in a couple of months. So this seems like a good time to upgrade to higher resolution cameras. (The Frigate docs advise against using Wi-Fi cameras, which would otherwise be my preference.)
- syntaxing 3y agoDoesn’t have to be PoE cameras. I use wifi cameras too, pretty much any camera with rtsp/onvif would work. Chances are, a single switch is more cost effective than multiple injectors. But you also need Ethernet routed throughout your house. One alternative is to have the G.hn (powerline) adapter with PoE. This way, you can be both network and power with one plug without wiring your house.
- rahimnathwani 3y agoIf you're happy with your wifi cameras' performance with Frigate, I'd love a recommendation.
- syntaxing 3y agoI have a mix of reolink and amcrest ones, I can grab the models later tonight when I’m at my computer
- VTimofeenko 3y agoPlease do, also looking for recommendations :)
- eddyg 3y agoWi-Fi cameras are not a great idea. Sure, they are convenient, but Wi-Fi is a shared access medium (every device on, say, channel 11, has to “cooperate” with all the other devices about when it can transmit, including devices on neighboring SSIDs) and something that is constantly streaming video (or worse, multiple devices!) is going to quickly consume available bandwidth and offer a poor Wi-Fi experience. (But most people only care about convenience.) Plus, Wi-Fi is easily jammed, which is not great from a security perspective.
- orangepurple 3y agoConsider checking if you can compute everything on a single Orange Pi 5 first. It seems that preliminary support has been merged! https://github.com/blakeblackshear/frigate/pull/8382 https://github.com/blakeblackshear/frigate/pull/8382
- nagisa 3y agoI am testing Frigate for a couple months now. It is a very ambitious project and I would love to see it succeed. Here are the observations: * You don’t actually need hardware decoding or a Coral, but they do help. You will of course need to provision more CPU horse-power for NVR. * Motion detection uses the usual implementation from OpenCV. Unfortunately this algorithm is not very good in my experience. Many things I would consider as motion are missed (false negative), many things I would not consider motion are being detected (false positive). These factors mean that one is tempted to go ham on masking to filter out false positives, which then leads to further false negatives. I’m genuinely surprised the motion algorithm that’s implemented in OpenCV is still the state of art of what’s available openly. * Object detection is somewhat knee-capped by the models available publicly. They are not very good either. Frigate has built its behaviour around these models with an assumption that these models are largely pretty accurate, which in my experience has ended up with quite a few missed recordings for important events, which led me to switch to create recordings based on motion (I’m not in a very densely populated area and reviewing the recordings isn’t too onerous.) * Support for coral is… shaky at best. There are some indications that the production of these devices has largely stopped (and finding them to purchase is hard and expensive,) and maintenance of the drivers and libraries to interface with coral seems to be minimal or non-existent to the point where some Linux distributions have started dropping the relevant packages from their repositories. On the upside, running these models on the CPU isn’t that expensive, especially considering that the models are invoked very sparingly. I’m currently thinking of moving over to continuous recording, perhaps trying out moonfire-nvr or mayhaps handwriting a gstreamer pipeline. Simple software -> fewer failure modes. (NB: I worked at a computer vision startup in the past, my views are naturally influenced by that experience.)
- englishspot 3y ago> Support for coral is… shaky at best. There are some indications that the production of these devices has largely stopped (and finding them to purchase is hard and expensive,) and maintenance of the drivers and libraries to interface with coral seems to be minimal or non-existent to the point where some Linux distributions have started dropping the relevant packages from their repositories. I've recently gone through the process of trying to install pycoral on Rocky Linux 9. I had to build from source, and there was some challenge because documentation for the build process was sparse. There was some conflicting information about files I had to edit, values I had to set, what was supported and what wasn't.
- pinetroey 3y agoI've been following the project from a distance. I'm waiting for proper nix support to test it.
- preek 3y agoI’ve been using Frigate for six months on a raspberry pi 4 with a Google Coral TPU. It’s connected to 2 network cameras streaming in 2mp each. Frigate standalone works super smooth with no hiccups at all. I am using object detection for people and have not yet had a false positive or false negative. Additionally, I record not only the events, but but also a 24/7 video. Frigate takes care of garbage collecting old assets. I have it hooked up to my Home Assistant running on the same raspberry pi. From there, I get notifications to my phone which include a live video, snapshot and video recording. The UX and configuration options are way better than any commercial end user product I have found. It’s been a literal lifesaver, also fun and easy to use. Would recommend 10 of 10. I have no affiliation with the maintainers.
- prmoustache 3y ago> It’s been a literal lifesaver,. Whose lives have been saved? > also fun Do people actually work in security companies for the LOLz? Nobody told me.
- giobox 3y agoI've also used the same solution, although I ended up scaling from a Pi to a larger 13th gen Intel box with two USB Corals due to number of cameras. It's been ridiculously reliable running from a docker compose stack for years now, including using Watchtower to auto-upgrade the Frigate container. It's really easy to map the corals via docker compose as well. It's nuts how cheaply you can make such a good system with AI-detection features, its more than paid for itself vs commercial options with monthly fees. High quality weatherproof PoE cameras are crazy affordable now too, and you can VLAN them off your home network with no connection to the internet to further harden the system.
- nyargh 3y agoReally the best NVR / motion detection out there. Incredibly good camera support through go2rtc and ffmpeg. Supports accelerated video codecs via ffmpeg. You can use your own Yolo weights and models for object detection. There are some that are trained for high angle person detection that are great for surveillance cameras, for example. Frigate also has pretty solid OpenVINO support now which means accelerated inference on modern-ish intel cpu/gpus, which is a game changer when you have several cameras. Great docs, too.
- tamu_nerd 3y agogo2rtc is a really great addition. Local 2way audio through a doorbell is awesome.
- yobid20 3y agoHow does this compare to Blueiris?
- shaklee3 3y agoBI is windows only. Frigate is mostly used on Linux.
- wiktor-k 3y agoI wonder if Frigate runs on Arm SBCs such as https://www.hardkernel.com/shop/odroid-m1s-with-8gbyte-ram/ https://www.hardkernel.com/shop/odroid-m1s-with-8gbyte-ram/ ?
- nickm_27 3y agoSupport for some RockChip SBCs was recently merged in for 0.13 as a community supported board https://deploy-preview-6262--frigate-docs.netlify.app/configuration/object_detectors#rockchip-rknn-toolkit-lite2 https://deploy-preview-6262--frigate-docs.netlify.app/config...
- wiktor-k 3y agoWow, that's great! Thanks for the link.
- xrd 3y agoOK. I have a bunch of ring cameras and cannot get them connected to Amazon anymore. The person that sold the house didn't leave the packaging, and the Amazon app does not allow connection to the temp wifi; you must scan the QR code or enter the serial number? I've never been able to get them reconnected since the Hurricane last year. Can I somehow use these with Frigate? Is there a way to root these Ring cameras and use them? I never liked the idea of paying a service fee, nor having Amazon pull the videos into their free neighborhood watch program. Any suggestions on using them now?
- tw04 3y agoYou can’t, Amazon doesn’t support any open protocols with their ring cameras. You can get the serial number off the camera itself, usually on the back so it needs to be removed first. Also most of those ring cameras are 2.4ghz only so you need a dedicated 2.4ghz wifi network. It won’t connect at all if you have an SSID that is broadcasting both 5ghz and 2.4ghz on the same name.
- deleted 3y ago[deleted]
- albumen 3y agoI had that problem with some Tapo smart plugs, and an ecoflow delta max battery. To connect those, I disabled SSID broadcast on 5ghz temporarily; connected the plugs to the 2.4ghz network; then re-enabled the 5ghz. Works fine now with both networks up in the same SSID.
- gosub100 3y agoTry registering it with your address. I can't remember if it asks you "did you just buy the house?" or not, but I had this problem and it sends an email to the prior registrant, and if they voluntarily release it, or do nothing for 30 days (IIRC), it turns the camera back over to you. I got this far with it, but I was too lazy to install the app and actually set it up.
- notfed 3y agoCan it detect a dog peeing indoor? I always wanted to set off an alarm if my dog tries to pee inside.
- wizerdrobe 3y agoOff-the-shelf, not that specific scenario… If your dog has a consistent space it pees, maybe. You would setup a camera in the room and define an area (basically draw a box around the rug) and further refine with parameters like “Between 9.00 to 17.00 on Monday to Friday, Alert” Insofar as I’m aware there isn’t any specific dog detection models shipped with the tool. You might be able to find image detection models to add-on easily, but YMMV.
- deleted 3y ago[deleted]
- rome390 3y ago[flagged]
- Plasmoid 3y agoOne thing I'd like to see is offloading object detection to the camera. Many cameras now include event detection and I'd like to use the on-board dedicated hardware in each camera rather than trying to do it on a local GPU for each of my data streams.
- dugite-code 3y agoThere is now the event trigger in the API where you can tell frigate something has happend like a doorbell press. I'm still not clear if this just acts like a regular motion event where it'll do person detection ect after. if so I was thinking of setting up a mm-microwave sensor at my front door because the shadows constantly trigger motion events.
- vongomben 3y agoWow. I have always been tempted two give it a go with an Odissey. Question: how tough is it to integrate a roboflow dataset in the custom model section? https://docs.frigate.video/configuration/objects https://docs.frigate.video/configuration/objects
- vimeh 3y agoRuns really well within a Docker container on my M1 Mac Mini with 3 2K (2560x1440p) Reolink cameras. Paired with running Scrypted for HomeKit Secure Video (have also found using the RTSP streams rebroadcast from it to be more stable than having multiple sinks connected straight to the camera), and this makes a really good persistent NVR solution that I can also use to monitor remotely without necessarily VPN’ing back into my home network or exposing Frigate thru a separate reverse proxy.
- shaklee3 3y agoI've been using Frigate for about 6 months. It's significantly better than Blue Iris and zoneminder.
- hcfman 3y agoI use StalkedByTheState (https://github.com/hcfman/sbts-install https://github.com/hcfman/sbts-install) with 15 cameras all being evaluated with an NVIDIA GPU with large model yolov6 and matches double checked with large yolov7. Practically never get a false positive in a complex environment and never get a miss. The port to the Orin series still needs to be completed though.
- jojobas 3y agoIt sounds awesome for remote dwelling security. Don't bother with rabbits and foxes, turn on the lights and play "you are trespassing turn back now" for unexpected guests. Perhaps can even tell if they have guns or crowbars.
- prmoustache 3y agoHow welcoming you are.
- godsfshrmn 3y agoDoes it have a decent mobile app for alerts?
- magnetic 3y agoI don't think so. That is the main reason I'm keeping Blue Iris going. My wife can use the BI app (even though it uses an outdated UI design). I haven't found any Frigate-based UX that would meet that bar (and that bar is not even particularly high with the BI app). Would love to know if I'm missing a Frigate UX option that is "family friendly".
- cchance 3y agoI mean alerts can go out to home assistant or any mqtt it looks like, so for assists that seems like the easiest option MQTT or the HA app
- cchance 3y agohows this compare to something like blueiris, i'm running blue iris with 5x 4K cameras on a small intel NUC, the AI detection works pretty good but always would prefer something lighter and opensource
- grigio 3y agoThe best! Open source and with Coral AI support