12 ms·
I've spent about 1,000 hours on this with my team using a very expensive (~$250k) lab and I'd love for this to be a great resource for people when choosing a ma
by lloydarmbrust 5y ago
I've spent about 1,000 hours on this with my team using a very expensive (~$250k) lab and I'd love for this to be a great resource for people when choosing a mask.
The heavy lift we are doing here is around our particulate filtration efficiency test in which we do either the NIOSH N95 NaCL (0.3 micron) test or the ASTM 0.1 micron latex particle test.
I'd love HN feedback on how we improve the interface and make this a true resource for people.
Disclaimer: Yes, I'm a mask manufacturer and that's how I justify keeping all of this equipment up to spec, but I'm not big enough to make all of the masks for the world so I'd rather people find a good mask than just use my mask.
Any feedback is appreciated.
- roeles 5y agoPerhaps interesting for you: The University of Delft has done research on mask fit. A report in Dutch can be found here[1]. Perhaps auto-captions in English work for you? [1] https://www.youtube.com/watch?v=zJZBNwa6QMk https://www.youtube.com/watch?v=zJZBNwa6QMk
- taf2 5y agoMy question is after weeks with the same mask… how does it perform… also bonus what kind of additional germs to I get to experience close to my face
- Double_a_92 5y agoYou are not supposed to keep the same mask for weeks... They are meant to be replaced after hours.
- throwaway81523 5y agoI looked at the linked page and it had a big list of masks, each of which linked to a page about that mask with a picture but no information such as test results. Was that intended? Could you just ditch all the fancy web design and have a big table with test results for each mask, with an ordering link for the models that you sell? That would be awesome. It would be great if you also sold the stuff you use for testing masks. I spent a while looking into testing masks myself, but then the shortage eased up so it seemed less important.
- lloydarmbrust 5y agoTesting masks is very specialized and all in I've spent about $250k on the mask lab. I just bought a new machine that costs about $90k. Here's an overview of the machine: https://www.youtube.com/watch?v=vpjajJrDWBk https://www.youtube.com/watch?v=vpjajJrDWBk
- throwaway81523 5y agoThanks, I'll watch the video when I get a chance. My idea was to basically reproduce the setup in Joel Amilcar's PhD thesis (https://ir.uiowa.edu/etd/2002/ https://ir.uiowa.edu/etd/2002/) using an off the shelf air quality sensor (PM2.5 with the hope of being able to extrapolate below that size), using a salt spray nebulized with vape gear. I didn't have any good ideas about how to control the particle size (this isn't my area at all) so had hoped to get some advice at some point (let me know if you have any thoughts). I had remembered reading about a guy on Youtube who did some tests like that but never managed to find the channel. Maybe it was yours! Someone else here mentioned Aaron Collins so I will have to check his videos too. I think it would be great to have easily reproduceable, low cost test equipment available at shops and clinics because the quality of masks (even of a specific make and model) is likely to vary between units. You might find a good mask with your tests, and then find that your next order of the exact same mask is crap. So you have to keep testing. Maybe it is less bad now. I was interested in this more when masks were in very short supply, but then I managed to get a few boxes of them, and set the testing idea aside.
- nyanpasu64 5y ago> I looked at the linked page and it had a big list of masks All test results disappear when the browser window isn't wide enough (eg. on mobile, or narrow PC windows).
- yborg 5y agoList doesn't seem to scroll in Safari desktop :/
- deleted 5y ago[deleted]
- nopenopenopeno 5y agoTable only shows mask names on mobile. Don’t be surprised if your announcement doesn’t have the impact you wanted it to. You need a website that does its job on mobile.
- lloydarmbrust 5y agoAhhh... good point. The search will work but you are correct that the full version is better on desktop.
- bfung 5y agoThe GP has a good point - I was about to write a long HN reply about being able to sort or show the “best” masks. Saw the “list doesn’t show scores” on mobile led me to this comment. As a consumer, when I land on that site, “what’s the best mask I should buy” (protection level, budget, comfort, local/globally made). If it’s not clear on mobile, it’ll be pretty hard to get non-tech people to stay on page for more then 10s or funnel them to the page you want.
- dzdt 5y agoEven with "desktop mode" enabled on mobile (android chrome) I still see only one column. You can click in for more information but it is pretty useless as an interface.
- lloydarmbrust 5y agoOkay we updated the site to work on mobile. Thanks for this... seems obvious now but total miss on our part. Thank you!!
- nobodytoseehere 5y agoGreat work, thank you for sharing it with the world. I am very curious about country stats and have 2 questions. First, I found this one randomly: https://www.armbrustusa.com/blogs/mask-review/kf94-try-mask-kn-flax-boat-adult-regular-black-658 https://www.armbrustusa.com/blogs/mask-review/kf94-try-mask-... The country of origin on your page says China, but the photo's box says Korea. Is this a mask repackaged and exported from Korea that is actually from China? Second, does "China" also include Taiwan? If so, I would be interested in separating them for statistics. for those interested, here's a first level breakdown of pass/fail by country | country | # pass | # fail | pass rate | |-----------+--------+--------+-----------| | USA | 39 | 27 | 59 | | China | 48 | 186 | 21 | | Korea | 31 | 13 | 70 | | Thailand | 0 | 2 | 0 | | India | 2 | 12 | 14 | | Mexico | 1 | 0 | 100 | | Germany | 0 | 1 | 0 | | Singapore | 1 | 0 | 100 | | Vietnam | 1 | 0 | 100 | also, in this dataset it looks like adult masks have a 66% pass rate as a whole, while kids masks have a 73% FAILURE rate! So a third question is, are you using adult mask testing methods for testing kid masks as well (which would explain the failure; on the other hand, the kid masks that passed must be quite some mask!), or do kid masks just suck in general?
- lloydarmbrust 5y agoAh! You caught a mistake. Thank you it's fixed. China and Taiwan are separate (they make very different masks) but I haven't been able to find any from Taiwan to test.
- nobodytoseehere 5y agothanks for the clarification! (apologies, I edited my original message with a third question, which I would love to get an answer to, but now I don't want to mess with this thread anymore)
- lloydarmbrust 5y agoIn the US the standards for adults are the same as kids... in China they just came out with a new standard but for reasons I wont go into we don't cover it (very China specific). That said, I have also noticed this... if a manufacturer in China makes a great adult masks, their kids mask is likely to fail standards for filtration AND be harder to breath. Having made both adult and kids masks I can tell you that there is way less of a demand for kids masks and because of that less attention gets paid to them on the manufacturing floor. Theory: People are just lazy and make worse masks for the kids I think because kids are not paying attention. Furthermore, kids don't care that it passes standards, they care if there's a dinosaur on the mask or not. Even my own kids tell me my kids masks are boring! So manufacturers put their time on making it fun and not on protection. We test both kids and adults to the same standards, use the same fabric, etc. Boring but effective :)
- wrycoder 5y agoYour filtration test appears to be only testing the mask fabric, but not the fit. I see a number of surgical masks over 95%. I don't think that would be possible in practice, because of leaks at the sides and top. I'd expect more like 50%. But, you don't appear to have the equipment to do a fit test. Refer to the 3M video on how to fit test an N95. I realize that N95 and surgical masks have different standards, but you are making them look comparable, when they are not.
- lloydarmbrust 5y agoA good mask needs both fit and filtration... most people can put a mask on, check for air gaps and see how well it fits, but they don't have a $250k mask lab to make sure the fabric is good. We are just solving for the filtration and letting people figure out the fit. But, you make a good point, in the videos I try to point this out but we could do better. Where could I add this to make this more clear?
- deleted 5y ago[deleted]
- BugsJustFindMe 5y agoYou could start by adjusting your given filtration ratios by predictable leakage based on the type of mask. It's wholly misleading to rate the filtration potential of an earloop mask as equivalent to that of a 3M Aura.
- lloydarmbrust 5y agoNot exactly.. it really depends on the situation. For example an ASTM 2 or 3 surgical mask fabric has a filtration of 98%+ On my face I have a leakage of about 21% or PFE of 79% when worn normally. With an ear saver, it jumps to 91%. With a mask brace, it jumps to 98%. So it really is about the fit. If I put leakage % it would vary from person to person and many people would be mislead by this.
- 5y ago
- causi 5y agoThe biggest issue with surgical masks is most of the nose strips are pathetically thin so they bend out of place and stop you from getting a good seal, which means they're a nightmare for glasses wearers.
- jader201 5y ago> which means they're a nightmare for glasses wearers More importantly, it greatly reduces their effectiveness. Fogging up glasses is, by far, the lesser issue of the two.
- causi 5y agoDepends on whether you're the type of person for whom fogged glasses means a mistyped line of code or the type of person for whom fogged glasses means blowing up a lab or getting your arm ripped off in a machine.
- lloydarmbrust 5y agoYes. Look for masks with a double nose wire. We make one and many find it does not fog their glasses... but there are plenty of others that make them too.
- newman314 5y agoSorting by breathability is broken. It'd be nice if you had pop-up dialogs upon hover over each of the fields. For example, if I hover over breathability, explain what it is and how you measure it. Some color codes/gradient would be nice to help with the visual effect (Green for Pass, Red for Fail etc.) But please do include a toggle for color-blind mode if you do add color.
- lloydarmbrust 5y agoIt's working for me, can you describe what's happening? Good call on the color coding... I'm color blind so didn't think of this :)
- newman314 5y agoInteresting, it seems somewhat fixed now. Initially, I was seeing the sort return 1, 10, 100, 2, 20, 200.. so sorting by the first numeral instead of the number. But now it seems to be sorting ok-ish except if you jump to the bottom and the row for "Staples / Beixikang Face Mask" shows a % symbol for some reason. So possibly some data entry issues. Below the Beixikang, there are then about 12 entries in 80-168 range so the entry for the Beixikang may be throwing the sort off.
- twelvechairs 5y agoWhen I sort by breathability (Firefox desktop) it goes 9 up to 572 for most of the list then '79.46%' then 80.2-183. The other way it goes 162 down to 9 then '79.46%' then 572 down to 80.2.
- pimlottc 5y ago> Sorting by breathability is broken. I'm seeing this too; I think the single entry [0] that includes a percent sign in its breathability score is screwing up the sort. 0: https://www.armbrustusa.com/blogs/mask-review/surgical-beixikang-3ply-adult-regular-blue-217 https://www.armbrustusa.com/blogs/mask-review/surgical-beixi... > Some color codes/gradient would be nice to help with the visual effect (Green for Pass, Red for Fail etc.) But please do include a toggle for color-blind mode if you do add color. If the green and red shades are chosen to have enough contrast to look different when convert into black and white (e.g. when printed), it should be usable even for most colorblind people, while also being easier to read for everyone.
- nier 5y agoGreetings from Germany. Of course my local interest lead me to the one and only product tested that originated here. https://www.armbrustusa.com/blogs/mask-review/surgical-medtecs-3ply-adult-regular-black-630 https://www.armbrustusa.com/blogs/mask-review/surgical-medte... The accompanying video is informative and I can add that the way the earloops are attached is wide-spread in Germany. Also confirmation from my side that the strings rip right off with this type of attachment regardless of the actual manufacturer. On an iPhone, the value for color in the details is slightly too far to the left and in this case wrong because it reads Black. I’d like to be able to tap on the color and see a list of matching masks and also have a top level filter for color. As a parent I’d love to have a top level filter to see masks for kids. Finally, German quality engineering exists but it’s really not found that often in the wild as the myth would lead someone to believe. So thanks for helping to debunk that in the video.
- carlmr 5y ago>Finally, German quality engineering exists but it’s really not found that often in the wild as the myth would lead someone to believe. So thanks for helping to debunk that in the video. I don't think you should base anything on N=1, either for or against.
- lloydarmbrust 5y agoIf it helps 100% of my grandparents are from Germany :) might be obvious by my last name.
- nier 5y agoCrossbow. Yeah, you mentioned in the video. :)
- tallanvor 5y agoI read through your "methodology", and it seems to be too simple to explain your pass/fail results. For example, you fail this mask: https://www.armbrustusa.com/blogs/mask-review/kn95-arun-flat-fold-adult-regular-white-518 https://www.armbrustusa.com/blogs/mask-review/kn95-arun-flat... even though it seems to meet the filtration and breathability standards, but is still listed as having failed. I guess maybe you explain the failure in the video, and maybe there's a good reason that it failed, but you're asking me to waste a bunch of time watching videos to understand information that could have been provided in print. It doesn't make me trust you.
- waynesonfire 5y agoRead their methodology, > A good example of this is in the text written on the front of N95 and KN95 masks. The standards for each of these masks demand that very specific information be printed on the device. If a KN95 mask does not have the manufacturer name and the standard number they are meeting (GB 2828-2019 or GB2828-2006), then they cannot be considered KN95 masks Such masks are marked failed. My guess is thats what happened here.
- vertis 5y agoI disagree with this methodology. At the very least it should be called out as the reason for the 'fail'. Yes, it's less than ideal to not follow the standard. But I would far rather an N95/KN95 mask that didn't have it correctly printed but otherwise passes the criteria than none at all. If it's a filtration test and it filters correctly give it a pass with an asterisk.
- lloydarmbrust 5y agoYes the reasons for failing are in our testing notes being transcribed now. Over 250 hours of actual testing just to get to this part and with Omicron we wanted to get the raw data up ASAP. Notes should be live in about 275 of them hopefully today.
- 5y ago
- potatochup 5y agoon the 3M aura, "made in american". otherwise great site
- TylerE 5y agoIt actually depends on the model. 9205 is US made, the 9210 is made in Singapore.
- throwaway4good 5y agoDid you fail all the Chinese masks?
- mmahemoff 5y agoIf you're open to taking "requests", I'd love to see this Australian one tested. https://amazon.com.au/gp/product/B093B8QKVP/ https://amazon.com.au/gp/product/B093B8QKVP/ Good N95 style masks are difficult to get hold of in Australia. A few places are either charging absurd prices (like $10+ per disposable mask), but most pharmacies just don't stock them. The one above has some fancy photos of certs in its listing, so it would be interesting to see if it's genuinely good. Happy to send some to you if it's helpful (you can dm me on twitter listed in my profile).
- ricardobeat 5y agoI see a ton of KF94 results, may be easier to find them due to proximity to Asia? They are supposed to be more comfortable than the beak-shaped kn95 anyway, and offer the same protection.
- mmahemoff 5y agoMight be, but it's hard to trust any of those listings - where they come from and if the KF94 really means anything at all (some reviews indicate as much too, but realistically most consumer have no way of knowing). The one I mentioned stood out as it's locally made and supposedly locally certified.
- deleted 5y ago[deleted]
- OJFord 5y agoHi, was interested to see this, but the video is just of you buying them? And the methodology link is to https://www.armbrustusa.com/pages/ https://www.armbrustusa.com/pages/ which doesn't seem right, and 404s anyway. From the comments here it seems others have got to the right content, so I'm not saying 'avoid this spam nothing here' or whatever, just not sure what's going on. Accessing from Europe (UK) if that's something to do with it.
- nobrains 5y agoI sorted the list by breathability, filtered out the failed ones, and only focused on the n95/kn95/94 masks (as breathability rating for surgical masks does not make sense, because it is not supposed to be tight), and the top 5 were: https://www.armbrustusa.com/blogs/mask-review/n95-gerson-duckbill-adult-regular-white-665 https://www.armbrustusa.com/blogs/mask-review/n95-gerson-duc... https://www.armbrustusa.com/blogs/mask-review/n95-gerson-duckbill-adult-regular-white-664 https://www.armbrustusa.com/blogs/mask-review/n95-gerson-duc... https://www.armbrustusa.com/blogs/mask-review/kf94-dr-puri-boat-adult-regular-black-175 https://www.armbrustusa.com/blogs/mask-review/kf94-dr-puri-b... https://www.armbrustusa.com/blogs/mask-review/n95-honeywell-safety-flat-fold-adult-regular-white-570 https://www.armbrustusa.com/blogs/mask-review/n95-honeywell-... https://www.armbrustusa.com/blogs/mask-review/n95-indiana-face-mask-flat-fold-adult-regular-white-503 https://www.armbrustusa.com/blogs/mask-review/n95-indiana-fa...
- pmuk 5y agoI was thinking the same. Do you have a video of you testing some of them as well? It would be interesting to see how it works!
- nkurz 5y agoClick on any individual mask, and it takes you to a separate page. On most of those pages, there will be a 5-7 minute video showing that particular mask being tested while Lloyd talks about the features of the mask.
- formerly_proven 5y agoBeing able to filter the list by pass/fail or minimum PFE and/or maximum breathing resistance would be nice.
- lloydarmbrust 5y agoAdding this to the feature list
- watersb 5y agoMy budget is limited, but I just purchased a $50 shipment of your masks because this is awesome. Thank you.
- lloydarmbrust 5y agoThanks! Honestly didn't do this to directly sell masks... according to shopify we have made a whopping $248 from this post
- okl 5y agoThanks for putting in the effort and publishing the data. Are there indications that point to good/bad filtration quality? What do the good/bad products have in common?
- _n_b_ 5y agoI think this is great and thanks for doing this! I have three small suggestion: 1. For masks that fail on marking issues but not filtering efficiency, could they get a third category that’s not pass or fail (something like ‘non-compliant’)? 2. I wish you could filter on pass/fail 3. I wish you included/could filter on price per box and price per mask.
- weinzierl 5y agoAlso big thanks for doing this from me and a third suggestion: I wish I could filter for "valve" because valved masks are not allowed where I live.
- jve 5y agohttps://www.armbrustusa.com/blogs/mask-review/surgical-beixikang-3ply-adult-regular-blue-217 https://www.armbrustusa.com/blogs/mask-review/surgical-beixi... has breathability expressed in percentage. Others not. Buy this mask button should be green :)
- yrral 5y agoHi, thanks for doing this. 1 piece of feedback is to have a couple lists of masks that you recommended so we don't have to comb through all the listings. I would put this page as the front page and then link/refer to the list to provide authority/weight to your recommendations. Eg by type (surgical,duckbill,n95,kn95), by budget (budget, price/performance, premium), ships now on amazon, doesn't ship now but better in some way if you're willing to wait, etc. Also I was looking at the 3m 9210 that you have 2 entries for in your table. The breathability is quite different between the two samples (98 vs 242). Is this expected? That seems a lot of variability for the same mask.
- bradknowles 5y agoI’m not seeing AirPop masks on this list, see https://www.airpophealth.com/us/home https://www.airpophealth.com/us/home
- bradknowles 5y agoI’m also not seeing U.S. Mask on that list. The thing I like about their KN95 style mask is that each one is individually packaged, unlike almost all the other masks I’ve seen.
- SixDouble5321 5y agoIs this a mask testing company or a mask selling company? How could I possibly trust one company to do both?
- bradknowles 5y agoThe viewer should be able to select only those masks that pass. They should also be able to select a maximum breathability score. They should also be able to select minimum PFE rating.
- astura 5y agoUm, Your site appears to be completely broken - once I scroll down once scrolling (up or down) no longer works at all.