Our team goes out probably once a week (informally) on Fridays and I feel like I hold them back if I go. I'm not a vegetarian but I am allergic to dairy and egg

Our team goes out probably once a week (informally) on Fridays and I feel like I hold them back if I go. I'm not a vegetarian but I am allergic to dairy and eggs which makes it hard to spontaneously pick a place to eat.