Context does matter though. If you're talking about startups in Silicon Valley, it's completely correct to exclude normal small business and focus on technology

Context does matter though. If you're talking about startups in Silicon Valley, it's completely correct to exclude normal small business and focus on technology-based startups aka "tech startups". They really are very different kinds of businesses. The problem may be that that "tech startup" is too verbose and lame sounding.