For what it's worth, this is exactly how Reddit was in the early days. I remember a niche sub being something that had maybe 30-50 members, now basically every subject has a subreddit with communities in the 5000+ range.
Just give it time. If there is a particular community you're missing, use this as an opportunity to start it over here and start getting people involved.
Nepenthe
dosidosankofa