I am not a specialist, but I immediately thought about the Brachiopoda ("lamp shells"), since they were very abundant filter-feeding, reef-building organisms during the Paleozoic era, and now most of the species are extinct and their niches, occupied by unrelated phyla. I've found very few in my field sampling expeditions, but their abundance, diversity and even size in the fossil record always amazed me.