There are people who are using Hierarchical SVM for multi-class classification. But I think it simplifies the original problem and doesn't serve the actual purpose. OnevsAll though similar to this approach but still uses all classes at each classification. Any idea?