Start you literature survey on Machine Learning algorithms. Many algorithms are there in the literature some are good for some applications some are for other applications.
Every algorithm is something novel only thing how we can use that for the application.
Your self also think and hybridize some existing algorithms and apply for your classification problems.
In which field are you looking for? Like imaging, data mining etc.. if its for data mining weka is a good data mining software which has many machine learning algorithms.
Start you literature survey on Machine Learning algorithms. Many algorithms are there in the literature some are good for some applications some are for other applications.
Every algorithm is something novel only thing how we can use that for the application.
Your self also think and hybridize some existing algorithms and apply for your classification problems.