There are lots of Optimization method /Evolutionary algorithms (EAs) in literature. Some of them is more effective (for solving linear/nonlinear problem) compared to other. But we don’t know which will fit our model. As a result we checked for everything as we can do. But cant get the desire result. Some of those methods are 1. Genetic algorithms (GA) ; Haupt and Haupt (2004) 2. Pattern search (Mathlab) 3. Particle swarm optimization (PSO), Binary Particle Swarm Optimization (BPSO); Eberhart and Kennedy (1995) 4. Bee optimization; Karaboga and Bosturk (2007) Pham et al (2006) 5. Cuckoo algorithm; Yang and Deb (2009, 2010) 6. Differential evolution (DE) ; Storn and Price (1995, 1997) 7. Firefly optimization; Yang (2010) 8. Bacterial foraging optimization; Kim, Abraham and Cho (2007) 9. Ant colony optimization (ACO) ; I Dorigo and Stutzle (2004) 10. Fish optimization; Huang and Zhou (2008) 11.Raindrop optimization ; Shah-Hosseini (2009) 12.Simulated annealing ; Kirkpatrick, Gelatt and Vecchi (1983) 13.Biogeography-based optimization (BBO), 14. Chemical reaction optimization (CRO) 15. A group search optimizer (GSO), 16. Imperialist algorithm 17. Swine flow Optimization Algorithm. 18. Teaching Learning Based Optimization (TLBO) 19. Bayesian Optimization Algorithms (BOA) 20. Population-based incremental learning (PBIL) 21. Evolution strategy with covariance matrix adaptation (CMA-ES) 22. Charged system search Optimization Algorithm 23. Continuous scatter search (CSS) Optimization Algorithm 24. Tabu search Continuous Optimization 25. Evolutionary programming 26. League championship algorithm 27. Harmony search Optimization algorithm 28. Gravitational search algorithm Optimization 29. Evolution strategies Optimization 30. Firework algorithm, Ying Tan, 2010 31. Big-bang big-crunch Optimization algorithm, OK Erol, 2006 32. Artificial bee colony optimization (ABC), Karaboga,2005 33. Backtracking Search Optimization algorithm (BSA) 34. Differential Search Algorithm (DSA) (A modernized particle swarm optimization algorithm) 35. Hybrid Particle Swarm Optimization and Gravitational Search Algorithm (PSOGSA) 36. Multi-objective bat algorithm(MOBA) Binary Bat Algorithm (BBA) 37. Flower Pollination Algorithm 38. The Wind Driven Optimization (WDO) algorithm 39. Grey Wolf Optimizer (GWO) 40. Generative Algorithms 41. Hybrid Differential Evolution Algorithm With Adaptive Crossover Mechanism 42.Lloyd's Algorithm 43.One Rank Cuckoo Search (ORCS) algorithm: An improved cuckoo search optimization algorithm 44. Huffman Algorithm 45. Active-Set Algorithm (ASA) 46. Random Search Algorithm 47. Alternating Conditional Expectation algorithm (ACE) 48. Normalized Normal Constraint (NNC) algorithm 49. Artificial immune system optimization; Cutello and Nicosia (2002) 50. fmincon .
Besides this there are many other optimization algorithm recently invented which are generally called Hybrid optimization Technique because it’s a combination of two method. If we share our experiences then it will be helpful for all of us who are in the field of optimization. I may be missing some methods, researcher are requested to add those algorithms and the way of use like many model needs initial value, weight, velocity, different type of writing objective function etc. I am facing some problems that’s why I make this format which will definitely help me as well as all other researchers in this field. Expecting resourceful and cordial cooperation.