What do you mean by "online adapt"? Do you want to adapt the parameters dynamically? However, a possible starting point for your research can be the following source: http://iridia.ulb.ac.be/irace/

Dear Hayder,

I think it depends on the problem you're solving.

Here is a work that uses swarm optimization to parameter tunning on multiple sequence alignment. It may be a start point for you.

Swarm intelligence for optimizing the parameters of multiple sequence aligners. Rubio-Largo et al. 2018.

Regards!

There are different strategy has been used in the literature, but i am looking for the optimal one.

Dear Hayder, Pleas see the following paper, which is related to you question Article Parameter Adaptation in Ant Colony Optimization

Your question is an important and interesting one:

online parameter control may be useful to better adapt an algorithm to the characteristics of a particular instance-this may be particularly beneficial if the instances are relatively heterogeneous, requiring different settings of key algorithm parameters to reach peak performance. Additionally, it may be desirable to adapt algorithm parameters depending on the stage of the search process, for example, to make a transition from a rather explorative to an exploitative search phase, or depending on the amount of infeasibility when dealing with (strictly) constrained problems.

You may look at the useful link below:

Article Parameter Control in Evolutionary Algorithms: Trends and Challenges

Through the use of generation number. The idea is to increase parameters that intensify the solution generation