To validate the results of modeling by Abaqus software with experimental results, how can estimate the Chaboche hardening coefficients from the hysteresis curve?
You should use the curve fitting option of the software. I don't know if Abaqus has this option or not, but ANSYS has it. You should introduce the material coupon test to the software (which should be based on true stress and not engineering) and define the type of hardening you want the software to consider for curve fitting. You can also choose Chaboche combined with isotropic hardening.