I think you should take fibers into account in the material modeling(use stress stain curve and other parameters for steel fiber concrete ), but it's so difficult to distribute fibers in concrete
It's possible using a Matlab code and excel spread sheet to do the distribution in any 3D CAD Software and then import to ABAQUS. But the solution will take long time due to the large numbers of fibers. The program will have to solve for each single fiber which will take very long time.
For concrete simulation you don't model the aggregate inside. Here is the same issue, you don't have to model the fibers inside. Just input the experimental stress strain curve (after changing to true stress and plastic strain) to your FE software and do a best fit to calibrate your FEM.
Unless you want to study the fibers it self in the solution (stresses, deformations...etc of fibers) you don't have to model the fibers separately. But if you want to go in details here's two links where the distribution is done in details but for ansys spaceclaim.