As Boris L. Glebov already stated: these passive devices can be considered a passive waveguide. Thus basically the same rules as for fibers apply.
The only thing that might differ: could be that the wavelength dispersion - aka the dependency of the refractive index from the wavelength is a bit more pronounced than at fibers. Just a point to check.
You can get a good estimate by taking their physical length, multiplying by the relevant index of refraction, and dividing by speed of light in vacuum.
Or delay relative to vacuum: (n - 1) * t / c
Where n in index of refraction, t is thickness, and c is the speed of light in vacuum.
As Boris L. Glebov already stated: these passive devices can be considered a passive waveguide. Thus basically the same rules as for fibers apply.
The only thing that might differ: could be that the wavelength dispersion - aka the dependency of the refractive index from the wavelength is a bit more pronounced than at fibers. Just a point to check.
As you know, the latency has become an issue of the present research for the sake of 5G technology and Internet of Things (IoT). The passive devices you referred to are parts of optical transport networks (OTNs).
As far as the physical layer is concerned, the latency basically is caused by optical paths, The optical paths could be free space or the wired one (i.e., copper or fibers).
If you leave aside the software-caused latencies in a network (conventional and optical), in your case, you should consider the optical paths of the devices through which the signals take to pass. Specifically, in the circulator, how much time is needed for a signal to circulate to the desired port, and of course, it depends on the circulator type, as well.
One of my projects is on latency in optical transport networks. We are focussing on the design of optical fiber as the transmission medium to reduce the propagation delays of the pulses in long-haul communication links. We are considering different types of fiber profiles, specifically NZDSF fibers that are common transmission fibers.