Verify that you have the apropriate blank at each condition, pay particular attention to solution turbidity in blank and test solutions
Use matching cuvettes for blank and test solutions
Finally, if you are measuring enzyme activity, the specific value of absorbace is often not so important as you have to work with the slope of the linear portion of the time course. I hope this helps.