The buffering capacity of buffer (resistance of pH change when H+ or OH- is added) is proportional to the concentration of the buffer. When pH = pKa (buffers containing an equal quantity of acid and its salt) the capacity is maximum. More simply, if about 10% (relative to the buffer concentration) of OH- or H+ is added to the solution, the change is less than 0.05 pH units (for 1% it is about 0.004 units, etc.). Remember that pH = pKa - log(AH/A-). So a factor of 10 relative to a solute (the species which brings H+ or OH- to the solution) seems to be a minimum, but depends on the tolerance of your process to pH changes. Note that the buffer capacity decreases when the condition pH = pKa is no longer fulfilled.
To complete the Joaquim answer and mine, you can evaluate the pH change (as I did) from the Henderson Hasselbalch equation : pH = pKa + log(A-/HA) (similar to the one I gave) by calculating log (A-/HA) for (A-/HA) ratios slightly different from 1 (0.9 or 1.1 for a buffer excess of 10, 0.99 or 1.01, for a buffer excess of 100, etc). This is what I did in my answer. When you are not exactly at pH = pKa the change may be evaluated by calculating -for example- a pH change when log(A-/HA) change from 1.1 to 1.2 (more basic side) or 0.9 to 0.8 (acidic side).