Relativity tells us that a particle observed well outside the gravitational field takes an almost infinite time to drop into the black hole. Whereas if one could ride a particle it would fall in almost instantly.
How then can a black hole increase in size when observed from the earth? Once it is formed it will take an almost infinite time to increase its mass.