This is an impossible question to answer in many ways.
Firstly, Paracelsus, regarded as father of toxicology is famous for stating " Solely the dose determines that a thing is not a poison.”- so everything is toxic.
The toxic dose of course also depends on the material in question. For nanoparticles, the interactions at an organism, organ, cellular level can depend on chemical composition, size, shape, crystallinity, surface functionalisation....
What is of importance is the Risk, which is a product of the Hazard times the Exposure. What is difficult in the case of nanoparticles is to establish what is a realistic exposure scenario, and dose.
In Europe there are and have been many consortia addressing the questions, and these are compiled under the EU NanoSafety Cluster