I do not think that any approach to AI can ignore the massive data provided by the internet, part of which is nothing more than the digitalization of pre-internet or non-internet material. There is of course the problem of the enormously varying quality and reliability of this material, the presence of redundancy and its sheer vastness, which could lead one to wonder whether processing such raw data via rudimentary algorithms is really worth the energetic and environmental costs or the use of the expensive infrastructure involved.
I believe that the correct approach to AI must be based on formal logic and the logical-algebraic frameworks of theoretical computer science, as well as other kinds of mathematics beyond the the ones commonly employed in machine learning.
The Semantic Web project seemed a good approach along these lines. It involves a logical and formal semantic analysis of natural language. It calls for a far more sophisticated way of producing internet content and (re)presenting human knowledge on the internet. No Data without Metadata. We need a machine-human logical-semantic interlingua so that internet data can become machine readable in a logical and semantic sense (rather than mere statistical data chunked by a machine learning algorithm).
We should be able to effect complex structured queries to intelligent evolving self-correcting interlinked data bases according to varying degrees of precision which will be able to output the source and a measure of reliability of the data presented.
Machine learning will come into play for example at the level of automatic theorem proving, of the massively difficult task of the processing of logical queries.
Our ethical principles can be given formal logical formulation than can be understood by machines.
It seems that this approach (even if demanding more time and work and being filled with challenges) is far more desirable than internet-based Large Language Models. This kind of 'intelligent' AI seems to be in the long run a better ethical , environmental and human choice.