I have large data tables in MySQL and is connected to R. I am using sqldf package in R to read tables from SQL and combining required tables to obtain the final table to carry out further analyses. But this is not very efficient as it occupies memory in R as well as it takes long time to extract big tables.
Is there a package or something in R that will help me work by directly referencing to tables in MySQL without having to read them first in R?
Thanks!
Have you tried the package RMySQL? Also see the answer to this question: http://stackoverflow.com/questions/1875795/best-practices-for-storing-and-using-data-frames-too-large-for-memory
you can check this link
http://www.roseindia.net/customsearch/search.shtml?cx=partner-pub-0714075272818912%3A351fen-pwln&cof=FORID%3A10&q=Is+it+possible+to+work+with+tables+directly+from+MySQL+without+first+reading+in+R&sa=Search&siteurl=www.roseindia.net%2F&ref=www.google.com%2F&ss=37j1369j2
Thanks for info on memory related issues in R for big data..as well as on various aspects of Mysql and R..
I use SQL commands (in MySQL, phpMyAdmin - part of XAMPP environment) for most of the problems and export CSV files to be processed by R, if is needed (diagrams etc.). But I work with SQL from 15 years. I TRUST in MySQL commands, than in R packages, because I use it more, and I can control faster. I use also R to decompose CSV files to upload into MySQL
@Laszlo- R can use almost all Mysql and PhP commands and replicate exactly the similar results with similar efficiency. Being a non-regular user of Mysql, I am relying on R but R has additional advantage as it can prepare slide presentations and complex statistical analyses, as you know. I am not familiar with similar features in Mysql and php.
@ Laszlo again- I have created two tables in MySQL but I have no idea how to make them update automatically without having to run the query time and again. Do you think it is possible?
Hi Rajan,
It is possible, I think.
If You send me more concrete things, and your problem, I hope I can help you.
I need the tables structure and what U wanna do with them.
If there is a problem, U can say tableX(a01,a02,...ann)
I will have little time until 16th december, but I hope I can help You before too.
Write what U have and what You want, maybee in steps, and hope I can help.
Regards
Laszlo
The creation of tables could be:
CREATE TABLE newtable AS
SELECT a01,a02,a05 FROM oldtable;
And You have the table with the informations too. After that you can EXPORT this in CSV or other formats, what U can read into R.
- Badges
- Science topic
- Similar topics
- Mathematics
- Statistics
- Statistical Software
- R