So I have large number of csv files (100+) in a directory with same structure and column names. The data is in time series and there are approx 30 columns/file. However i only want to aggregate particular number of columns together while dont care about others. I need help in R coding for this.
e.g i want to aggregate column 2 from every file together in one place, similarly column 2 from every file together. My prefernce is to keep all data in column because row binding has resulted in wrong numbers.
Dear Mahmood Saeed ,
I am not sure if what you mean by ''aggregating particular columns together'' is merging those multiple csv files. If I am correct and that is the case, please try the following to see if it can work:
Having completed creating your data frames, you should have three R add-on packages for the following R syntax: dplyr, plyr, and readr; hence you need to first install and load the packages into R.
install.packages("dplyr")
install.packages("plyr")
install.packages("readr")
library("dplyr")
library("plyr")
library("readr")
Then, import and merge the example csv files based on the list.files, lapply, read_csv, and bind_columns functions:
# Identify all csv files in a named folder (eg. XX)
data_all %
# Store all files in list
lapply(read_csv) %>%
# Combine datasets into one dataset
bind_columns
# Print data to RStudio console
data_all
Elvis Munyaradzi Ganyaupfu nopes. what i mean is each csv files has particular columns (same column name in each file) say Col A, Col B and Col C. I want to select these columns from each file and add together i.e Col A from file 1,file2.... and Col B from file 1,file2.....
Mahmood Saeed ,
Thanks for the clarity. I would be grateful if you share with me how to do that - possibly you can post the question/enquiry for help to RStudio Community, I hope someone can assist:
https://community.rstudio.com/
These two links may be useful
1. Merging multiple files
https://www.r-bloggers.com/2011/04/merging-multiple-data-files-into-one-data-frame/
2. Selecting particular columns
https://www.datasciencemadesimple.com/select-variables-columns-r-using-dplyr-select-function/
hi, you can merging your files after that selecting particular columns
you can use the microsoft power bi software to do this work faster that R.
Proloy Barua methods in R acceptabe.
Mahmood Saeed .
- Badges
- Science topic