Share your experience of using (when and where to use) these 2 leading Data Warehouse technologies in industry.
Hello,
When I was working at ABB we used ETL to get data from different ERP-systems into data warehouse SAP-platform for generating financial reporting, different kinds of analyses, and BI. The main benefits of ETL was that you get the exact data from the source that is needed for the reports and analyses, the problem is when the need of the reports and/or analyses change since then some data could be missing and the business rules for the ETL process had to me modified. This solution was implemented a long time ago and would if implemented now probably be using ELT since it gives more flexibility because it would be possible for the load process to include all source data into the data warehouse for further transformation depending on need of reporting and analyses.
My conclusion would be that ETL is very effective if the reporting and need of analyses/BI are relatively static and thus ETL is to prefer since it only loads a part of the data in to the data warehouse. But if the needed reporting and analyses/BI is changing or the data is needed in BI for “drilling-down/up” and “slice and dice” then ELT would be better since it gives greater flexibility to adjust to changing business requirements.
An interesting paper about the ETL/ELT topic is:
Florian Waas et al., 2013, On-Demand ELT Architecture for Right-Time BI: Extending the Vision, International Journal of Data Warehousing and Mining, 9(2), 21-38.
Best regards!
Article On-Demand ELT Architecture for Right-Time BI: Extending the Vision
Hi, I have been working on an ETL project for an year now, and here is my experience. We are using it to migrate the data from existing SAP systems to new SAP systems. Before migration, we cleanse the data residing in existing SAP systems so as to ensure only productive and precise data will be migrated to new systems. As we are dealing with SAP systems, we have been using SAP Data Services application as an ETL tool, and the same tool can be used for other ERP systems as well. Hope this info helps! Please let me know if you need more insights in the similar lines. Thanks!
https://www.xplenty.com/blog/etl-vs-elt/
https://blog.panoply.io/etl-vs-elt-the-difference-is-in-the-how
https://www.jamesserra.com/archive/2012/01/difference-between-etl-and-elt/
https://www.ironsidegroup.com/2015/03/01/etl-vs-elt-whats-the-big-difference/
https://www.matillion.com/events/etl-vs-elt-whats-big-difference/
- Badges
- Science topic
- Similar topics
- Computer Science
- Data Mining