I am trying to make an approach on how to stream data from files based on the timestamp field in the data. such that data gets ingested to processing applications based on the timestamp.
I am using the word 'stream' because I using the apache spark streaming.
I think there should a way in apache-spark, apache Kafka or Linux bash etc
Qamar Ul Islam
Varun Garg have a look https://stackoverflow.com/questions/62486634/stream-and-process-data-based-on-timestamp-values-using-kafka-and-spark-streami
1 votes
1 thanks
Aravinda C V
https://stackoverflow.com/questions/62486634/stream-and-process-data-based-on-timestamp-values-using-kafka-and-spark-streami
0 votes
0 thanks
- Badges
- Science topic
More Varun Garg's questions See All
Similar questions and discussions