Filling Your Data Lake One Stream at a Time
In this follow-up to the Datanami article “One Deceptively Simple Secret for Data Lake Success”. He talks about leveraging change data capture to ingest transactional data, and applying filtering and enrichment to streaming data to maximize its value when it lands in the Lake.
“A Data Lake can be a powerful ally if it is built in the correct way. By utilizing streaming data collection and processing, you can feed your Lake with data designed to answer your questions, and ensure it is current and relevant. After all, what is better for a lake than a supply of good, healthy streams?”