Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

Do you mind sharing more how you use Redis streams for ETL pipelines?


Happy to talk shop anytime, feel free to reach out.

In short - I like to have audit-able dataflows in my pipelines. Streams are inherently timestamped and provide a great way to see how data changed over time. For one, if you had a bug or regression in the pipeline, you can precisely track down the impacted time window - no guessing needed.




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: