My book
My book, Designing Data-Intensive Applications, has received thousands of five-star reviews.
Samza and the Unix philosophy of distributed systems
A talk at UK Hadoop Users Group, London, UK, 05 Aug 2015
Abstract
One of the big ideas in Unix was to allow small, simple command-line tools to be chained together
with pipes. Each of those tools would do one thing and do it well. Even now, 50 years later, Unix
tools are one of the most powerful ways of getting things done: a one-liner of
grep | awk | sort | uniq is still one of the fastest ways of processing data and analysing logs.
Many modern data systems are monolithic, the very opposite of the Unix philosophy. But Apache Samza is different: it is, in some sense, an attempt to bring the Unix philosophy into 21st-century distributed systems. In this talk, we will explore the design decisions behind Samza, and see how the Unix philosophy can help us build modern systems that are robust, scalable and maintainable.
