Case Study: Implementing Lambda Architecture

Abstract

Lambda architecture was one of first definitive ideas in Big Data architecture and, like any new architecture, has its followers and detractors. How do you decide which side you are on? I have a simple answer: it depends on the architecture’s applicability to your environment. Lambda is definitely not suited for all Big Data use cases. Maybe one of the newer architectures like Kappa or Fast Data architecture is more suited for your environment. Maybe you don’t even need to have an architecture-based approach and can simply start with a data reservoir and design analytics as required. Every environment is unique in some ways and needs special design considerations, but the trick is to start with a generic approach—and the most appropriate one.