Architectural Evolution of Amazon Internal Data Platform

In this talk, we will delve into the evolution of PXT DaaS – a multi-tenanted hub built on top of AWS for data exchange between software and analytical teams in Amazon HR – and its high-level architecture. We will explore the three major steps of PXT DaaS’s architectural evolution: (1) the transformation from a single-tenant to a multi-tenant data lake, (2) the split of the monolithic code base into a set of modular microservices, and (3) the implementation of a self-service portal for the data platform. We will discuss the challenges faced by the team during each step of this evolution and how we overcame them.

Lecturer- Filipp Fediakov, a Senior Software Development Engineer at Amazon. I have been a lead engineer in a team of 12 building an internal data platform for software, analysts, data engineering teams in Amazon People Experience Technology. Now I work in a team that works on intranet search to help Amazon employees find the information they need to stay productive. Apart from work at Amazon I also write blogs and contribute to AWS CDK.