Ask HN: Resources on learning System Design (back end/data engineering)?
by LewisVerstappen on Hacker News.
I’m looking for resources/tips on how to learn concepts in system design. Things around backend engineering and all the various components that go into building large scale systems (load balancing, message queues, CDNs, etc.). I’d also like to learn concepts around data like database sharding, non-relational database models, streaming/batch (lambda architecture, kappa architecture, etc.) and more. In terms of what I’ve done so far… I’ve read – Designing Data Intensive Applications ( https://ift.tt/vjakrCS ) – This book has been recommended a ton on HN/twitter/reddit and I found it extremely useful to get a better idea of how data systems work, different types (OLAP vs. OLTP, data warehouse vs. lake, etc.) and get a better understanding of distributed systems. – Quastor ( https://ift.tt/lCIvPVN ) – This is a newsletter that sends out summaries of system design blog posts from Big Tech engineering blogs. It’s been helpful to me for getting an understanding of the different components involved in the tech stacks at various companies and how companies think about building scalable systems. – MIT Distributed Systems ( https://www.youtube.com/playlist?list=PLrw6a1wE39_tb2fErI4-W… ) – This is a series of lectures by Robert Morris (co-founder of YC) on distributed systems and their properties. The lectures pick a specific tool/technology (Google File System, ZooKeeper, Apache Spark, etc.) and then discusses it. I’ve really enjoyed reading the papers and watching the lectures. I’d really love any recommendations from the HN community on how else I should be learning about system design. Thank you very much!