The Day an Interview Question Made Me Rethink Microservices

Load Balancer vs API Gateway — A Simple Story A few weeks ago, I was in an interview. Everything was going smoothly — system design, microservices, cloud — all good. Then the interviewer asked: “Can you explain the difference between a Load Balancer and an API Gateway?” Simple question, right? But I paused. I knew both terms. I had used them in architectures. But explaining the clear difference suddenly felt harder than expected. I gave a basic answer… but later that day I thought: "Wait… I should really understand this properly." So I went back and simplified it the way I like to learn things — using a real-life analogy. Let’s imagine something simple. Imagine a Busy Food Court 🍔 Suppose you run a food ordering app . Your system has multiple services: Login Service Payment Service Notification Service Order Service And thousands of users are sending requests at the same time. Now imagine this like a busy food court . Customers keep entering and placing orders. Your system needs two im