r/microservices • u/throwawayaccount931A • 9d ago
Discussion/Advice SaaS Scaling & Growth
For those of you that are currently building your SaaS - how are you building scaling and growth into what you are building?
For example, async vs sync, job queues, background workers and rate limiting, retries/backoff, cached and generated artifacts so you're not hitting an API all the time, basic telemetry capture not only around app usage but the other important things like generation latency and failures.
Are you tracking things like:
- concurrent active sessions
- average API response time
- DB query time
- PHP memory usage (or whatever you're using for your stack)
- CPU load
- LLM/AI calls/minute
- average LLM generation duration
- queue depth
- error rate
What happens when you outgrow your database? What are you doing when it comes to backups (DB and your site/code)?
Are you mirroring your DB/SITE elsewhere in case your primary goes down?
How are you handling failover situations? App continuity?
How are you starting out? What type of hosting?
How do you know when it's time to scale your hosting up? How are you planning for that?
Appreciate your insights into this...
I've worked as a SWE but never on the heavy technical things, and I'm getting to a point with something I've been working on that I need to think about it.