Thanks to all the useful tips on optimizing for scaling.
However, I’m still running into trouble scaling to a few hundred users, with “Service unavailable” fairly often on startup (requiring a few browswer refreshes), and a recent hang for ~250 users using RStudio.
I’m now thinking about what I need to try next for optimizing. How much difference does it make to offload the logs to PostgreSQL, rather than the default sqlite? In particular, how important is it to offload the logs to a separate node? Do y’all find the sqlite process uses a lot of memory / CPU?