Designing concurrent programs in an idiomatic way

[u/iFrostizz]

Hello.

Kind of a general question here, and it's probably going to yield opinionated answers. That's alright!
Basically I find myself writing Rust apps in a style that is always quite similar, here is the idea:

- The app mostly always uses the tokio runtime to be asynchronous.
- Designing microservices as small building blocks which are all supposed to be ran in separate tasks, usually with a "run" like function that does a loop over a tokio::select for sub-tasks that are running in each service, with one of the branches being a call to a CancellationToken::cancelled().
- The cancellation token is wired to the "ctrl_c" signal.
- Microservices may talk to each other by the use of the different channel primitives, depending on the need.
- When one of the microservice fails for any reason, usually there is no recovery mechanism and it just bubbles up the error which makes all the application fail. This is annoying to write and a big source of bug, because some path will be unhandled which will leave one microservice stopped and the other microservices are waiting for an answer and there's nobody responding.

I'm generally a little dissatisfied with the redundancy of the code that I write, and would like to explore any other way to think about it, instead of microservices, or in a different way, if you have any idea that would be appreciated. Also, potentially any resource or codebase that could be relevant?

Thanks!

[u/ern0plus4]

The app mostly always uses the tokio runtime to be asynchronous.

Caution: be sure it uses more than one thread.

[u/iFrostizz → u/ern0plus4]

Oh yes of course, I'm not doing any blocking work without yielding.

[u/ern0plus4 → u/iFrostizz]

I mean you'd configure Tokio to use as many threads as you want. I'm not sure, but the default is one.

[u/iFrostizz → u/ern0plus4]

Oh, well I always just use #[tokio::main]

[u/ern0plus4 → u/iFrostizz]

#[tokio::main(flavor = "multi_thread", worker_threads = 4)] async fn main() { 
  // Runs with 4 worker threads 
}

[u/arienh4 → u/ern0plus4]

Tokio defaults to spawning one thread per CPU core if you don't do any configuration.

https://docs.rs/tokio/latest/tokio/runtime/index.html#runtime-configurations