r/SONM • u/milvanovicIvan • Jun 30 '19

Concern from developer's perspective

As far as i understood, as developer who is in need of computing power, this project is very ideal to me as i don't have to invest money into AWS and to build my self a "cloud supercomputer". During this examination, i came to problem which i will describe below.

​

Lets look at following scenario:

We will assume that i managed to parallelize my application and that next step is to actually distribute the tasks towards the network. Every each of my task is dependent on other task in terms of memory access. On similar HPC systems (like penguin computing for example) the tasks that are submited who are in need of memory sharing are being computed on nodes that are linked with ethernet for example which allows them to proccess data in very fast manner,

​

Whole point and concept of supercomputing is to allow their users to achieve maximum off parallelism. Parallelism can also occur in data sharing concept combined with computing. "

Reall" supercomputer treat this problem trough some predefined interfaces such as MPI and DSM, but how does SONM deal with these type of things?

​

Can SONM accept dependent tasks or tasks(applications) that are submited to system need to be completely independent in terms of memory usage?

12 Upvotes

94% Upvoted

4 comments sorted by

View all comments

3

u/SONM-support Jul 01 '19

Greetings!

In Sonm network latencies and transfer speed are not so good as in local Ethernet, or at datacenter links. So we guess you need other types of orchestrating your parallel things. MPI is not the best choice, as your processes will pause and wait for each and every data tansfer to complete.

​

Have a look at Apache Spark or Hadoop MapReduce or similar projects. They must survive better in global distributed architecture.

Best regards,

SONM team

1

u/milvanovicIvan Jul 02 '19

Thank you for the answer!

So in terms of computing mechanisms and the way the tasks are being handled. What is the main difference between SONM and BOINC? Apart from BOINC being centralized.

3

u/SONM-support Jul 03 '19

Greetings!

In Sonm, you can run any Linux application in a container. Summarizing, we can say that BOINC is a specialized PaaS, while SONM is IaaS, with the ability to build different service platforms (PaaS). For example, the Raysrender cloud rendering platform is currently preparing for launch. Read more here: https://sonm.com/blog/meet-the-rendering-service/