[Question] Anyone knows how to impl a remote scheduler?

[lixin-wei]

Hi everyone, I'm confused about how to implement a remote scheduler.

Do I need to serialize the entire operation state, and then send it to remote through network?

Sounds very tricky, because the operation state contains a lot non-serializable things like lambdas of the ex::then callback.

Could any one help me? Any idea will be helpful, thanks in advance!

[ericniebler]

no, you would not have to send the operation state over the network. you couldn't, in fact, because it is not movable. instead, in your operation state's start() member function, you would initiate the transfer of only the data that your remote workers need. if you are writing an MPI scheduler for instance, this is where you would put your invocation of MPI_Send.