[FEATURE] Broadcast the shuffle handle info for the reader #2642

Code of Conduct

• I agree to follow this project's Code of Conduct

Search before asking

• I have searched in the issues and found no similar issues.

Describe the feature

In #2637 , we introduce the cache mechanism for the shuffle handle retrieving performance. Another optional proposal is to broadcast the shuffle handle info, that may be much better to reuse the spark network stack.

Motivation

No response

Describe the solution

No response

Additional context

No response

Are you willing to submit PR?

• Yes I am willing to submit a PR!