Solution for Getting Subgroup Ranks Info in Custom Backend in PyTorch
is Given Below:
In PyTorch code, looking at the creation of a sub group using new_group(ranks, backend) construct, I see it goes through _new_process_group_helper().
I am interested in getting this call to a custom backend, (I’ve registered this following the guide here). This call is delegated to the registered process group creation method in the same method at L724
However, it doesn’t seem to forward the participating ranks list to the method. Any help on how to get this information in the custom backend during new_group() creation?