Skip to content

all_gather for TPU doesn't support backward gradients. #6295

@tchaton

Description

@tchaton

Currently, we rely on AllGatherGrad to compute gather for GPUs.

TODO:

  • [] Extend this class to support TPU
  • [] Add tests

Metadata

Metadata

Assignees

No one assigned

    Labels

    accelerator: tpuTensor Processing UnitfeatureIs an improvement or enhancementgood first issueGood for newcomershelp wantedOpen to be worked onwon't fixThis will not be worked on

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions