Skip to content

Update FSDPPrecision to support 16-true precision setting #17657

@awaelchli

Description

@awaelchli

Description & Motivation

We recently added true precision support in Fabric:
#17287
#17576

The FSDPPrecision plugin needs an update to support the strings "16-true" and "bf16-true".

Pitch

Update the plugin's code by following the same pattern as in #17576.

Alternatives

No response

Additional context

No response

cc @Borda @justusschock @awaelchli @carmocca

Metadata

Metadata

Assignees

No one assigned

    Labels

    fabriclightning.fabric.FabricfeatureIs an improvement or enhancementrefactorstrategy: fsdpFully Sharded Data Parallel

    Type

    No type

    Projects

    No projects

    Milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions