Skip to content

Batch requests in MLFlowLogger #15900

@schmidt-jake

Description

@schmidt-jake

Proposed refactor

Update the mlflow API callsites in MLFlowLogger to use the more efficient MlflowcClient.log_batch API.

Motivation

Improve logging performance and reduce the number of API calls.

Pitch

MLFlowLogger currently executes individual API calls for every hyperparameter (in log_hyperparameters) and metric (in log_metrics) using for loops. By refactoring these two methods to use log_batch, we could reduce the number and overhead of MLFlowLogger API calls.

I'd be happy to open a PR for this.

cc @Borda

Metadata

Metadata

Assignees

No one assigned

    Labels

    featureIs an improvement or enhancementhelp wantedOpen to be worked on

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions