Skip to content

show_metrics() Enhancement: Display MLFlow metrics for OSS models#6013

Merged
zhaoqizqwang merged 3 commits into
aws:master-nova-follow-upsfrom
ehsu3:job-monitoring-oss-mlflow
Jul 10, 2026
Merged

show_metrics() Enhancement: Display MLFlow metrics for OSS models#6013
zhaoqizqwang merged 3 commits into
aws:master-nova-follow-upsfrom
ehsu3:job-monitoring-oss-mlflow

Conversation

@ehsu3

@ehsu3 ehsu3 commented Jul 10, 2026

Copy link
Copy Markdown
Contributor

Issue #, if available: Continuation of 'Monitoring training/eval jobs with CW logs' task

Description of changes:

  • Extends show_metrics() to support non-Nova (OSS) models by pulling metrics from MLflow when configured. Nova models continue to use CloudWatch log parsing.
  • show_metrics() routes to a CW parsing method or MLFlow display method based on the model that was used for training.
  • Updated related unit tests
  • Manually tested on a small OSS job to verify that the metrics show up properly in a notebook.

By submitting this pull request, I confirm that you can use, modify, copy, and redistribute this contribution, under the terms of your choice.

f"run: {mlflow_details.mlflow_run_id}"
)

from sagemaker.train.common_utils.metrics_visualizer import plot_training_metrics as _plot_mlflow_metrics

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Can this be a top level import?

"""Parse and plot training metrics from CloudWatch logs (Nova models)."""
training_job = self._latest_training_job

# Resolve job ID

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Extra comment?

@zhaoqizqwang zhaoqizqwang merged commit b3152fb into aws:master-nova-follow-ups Jul 10, 2026
1 check passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants