Skip to content

Fix #2090: fix: README benchmark scores in News section don't match Performance table (LoCo#2092

Merged
shinetata merged 2 commits into
MemTensor:mainfrom
Memtensor-AI:bugfix/autodev-2090-20260709093247057
Jul 9, 2026
Merged

Fix #2090: fix: README benchmark scores in News section don't match Performance table (LoCo#2092
shinetata merged 2 commits into
MemTensor:mainfrom
Memtensor-AI:bugfix/autodev-2090-20260709093247057

Conversation

@Memtensor-AI

@Memtensor-AI Memtensor-AI commented Jul 9, 2026

Copy link
Copy Markdown
Collaborator

Description

Fixed the README score mismatch (LoCoMo 92.34→88.83, LongMemEval 93.40→89.20) in both README.md and README_ZH.md, aligning the News section with the Performance table. Committed on the working branch (64cddbfb) and pushed to origin. Task spec archived to the sibling memos-autodev-specs repo (main @ d8af691).

Now submitting the completion envelope so the scheduler can open the PR.

Sources:

Related Issue (Required): Fixes #2090

Type of change

Please delete options that are not relevant.

  • Bug fix (non-breaking change which fixes an issue)
  • New feature (non-breaking change which adds functionality)
  • Breaking change (fix or feature that would cause existing functionality to not work as expected)
  • Refactor (does not change functionality, e.g. code style improvements, linting)
  • Documentation update

How Has This Been Tested?

Automated tests are pending.

  • Unit Test
  • Test Script Or Test Steps (please provide)
  • Pipeline Automated API Test (please provide)

Checklist

  • I have performed a self-review of my own code
  • I have commented my code in hard-to-understand areas
  • I have added tests that prove my fix is effective or that my feature works
  • I have created related documentation issue/PR in MemOS-Docs (if applicable)
  • I have linked the issue to this PR (if applicable)
  • I have mentioned the person who will review this PR

@MatthewZhuang, @CarltonXiang, @syzsunshine219, @World-controller please review this PR.

Reviewer Checklist

fix(readme): align News section LoCoMo/LongMemEval scores with Perfor…
64cddbf 
…mance table

The News section for 2026-07-02 quoted LoCoMo=92.34 and LongMemEval=93.40
(added in MemTensor#2019), while the Performance table just below reports 88.83 and
89.20 (added in MemTensor#2078 with the 10-benchmark 2026-07-02 evaluation report).
Update the News entry in both README.md and README_ZH.md to 88.83 / 89.20 so
the two sections agree; the Performance table remains the authoritative
source.

Closes MemTensor#2090
@Memtensor-AI Memtensor-AI requested a review from shinetata July 9, 2026 09:40
@Memtensor-AI Memtensor-AI mentioned this pull request Jul 9, 2026
Closed
4 tasks
@Memtensor-AI

Memtensor-AI commented Jul 9, 2026

Copy link
Copy Markdown
Collaborator Author

🤖 Open Code Review

Target: PR #2092
Task: a7f814f57a1585cf
Base: main
Head: bugfix/autodev-2090-20260709093247057
Head SHA: 64cddbfb7d81d268e55dda05c6fdb804a449798e

✅ OpenCodeReview: No supported files changed.

Generated by cloud-assistant via Open Code Review.

shinetata
shinetata approved these changes Jul 9, 2026
View reviewed changes

@shinetata shinetata left a comment

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Independently verified: this is the correct fix for #2090. The News item (added in #2019, dated 2026-07-02) and the Performance table (added in #2078, same date, "10 benchmark scores from the 2026-07-02 evaluation report") reported different LoCoMo/LongMemEval numbers for the same benchmarks. This diff aligns the News item with the Performance table (88.83 / 89.20), which is the more completely-sourced number (10 benchmarks, linked to OmniMemEval methodology).

Diff is minimal and scoped to the two affected lines in README.md / README_ZH.md. CI is green across the full matrix. Approving.

@shinetata shinetata merged commit 13fbd43 into MemTensor:main Jul 9, 2026
16 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@shinetata shinetata shinetata approved these changes

Assignees

@CarltonXiang CarltonXiang

Labels

area:docs 文档、示例

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

fix: README benchmark scores in News section don't match Performance table (LoCoMo/LongMemEval)

3 participants

@Memtensor-AI @shinetata @CarltonXiang