Skip to content

Parallelize initial variant evaluations in GEPA#7039

Open
AntoineToussaint wants to merge 1 commit intomainfrom
parallelize-init-eval-step
Open

Parallelize initial variant evaluations in GEPA#7039
AntoineToussaint wants to merge 1 commit intomainfrom
parallelize-init-eval-step

Conversation

@AntoineToussaint
Copy link
Member

Summary

  • Replaced the sequential for loop in init_eval_step with concurrent execution using futures::future::join_all
  • All initial variant evaluations now run in parallel, reducing total wall time proportionally to the number of variants
  • No functional change: results are collected into the same BTreeMap<VariantName, VariantScores> as before

Test plan

  • Verify cargo check --package autopilot-tools passes
  • Verify existing GEPA tests still pass
  • Manual validation with multiple initial variants to confirm concurrent execution

🤖 Generated with Claude Code

The init_eval_step was evaluating variants sequentially in a for loop.
This changes it to run all variant evaluations concurrently via
futures::future::join_all, reducing total wall time proportionally
to the number of initial variants.

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant