Files
oh-my-pi/packages/react-edit-benchmark
can1357 5d2e2cef1f feat(react-edit-benchmark): added retry mechanism and autocorrect tracking to benchmarks
- Added retry mechanism for benchmark tasks with separate system and retry prompt templates to improve edit success rates.
- Introduced autocorrect tracking metrics including autocorrect-free success rate and edit autocorrect counts in task and benchmark summaries.
- Refactored prompt building into modular functions (buildBenchmarkSystemPrompt, buildInitialBenchmarkPrompt, buildRetryBenchmarkPrompt) with BenchmarkPromptDelivery type for distinguishing initial and follow-up messages.
- Added session management with cache-keyed provider session IDs using xxHash64 and centralized RPC argument building via prepareBenchmarkSessionSetup.
2026-03-22 21:13:42 +01:00
..
2026-02-22 16:08:53 +01:00