can1357
5cbdd740bf
- Added `fetchUsageData` and fleet token summation to aggregate token burn across clients. - Changed window grouping logic from window labels to limit IDs for distinct separation. - Updated `ProviderWindowInsight` properties and added tests for label suffixing and token summation.
298 lines
14 KiB
Markdown
298 lines
14 KiB
Markdown
# Changelog
|
|
|
|
## [Unreleased]
|
|
|
|
### Changed
|
|
|
|
- Window token estimates now use broker-held fleet token burn (per-client observed-usage reports) when an auth broker is configured, matching the fleet-wide window fractions instead of undercounting with local-only message stats.
|
|
|
|
### Fixed
|
|
|
|
- Fixed subscription-window insights merging distinct limits that share a duration label (Anthropic's overall vs model-scoped 7-day windows, Codex base vs Spark weeklies); interleaved fractions inflated window-equivalents consumed by orders of magnitude and broke tokens-per-window estimates. Windows now group by provider limit id.
|
|
|
|
## [17.3.6] - 2026-08-17
|
|
|
|
### Fixed
|
|
|
|
- Fixed the stats dashboard being unreachable from container hosts by accepting an explicit `--host` bind address while preserving loopback-only binding and same-origin API access by default.
|
|
|
|
## [17.3.0] - 2026-08-13
|
|
|
|
### Added
|
|
|
|
- Added cost-weighted `cacheSavings` metric alongside `cacheRate`, accounting for cache-read discounts and write premiums against equivalent uncached prompt costs.
|
|
|
|
### Fixed
|
|
|
|
- Ensured the embedded dashboard archive is byte-reproducible by sorting entries and zeroing tar and gzip timestamps during compilation.
|
|
|
|
## [17.2.10] - 2026-08-06
|
|
|
|
### Changed
|
|
|
|
- Optimized package dependencies by replacing `date-fns` with `@oh-my-pi/pi-utils/dates` and removing unused test dependencies.
|
|
|
|
## [17.2.9] - 2026-08-05
|
|
|
|
### Fixed
|
|
|
|
- Restricted the stats dashboard to IPv4 loopback and removed wildcard CORS access to its API ([#7633](https://github.com/can1357/oh-my-pi/issues/7633)).
|
|
|
|
## [17.2.4] - 2026-08-01
|
|
|
|
### Fixed
|
|
|
|
- Fixed provider usage window stats silently showing no data during SQLite contention by installing a five-second busy timeout on read-only agent database connections ([#7300](https://github.com/can1357/oh-my-pi/issues/7300)).
|
|
|
|
## [17.1.2] - 2026-07-24
|
|
|
|
### Added
|
|
|
|
- Added a Providers dashboard section: per-provider totals, stacked token/cost burn over time, peak-burn-hours histogram, subscription-window insights (windows burned, estimated tokens per window, peak concurrent utilization, ideal account count, exhaustion events), and latest window utilization per account — window analytics read the auth broker's `/v1/usage/history` when a broker is configured (falling back to the local agent DB), since broker deployments record usage history on the broker host
|
|
|
|
## [17.1.0] - 2026-07-24
|
|
|
|
### Fixed
|
|
|
|
- Fixed an issue where malformed persisted content blocks could abort stats ingestion for subsequent projects, and ensured pending full-session migrations are properly settled after successful backfills.
|
|
|
|
## [17.0.6] - 2026-07-20
|
|
|
|
### Changed
|
|
|
|
- Clarified overview token accounting by separating uncached input from cache reads and showing the conversation-token total used by the agent breakdown.
|
|
|
|
## [17.0.5] - 2026-07-18
|
|
|
|
### Fixed
|
|
|
|
- Fixed an EADDRINUSE error by properly reusing the live stats dashboard on the requested port and reclaiming stale listeners (#5970).
|
|
|
|
## [17.0.2] - 2026-07-17
|
|
|
|
### Fixed
|
|
|
|
- Fixed the Recent Errors list to honor the selected dashboard time range before returning the newest 50 failures.
|
|
|
|
## [16.4.7] - 2026-07-12
|
|
|
|
### Fixed
|
|
|
|
- Fixed a `SQLITE_CONSTRAINT_NOTNULL` crash (`messages.stop_reason`) aborting the entire session sync when a persisted assistant message lacks a `stopReason`. Malformed entries — missing stop reason, token counts, or message timestamp — are now coerced at the parser boundary, and entries with no usage or model attribution are skipped instead of failing the batch insert.
|
|
|
|
## [16.4.2] - 2026-07-10
|
|
|
|
### Fixed
|
|
|
|
- Fixed a crash during stats synchronization on legacy session entries that lack a cost breakdown by falling back to catalog pricing when available.
|
|
|
|
## [16.3.9] - 2026-07-06
|
|
|
|
### Changed
|
|
|
|
- Refined behavior metrics to significantly reduce false positives in profanity, yelling, and anguish detection by excluding technical terms (e.g., "dummy", "trash", "garbage"), neutral punctuation (e.g., dot runs), and single-word capitalization (e.g., filenames or environment variables).
|
|
- Re-categorized frustration interjections (such as "ugh", "argh", and "grr") from profanity to anguish.
|
|
- Improved negation and blame detection to exclude determiners (e.g., "no auto start") and compounds (e.g., "no-op") while adding support for phrases like "why did you" and "makes no sense".
|
|
- Added sad emoticons as a signal for anguish while excluding code-like patterns.
|
|
- Triggered a one-time automatic re-ingestion of sessions on the next database sync to apply the updated metrics.
|
|
|
|
## [16.3.7] - 2026-07-05
|
|
|
|
### Changed
|
|
|
|
- Optimized session-entry lookup and file reading performance by caching file metadata to avoid repeated full-file scans.
|
|
|
|
## [16.3.1] - 2026-07-02
|
|
|
|
### Added
|
|
|
|
- Added a Tools tab to the `omp stats` dashboard (`/#/tools`): per-tool call counts, error rates, result/argument payload sizes, per-model breakdown, and a stacked calls-over-time chart. Token and cost columns attribute each invoking turn's real provider usage evenly across that turn's tool calls. Existing databases re-parse sessions once on the next sync to backfill historical tool calls.
|
|
|
|
## [16.2.7] - 2026-06-30
|
|
|
|
### Fixed
|
|
|
|
- Improved premium request calculation accuracy by correctly accounting for specific model families.
|
|
|
|
## [16.2.6] - 2026-06-29
|
|
|
|
### Fixed
|
|
|
|
- Fixed application crashes and Bun aborts on macOS and when parsing large stats session files, including during `omp --smoke-test` runs, by utilizing a more resilient serial parser and lenient line scanner.
|
|
|
|
## [16.2.3] - 2026-06-28
|
|
|
|
### Added
|
|
|
|
- Support for parsing named advisor transcripts using the `__advisor.<slug>.jsonl` naming convention.
|
|
|
|
## [16.2.0] - 2026-06-27
|
|
|
|
### Added
|
|
|
|
- Added a Gain tab to the `omp stats` dashboard (`/#/gain`) to display snapcompact token-savings with project scoping from synced session folders.
|
|
|
|
## [16.1.17] - 2026-06-24
|
|
|
|
### Fixed
|
|
|
|
- Stats sync counted the same provider request multiple times when a forked or branched session file copied the parent's entries verbatim. Inserts now skip rows whose `(entry_id, timestamp)` already exists under a different `session_file`, and a one-shot migration on the next `omp stats` run collapses any pre-existing duplicates ([#3370](https://github.com/can1357/oh-my-pi/issues/3370)).
|
|
|
|
## [16.1.15] - 2026-06-22
|
|
|
|
### Added
|
|
|
|
- Added token usage breakdown by agent type (Main, Subagents, Advisor) to the overview dashboard
|
|
|
|
## [16.0.10] - 2026-06-18
|
|
|
|
### Changed
|
|
|
|
- Updated description of moderated content categories to use more inclusive terminology
|
|
|
|
### Fixed
|
|
|
|
- Wide data tables (Requests, Errors, Overview, Projects) overflowed the page horizontally at narrow-desktop widths (768-1023px): the `.stats-table-desktop-only` wrapper used for mobile-card tables lacked the `overflow-x: auto` containment that `.stats-table-container` already has. They now scroll within their own bounds instead of spilling the page body.
|
|
|
|
## [16.0.5] - 2026-06-17
|
|
|
|
### Added
|
|
|
|
- New Projects view summarizing usage, cost, and reliability per project folder (backed by the existing `/api/stats/folders` endpoint).
|
|
- System-aware light/dark theme toggle — follows the OS by default, and an explicit choice persists across reloads.
|
|
|
|
### Changed
|
|
|
|
- Redesigned the local stats dashboard with an OMP-themed product shell, dedicated per-section views, accessible loading/empty/error states, and flicker-free navigation between screens and time ranges.
|
|
|
|
### Fixed
|
|
|
|
- The 1h time-range chart rendered an empty/single-point line; it now buckets at 5-minute granularity for a real trend.
|
|
|
|
## [15.13.3] - 2026-06-15
|
|
|
|
### Changed
|
|
|
|
- Renamed `__omp_stats_sync_worker` to `__omp_worker_stats_sync`.
|
|
|
|
## [15.13.1] - 2026-06-15
|
|
|
|
### Fixed
|
|
|
|
- Dropped `git` from the profanity list so normal repository mentions no longer count as profanity
|
|
|
|
## [15.12.4] - 2026-06-13
|
|
|
|
### Fixed
|
|
|
|
- Fixed the stats dashboard's SQLite init never setting `PRAGMA busy_timeout`, so a concurrent `omp` startup hitting WAL recovery could crash `initDb()` with `SQLITE_BUSY` instead of waiting through it. The busy handler is now installed before `PRAGMA journal_mode=WAL` ([#2421](https://github.com/can1357/oh-my-pi/issues/2421)).
|
|
|
|
## [15.11.0] - 2026-06-10
|
|
|
|
### Added
|
|
|
|
- Added support for prebuilt npm bundle mode via `PI_BUNDLED`, allowing the stats server to use an embedded dashboard bundle in packaged CLI distributions
|
|
|
|
### Fixed
|
|
|
|
- Fixed handling of legacy `embedded-client.generated.txt` placeholder content so it is treated as missing archive instead of being decoded into invalid bytes
|
|
- Fixed ENOENT handling while scanning dashboard source/build directories so missing `client/` or `dist/client` trees no longer crash startup
|
|
|
|
## [15.10.11] - 2026-06-10
|
|
|
|
### Changed
|
|
|
|
- Bundled-model lookups (`getBundledModel`, `GeneratedProvider`) now import from the new `@oh-my-pi/pi-catalog` package instead of the `@oh-my-pi/pi-ai` barrel, which no longer re-exports catalog values
|
|
- The session-sync worker re-enters the host CLI entry (`workerHostEntry()` + `__omp_stats_sync_worker` argv selector) when running inside omp — source, npm bundle, or compiled binary — and keeps loading its own `sync-worker.ts` module directly for standalone `omp-stats`, bun test, and SDK hosts
|
|
|
|
## [15.1.6] - 2026-05-19
|
|
|
|
### Fixed
|
|
|
|
- Fixed `omp stats` crashing on first session sync in published `omp-{linux,darwin,windows}-*` binaries with `BuildMessage: ModuleNotFound resolving "./packages/stats/src/sync-worker.ts"`; the release build script now lists the stats sync, browser tab, and JS eval workers as explicit `--compile` entrypoints so Bun emits them into bunfs, matching the dev build script and the AGENTS.md worker spawn contract. ([#1150](https://github.com/can1357/oh-my-pi/issues/1150))
|
|
|
|
## [15.1.0] - 2026-05-15
|
|
|
|
### Fixed
|
|
|
|
- Fixed incremental `parseSessionFile(path, fromOffset)` losing the active service tier when resuming past a `service_tier_change` entry, so priority OpenAI replies appended after the offset are now credited with `premiumRequests: 1` (regression introduced by 13f59162e which stopped folding priority-tier into per-message premium counts)
|
|
|
|
## [15.0.1] - 2026-05-14
|
|
|
|
### Breaking Changes
|
|
|
|
- Raised the minimum required Bun version to >=1.3.14 in package metadata
|
|
|
|
### Changed
|
|
|
|
- Changed the "Premium Reqs" dashboard card to also include OpenAI priority service-tier requests (`serviceTier: "priority"`), counting each as 1 premium request alongside GitHub Copilot premium calls. Pre-existing sessions are backfilled on the next `omp stats` run: a one-shot `premium_requests_priority_v1` sentinel wipes `file_offsets` so every session re-parses, and `insertMessageStats` now `UPSERT`s `premium_requests` (other columns untouched) using the `service_tier_change` entries already in the session log to retroactively credit priority traffic.
|
|
|
|
## [14.9.9] - 2026-05-12
|
|
|
|
### Added
|
|
|
|
- Added separate input-token and output-token totals to the overview dashboard cards.
|
|
|
|
### Fixed
|
|
|
|
- Fixed `omp stats` in compiled binaries by using the serial sync path instead of spawning a raw file-asset worker that cannot import bundled parser code.
|
|
- Fixed behavior backfills after failed compiled-binary sync attempts by marking the backfill sentinel only after a successful full sync.
|
|
|
|
## [14.9.7] - 2026-05-12
|
|
|
|
### Breaking Changes
|
|
|
|
- Broke backward compatibility of behavior stats fields by replacing `yellingSentences`/`dramaRuns` with `yelling`/`anguish` and adding `negation`, `repetition`, `blame` in query result types and persisted `user_messages` schema
|
|
|
|
### Added
|
|
|
|
- Added `SyncOptions` to `syncAllSessions` with `onProgress` and `workers` to optionally show per-file sync progress and tune parser concurrency
|
|
- Added new frustration behavior metrics (`negation`, `repetition`, `blame`) plus a `frustration` aggregate in behavior charts, model tables, and summary cards
|
|
|
|
### Changed
|
|
|
|
- Changed sync ingestion to parse session files through a worker pool while applying parsed results and database writes on the main thread
|
|
- Changed behavior analysis to strip code blocks, XML/URLs, quoted lines, and placeholders before scoring and to suppress signals on long structured messages
|
|
- Changed dashboard metrics labels and totals to the new signal names, including replacing the old three-signal totals with `yelling`, `profanity`, `anguish`, and `frustration`
|
|
- Changed sync output to print a live terminal progress indicator while processing session files
|
|
|
|
### Fixed
|
|
|
|
- Fixed user-message attribution so assistant model/provider links are backfilled during incremental sync instead of being left unknown
|
|
- Fixed word-boundary regex handling in profanity detection so matching now works as intended in normal prose
|
|
|
|
## [14.9.5] - 2026-05-12
|
|
|
|
### Added
|
|
|
|
- Added time range selection options (1h, 24h, 7d, 30d, 90d, All) to the dashboard header and bound them to reloading statistics for the selected window
|
|
- Added a **Behavior** dashboard page that tracks user yelling (CAPS), profanity, and dramatic punctuation (`!!!` / `???`) per day, with by-model comparisons mirroring the cost page
|
|
- Added a per-model behavior table to the **Behavior** page mirroring the Models table: sortable rows of CAPS / profanity / drama hits per model with sparkline trend and an expandable per-model breakdown chart
|
|
- Added optional `range` query parameter support on stats endpoints to retrieve metrics scoped to a requested time window
|
|
|
|
### Changed
|
|
|
|
- Changed the Costs dashboard summary to report totals, average per day, and top model for the selected time range instead of a fixed 30-day window and removed the previous-30-day trend comparison
|
|
- Changed behavior metrics ingestion to compute yelling from user message sentence-level uppercase ratios, filtering out short uppercase fragments so the behavior data is attributed to messages more accurately
|
|
- Removed per-chart 14/30/90 day pickers on Costs and Behavior pages so every page obeys the single time-range selector in the header
|
|
- Changed dashboard and stats queries to return data from the selected time window instead of always using all-time aggregates
|
|
- Changed the default displayed range in the UI/API to last 24h
|
|
- Added support for returning all data when `range=all` is requested
|
|
|
|
### Fixed
|
|
|
|
- Fixed handling of unknown `range` values by falling back to the last 24h instead of returning unscoped data
|
|
- Fixed `omp stats` failing to build the client on globally-installed installs by promoting `tailwindcss` from `devDependencies` to `dependencies` (the client build runs at runtime)
|
|
|
|
## [14.5.4] - 2026-04-28
|
|
|
|
### Fixed
|
|
|
|
- Fixed GPT cost reporting by deriving missing OpenAI Codex costs from the model catalog and backfilling existing zero-cost rows.
|
|
|
|
## [13.6.0] - 2026-03-03
|
|
|
|
### Fixed
|
|
|
|
- Include subtask session files in usage stats ([#250](https://github.com/can1357/oh-my-pi/issues/250))
|