mirror of
https://github.com/permissionlesstech/bitchat.git
synced 2026-07-25 07:25:19 +00:00
Package.swift's .process("Noise") resource claim silently excluded all
of bitchatTests/Noise/ from compilation since Oct 2025 - including a
complete official-vector runner (cacophony + snow XX transcripts,
transport messages, handshake hash, byte-identical to upstream).
Narrowing the resource to the JSON file and loading via Bundle.module
brings 51 Noise tests back to life, with a guard asserting each
vector's protocol name matches the app's.
CI gains a performance floor gate: perf-floors.json carries deliberately
generous floors (~25% of measured throughput) that catch algorithmic
regressions without flaking on runner variance; PERF lines reach the
gate via an O_APPEND side-channel file since swift test --parallel
swallows passing tests' stdout.
Tests are now hermetic: FavoritesPersistenceService uses an in-memory
keychain under test (fixes the securityd hang that blocked pipeline
benchmarks locally) and read-receipt persistence uses a wiped scratch
UserDefaults suite instead of .standard.
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
42 lines
1.7 KiB
JSON
42 lines
1.7 KiB
JSON
{
|
|
"_philosophy": [
|
|
"Floor throughputs for the PERF[...] lines printed by PerformanceBaselineTests.",
|
|
"Floors catch algorithmic regressions (O(n) -> O(n^2), accidental sync I/O,",
|
|
"quadratic re-scans), NOT tuning noise: each floor is deliberately set at",
|
|
"~25% of the throughput measured on a local dev machine (2026-06, Apple",
|
|
"Silicon), leaving ~4x headroom for CI runner variance so the gate never",
|
|
"flakes on a slow runner while still failing loudly on order-of-magnitude",
|
|
"regressions.",
|
|
"Raise floors deliberately after intentional performance improvements;",
|
|
"lower them only with a written justification in the PR. If a benchmark is",
|
|
"renamed or removed, update this file in the same change - the gate fails",
|
|
"when a floored benchmark stops reporting.",
|
|
"Checked by scripts/check-perf-floors.sh against captured swift-test output."
|
|
],
|
|
"_units": "operations per second, matching each benchmark's PERF line",
|
|
"_reference_local_numbers_2026_06": {
|
|
"nostrInbound.fresh": 2132,
|
|
"nostrInbound.duplicate": 2558907,
|
|
"bleInbound.roundTripAndDedup": 38063,
|
|
"gcs.buildAndDecode": 776,
|
|
"delivery.incrementalUpdate": 172615,
|
|
"delivery.storeUpdate": 158862,
|
|
"formatting.formatMessage": 12261,
|
|
"pipeline.privateIngest": 24848,
|
|
"pipeline.publicIngest": 13102,
|
|
"store.append": 213201
|
|
},
|
|
"floors": {
|
|
"nostrInbound.fresh": 530,
|
|
"nostrInbound.duplicate": 600000,
|
|
"bleInbound.roundTripAndDedup": 9500,
|
|
"gcs.buildAndDecode": 190,
|
|
"delivery.incrementalUpdate": 43000,
|
|
"delivery.storeUpdate": 39000,
|
|
"formatting.formatMessage": 3000,
|
|
"pipeline.privateIngest": 6000,
|
|
"pipeline.publicIngest": 3200,
|
|
"store.append": 53000
|
|
}
|
|
}
|