QA Decision Desk

Release decisions

Both projects are on Hold: approval is paused, and they will be retested after the revamp launches.

Holdcex-market-data-quality-labApproval on hold; the approval expired on 2026-09-08 23:59 (Taipei time).
Holdsanyoii.github.ioApproval on hold; the approval expired on 2026-09-13 20:40 (Taipei time).

HoldHold: not approved for release for now.

Show decision detailsCollapse

HoldArchived democex-market-data-quality-lab
Decision makerWilliam
Decision date2026-09-07 23:11 (Taipei time)
Expiry2026-09-08 23:59 (Taipei time)
Next stepDo not re-approve in this revision. Retest after the revamp launches and record a new approval period; keep the historical approval.
HoldArchived demosanyoii.github.io
Decision makerWilliam
Decision date2026-09-06 20:51 (Taipei time)
Expiry2026-09-13 20:40 (Taipei time)
Next stepDo not re-approve in this revision. Retest after the revamp launches and record a new approval period; keep the historical approval.

Pinned snapshot: 2026-09-07 · SHA fc1e060 & 643b017 · expired self-review, not a current Go

computed on 2026-10-29

PART 1 · PINNED RELEASE RUN TELEMETRY MATRIX (SEPT 6–7 JUNIT ARTIFACTS)6 Reviewed Runs · 67 Active Checks

Click any Run ID to jump to its per-test JUnit breakdown below

Run ID (Jump)	Repository & Tested SHA	Executed At	Sanitized Command	Result	Original JUnit SHA-256
RUN-20260906-cex-deterministic-1 ↓	cex-market-data-quality-lab `@fc1e060` Windows; Python 3.14.2; public Binance market-data endpoints; automated checks only	`2026-09-06 12:40:02 UTC`	`python -m pytest tests/unit tests/contract tests/meta -v -p no:cacheprovider`	● 40/40 PASS	`b836c58969…20253e`
RUN-20260906-cex-live-1 ↓	cex-market-data-quality-lab `@fc1e060` Windows; Python 3.14.2; public Binance market-data endpoints; automated checks only	`2026-09-06 12:40:37 UTC`	`python -m pytest tests/live -v -m live -p no:cacheprovider`	● 5/5 PASS	`4530c5f358…02c50c`
RUN-20260907-cex-deterministic-1 ↓	cex-market-data-quality-lab `@fc1e060` Windows; Python 3.14.2; public Binance market-data endpoints; automated checks only	`2026-09-07 15:09:50 UTC`	`python -m pytest tests/unit tests/contract tests/meta -v -p no:cacheprovider --junitxml=raw/deterministic.xml`	● 40/40 PASS	`ba95af23b5…063249`
RUN-20260907-cex-live-1 ↓	cex-market-data-quality-lab `@fc1e060` Windows; Python 3.14.2; public Binance market-data endpoints; automated checks only	`2026-09-07 15:10:26 UTC`	`python -m pytest tests/live -v -m live -p no:cacheprovider --junitxml=raw/live.xml`	● 5/5 PASS	`4ac2bb8b66…7ca28b`
RUN-20260906-portfolio-chromium-initial ↓	sanyoii.github.io `@643b017` Windows; Python 3.14.2; local HTTP server; Chromium via Playwright; not production	`2026-09-06 12:40:06 UTC`	`python -m pytest tests -v -p no:cacheprovider`	▲ BLOCKED (9/22)	`0eacce992c…c430a0`
RUN-20260906-portfolio-chromium-retry ↓	sanyoii.github.io `@643b017` Windows; Python 3.14.2; local HTTP server; Chromium via Playwright; not production	`2026-09-06 12:41:05 UTC`	`python -m pytest tests -v -p no:cacheprovider (elevated browser execution)`	● 22/22 PASS	`7df49109c2…04d1e1`

cex-market-data-quality-lab

SHA fc1e0604f962

▸ Expand Tested Scope, Exclusions & Review MetadataMetadata

Tested version: fc1e0604f96206e1f9dbbc58308031b5ff2f4c4f
Review: William · Owner self-review; overlapping roles disclosed
Decision recorded: 2026-09-07T15:11:54.526Z
Approval expiry: 2026-09-08T23:59:00+08:00
In scope: Unit and REST/WebSocket contract checks · Documentation consistency · Public market-data live integration
Excluded: Human manual testing · Authenticated accounts, orders and funds · Production trading-system certification · Load and production reconnect testing

RUN-20260906-cex-deterministic-1 · Pass40/40 passed

Executed at: 2026-09-06T12:40:02.275Z
Environment: Windows; Python 3.14.2; public Binance market-data endpoints; automated checks only
Command: python -m pytest tests/unit tests/contract tests/meta -v -p no:cacheprovider
Execution note: Recorded execution; not a new run or independent review.
Original JUnit SHA-256: b836c589694947da419047afc22539819568ec1df7aa9ec423b888623420253e

Sanitized per-test results derived from the original JUnit artifact; raw environment output is not published.

Test	Result
tests.unit.test_order_book::tests.unit.test_order_book	Pass
tests.unit.test_order_book::tests.unit.test_order_book	Pass
tests.unit.test_order_book::tests.unit.test_order_book	Pass
tests.unit.test_order_book::tests.unit.test_order_book	Pass
tests.unit.test_order_book::tests.unit.test_order_book	Pass
tests.unit.test_order_book::tests.unit.test_order_book	Pass
tests.unit.test_order_book::tests.unit.test_order_book	Pass
tests.unit.test_order_book::tests.unit.test_order_book	Pass
tests.unit.test_order_book::tests.unit.test_order_book	Pass
tests.unit.test_order_book::tests.unit.test_order_book	Pass
tests.unit.test_order_book::tests.unit.test_order_book	Pass
tests.unit.test_order_book::tests.unit.test_order_book	Pass
tests.contract.test_rest_contract::tests.contract.test_rest_contract	Pass
tests.contract.test_rest_contract::tests.contract.test_rest_contract	Pass
tests.contract.test_rest_contract::tests.contract.test_rest_contract	Pass
tests.contract.test_rest_contract::tests.contract.test_rest_contract	Pass
tests.contract.test_rest_contract::tests.contract.test_rest_contract	Pass
tests.contract.test_rest_contract::tests.contract.test_rest_contract	Pass
tests.contract.test_rest_contract::tests.contract.test_rest_contract	Pass
tests.contract.test_rest_contract::tests.contract.test_rest_contract	Pass
tests.contract.test_rest_contract::tests.contract.test_rest_contract	Pass
tests.contract.test_rest_contract::tests.contract.test_rest_contract	Pass
tests.contract.test_rest_contract::tests.contract.test_rest_contract	Pass
tests.contract.test_websocket_contract::tests.contract.test_websocket_contract	Pass
tests.contract.test_websocket_contract::tests.contract.test_websocket_contract	Pass
tests.contract.test_websocket_contract::tests.contract.test_websocket_contract	Pass
tests.contract.test_websocket_contract::tests.contract.test_websocket_contract	Pass
tests.contract.test_websocket_contract::tests.contract.test_websocket_contract	Pass
tests.contract.test_websocket_contract::tests.contract.test_websocket_contract	Pass
tests.contract.test_websocket_contract::tests.contract.test_websocket_contract	Pass
tests.contract.test_websocket_contract::tests.contract.test_websocket_contract	Pass
tests.contract.test_websocket_contract::tests.contract.test_websocket_contract	Pass
tests.contract.test_websocket_contract::tests.contract.test_websocket_contract	Pass
tests.contract.test_websocket_contract::tests.contract.test_websocket_contract	Pass
tests.contract.test_websocket_contract::tests.contract.test_websocket_contract	Pass
tests.meta.test_documentation_contract::tests.meta.test_documentation_contract	Pass
tests.meta.test_documentation_contract::tests.meta.test_documentation_contract	Pass
tests.meta.test_documentation_contract::tests.meta.test_documentation_contract	Pass
tests.meta.test_documentation_contract::tests.meta.test_documentation_contract	Pass
tests.meta.test_documentation_contract::tests.meta.test_documentation_contract	Pass

RUN-20260906-cex-live-1 · Pass5/5 passed

Executed at: 2026-09-06T12:40:37.272Z
Environment: Windows; Python 3.14.2; public Binance market-data endpoints; automated checks only
Command: python -m pytest tests/live -v -m live -p no:cacheprovider
Execution note: Recorded execution; not a new run or independent review.
Original JUnit SHA-256: 4530c5f35881149d0075137960bd0fc62854f1a46c133c952a862f198f02c50c

Sanitized per-test results derived from the original JUnit artifact; raw environment output is not published.

Test	Result
tests.live.test_rest_live::tests.live.test_rest_live	Pass
tests.live.test_rest_live::tests.live.test_rest_live	Pass
tests.live.test_rest_live::tests.live.test_rest_live	Pass
tests.live.test_websocket_live::tests.live.test_websocket_live	Pass
tests.live.test_websocket_live::tests.live.test_websocket_live	Pass

RUN-20260907-cex-deterministic-1 · Pass40/40 passed

Executed at: 2026-09-07T15:09:50.847Z
Environment: Windows; Python 3.14.2; public Binance market-data endpoints; automated checks only
Command: python -m pytest tests/unit tests/contract tests/meta -v -p no:cacheprovider --junitxml=raw/deterministic.xml
Execution note: Fresh execution on 2026-09-07 for the owner-authorized scoped renewal; not independent review.
Original JUnit SHA-256: ba95af23b5c22d8a190e7d6121e8dd740cbd639f84a7e2dfebd1bdc1fd063249

Sanitized per-test results derived from the original JUnit artifact; raw environment output is not published.

Test	Result
tests.unit.test_order_book::tests.unit.test_order_book	Pass
tests.unit.test_order_book::tests.unit.test_order_book	Pass
tests.unit.test_order_book::tests.unit.test_order_book	Pass
tests.unit.test_order_book::tests.unit.test_order_book	Pass
tests.unit.test_order_book::tests.unit.test_order_book	Pass
tests.unit.test_order_book::tests.unit.test_order_book	Pass
tests.unit.test_order_book::tests.unit.test_order_book	Pass
tests.unit.test_order_book::tests.unit.test_order_book	Pass
tests.unit.test_order_book::tests.unit.test_order_book	Pass
tests.unit.test_order_book::tests.unit.test_order_book	Pass
tests.unit.test_order_book::tests.unit.test_order_book	Pass
tests.unit.test_order_book::tests.unit.test_order_book	Pass
tests.contract.test_rest_contract::tests.contract.test_rest_contract	Pass
tests.contract.test_rest_contract::tests.contract.test_rest_contract	Pass
tests.contract.test_rest_contract::tests.contract.test_rest_contract	Pass
tests.contract.test_rest_contract::tests.contract.test_rest_contract	Pass
tests.contract.test_rest_contract::tests.contract.test_rest_contract	Pass
tests.contract.test_rest_contract::tests.contract.test_rest_contract	Pass
tests.contract.test_rest_contract::tests.contract.test_rest_contract	Pass
tests.contract.test_rest_contract::tests.contract.test_rest_contract	Pass
tests.contract.test_rest_contract::tests.contract.test_rest_contract	Pass
tests.contract.test_rest_contract::tests.contract.test_rest_contract	Pass
tests.contract.test_rest_contract::tests.contract.test_rest_contract	Pass
tests.contract.test_websocket_contract::tests.contract.test_websocket_contract	Pass
tests.contract.test_websocket_contract::tests.contract.test_websocket_contract	Pass
tests.contract.test_websocket_contract::tests.contract.test_websocket_contract	Pass
tests.contract.test_websocket_contract::tests.contract.test_websocket_contract	Pass
tests.contract.test_websocket_contract::tests.contract.test_websocket_contract	Pass
tests.contract.test_websocket_contract::tests.contract.test_websocket_contract	Pass
tests.contract.test_websocket_contract::tests.contract.test_websocket_contract	Pass
tests.contract.test_websocket_contract::tests.contract.test_websocket_contract	Pass
tests.contract.test_websocket_contract::tests.contract.test_websocket_contract	Pass
tests.contract.test_websocket_contract::tests.contract.test_websocket_contract	Pass
tests.contract.test_websocket_contract::tests.contract.test_websocket_contract	Pass
tests.contract.test_websocket_contract::tests.contract.test_websocket_contract	Pass
tests.meta.test_documentation_contract::tests.meta.test_documentation_contract	Pass
tests.meta.test_documentation_contract::tests.meta.test_documentation_contract	Pass
tests.meta.test_documentation_contract::tests.meta.test_documentation_contract	Pass
tests.meta.test_documentation_contract::tests.meta.test_documentation_contract	Pass
tests.meta.test_documentation_contract::tests.meta.test_documentation_contract	Pass

RUN-20260907-cex-live-1 · Pass5/5 passed

Executed at: 2026-09-07T15:10:26.443Z
Environment: Windows; Python 3.14.2; public Binance market-data endpoints; automated checks only
Command: python -m pytest tests/live -v -m live -p no:cacheprovider --junitxml=raw/live.xml
Execution note: Fresh execution on 2026-09-07 for the owner-authorized scoped renewal; not independent review.
Original JUnit SHA-256: 4ac2bb8b66cdeae5e2584583734f8c6ab856f83cc336d49eb8cdb2fcb67ca28b

Sanitized per-test results derived from the original JUnit artifact; raw environment output is not published.

Test	Result
tests.live.test_rest_live::tests.live.test_rest_live	Pass
tests.live.test_rest_live::tests.live.test_rest_live	Pass
tests.live.test_rest_live::tests.live.test_rest_live	Pass
tests.live.test_websocket_live::tests.live.test_websocket_live	Pass
tests.live.test_websocket_live::tests.live.test_websocket_live	Pass

sanyoii.github.io

SHA 643b01720959

▸ Expand Tested Scope, Exclusions & Review MetadataMetadata

Tested version: 643b01720959dad2b1ccc9c8fcbe4f493f89bf0b
Review: William · Owner self-review; overlapping roles disclosed
Decision recorded: 2026-09-06T12:51:34.447Z
Approval expiry: 2026-09-13T20:40:00+08:00
In scope: Static content and document checks · English and Traditional Chinese behavior · Responsive Chromium layouts · Reduced motion and 404 behavior
Excluded: Fresh production-site verification · Browsers other than Chromium · Performance testing · Full accessibility conformance certification

RUN-20260906-portfolio-chromium-initial · Blocked9/22 passed

Executed at: 2026-09-06T12:40:06.379Z
Environment: Windows; Python 3.14.2; local HTTP server; Chromium via Playwright; not production
Command: python -m pytest tests -v -p no:cacheprovider
Execution note: Chromium launch blocked by spawn EPERM. Retained before the elevated retry.
Original JUnit SHA-256: 0eacce992cc5313ba590fc34724c9cf83c5c3d89c6ef72eef658214348c430a0

Sanitized per-test results derived from the original JUnit artifact; raw environment output is not published.

Test	Result
tests.test_runtime::tests.test_runtime	Blocked
tests.test_runtime::tests.test_runtime	Blocked
tests.test_runtime::tests.test_runtime	Blocked
tests.test_runtime::tests.test_runtime	Blocked
tests.test_runtime::tests.test_runtime	Blocked
tests.test_runtime::tests.test_runtime	Blocked
tests.test_runtime::tests.test_runtime	Blocked
tests.test_runtime::tests.test_runtime	Blocked
tests.test_runtime::tests.test_runtime	Blocked
tests.test_runtime::tests.test_runtime	Blocked
tests.test_runtime::tests.test_runtime	Blocked
tests.test_runtime::tests.test_runtime	Blocked
tests.test_runtime::tests.test_runtime	Blocked
tests.test_static::tests.test_static	Pass
tests.test_static::tests.test_static	Pass
tests.test_static::tests.test_static	Pass
tests.test_static::tests.test_static	Pass
tests.test_static::tests.test_static	Pass
tests.test_static::tests.test_static	Pass
tests.test_static::tests.test_static	Pass
tests.test_static::tests.test_static	Pass
tests.test_static::tests.test_static	Pass

RUN-20260906-portfolio-chromium-retry · Pass22/22 passed

Executed at: 2026-09-06T12:41:05.513Z
Environment: Windows; Python 3.14.2; local HTTP server; Chromium via Playwright; not production
Command: python -m pytest tests -v -p no:cacheprovider (elevated browser execution)
Execution note: Elevated retry; original blocked attempt retained.
Original JUnit SHA-256: 7df49109c2efdd1cb32d7bb86ac2726ba9bd8463cc68a018fc52f229b504d1e1

Sanitized per-test results derived from the original JUnit artifact; raw environment output is not published.

Test	Result
tests.test_runtime::tests.test_runtime	Pass
tests.test_runtime::tests.test_runtime	Pass
tests.test_runtime::tests.test_runtime	Pass
tests.test_runtime::tests.test_runtime	Pass
tests.test_runtime::tests.test_runtime	Pass
tests.test_runtime::tests.test_runtime	Pass
tests.test_runtime::tests.test_runtime	Pass
tests.test_runtime::tests.test_runtime	Pass
tests.test_runtime::tests.test_runtime	Pass
tests.test_runtime::tests.test_runtime	Pass
tests.test_runtime::tests.test_runtime	Pass
tests.test_runtime::tests.test_runtime	Pass
tests.test_runtime::tests.test_runtime	Pass
tests.test_static::tests.test_static	Pass
tests.test_static::tests.test_static	Pass
tests.test_static::tests.test_static	Pass
tests.test_static::tests.test_static	Pass
tests.test_static::tests.test_static	Pass
tests.test_static::tests.test_static	Pass
tests.test_static::tests.test_static	Pass
tests.test_static::tests.test_static	Pass
tests.test_static::tests.test_static	Pass

PART 2 · INTERACTIVE CANONICAL TEST CASE WORKBENCH (SINGLE DEDUPLICATED CATALOG)OB · REST · WS · DOC · LIVE · MTC

Click any module tab below to filter test cases without scrolling through duplicate run tables

Order book (9 Test Cases)

9 SPECS

Test Case ID	Case priority	Verification Check	Expected Result
`OB-001`	`case P1`	Create an unsorted order book and read the best bid and ask.	Return the highest bid and lowest ask while preserving Decimal precision.
`OB-002`	`case P0`	Apply sequential updates that add levels and set quantities to zero.	Add levels, remove zero-quantity levels, and advance the update ID to 101.
`OB-003`	`case P0`	Apply a stale event to the current order book.	Return False without changing the update ID or visible levels.
`OB-004`	`case P0`	Apply an event with a sequence gap.	Raise SequenceGapError before changing any data.
`OB-005`	`case P0`	Create an order book from a crossed snapshot where the bid exceeds the ask.	Raise MarketInvariantError and retain the bid and ask details.
`OB-006`	`case P0`	Synchronize a snapshot with a stale event and sequential events.	Skip the stale event and apply sequentially through update 102.
`OB-007`	`case P0`	Create snapshots with zero price, zero quantity, and negative quantity.	Raise MarketInvariantError for every invalid dataset.
`OB-008`	`case P0`	Apply a negative-quantity update to a valid order book.	Raise MarketInvariantError; zero remains the only value that removes a level.
`OB-009`	`case P0`	Create an order book from a snapshot missing bids or asks.	Raise MarketInvariantError because both market sides must be present.

Synthetic example / Not current CEX evidence

How a Test Fail appears in Run Records

Fail Demo

WebSocket ordering checks

Fail 3 Test Cases · 2 Pass · 1 Fail

Run ID link

Expected

The stale sequence is rejected

Actual

The stale sequence overwrites current state

Defect

DEF-MDQ-004 · S1 · Triaged · demo

View full Failure, Defect, and Execution Log

Historical pilot · August 17

These are sanitized Run records without per-case raw output.

Open Failure Demo

Post-fix execution — Historical

Automated tests

Pass 39 automated checks covering 34 logical Test Case IDs

Order book (9 Test Cases)

Test Case	Case priority	Check	Expected result
OB-001	P1	Create an unsorted order book and read the best bid and ask.	Return the highest bid and lowest ask while preserving Decimal precision.
OB-002	P0	Apply sequential updates that add levels and set quantities to zero.	Add levels, remove zero-quantity levels, and advance the update ID to 101.
OB-003	P0	Apply a stale event to the current order book.	Return False without changing the update ID or visible levels.
OB-004	P0	Apply an event with a sequence gap.	Raise SequenceGapError before changing any data.
OB-005	P0	Create an order book from a crossed snapshot where the bid exceeds the ask.	Raise MarketInvariantError and retain the bid and ask details.
OB-006	P0	Synchronize a snapshot with a stale event and sequential events.	Skip the stale event and apply sequentially through update 102.
OB-007	P0	Create snapshots with zero price, zero quantity, and negative quantity.	Raise MarketInvariantError for every invalid dataset.
OB-008	P0	Apply a negative-quantity update to a valid order book.	Raise MarketInvariantError; zero remains the only value that removes a level.
OB-009	P0	Create an order book from a snapshot missing bids or asks.	Raise MarketInvariantError because both market sides must be present.

REST contract (9 Test Cases)

Test Case	Case priority	Check	Expected result
REST-001	P1	Fetch bookTicker with a lowercase symbol and inspect the request and response.	Send BTCUSDT and return a normalized symbol with Decimal values.
REST-002	P0	Handle a ticker whose bid exceeds its ask.	Reject crossed market data with RestContractError.
REST-003	P1	Fetch depth for btcusdt with limit 5.	Send normalized parameters and return only after validating the snapshot.
REST-004	P1	Request an unknown symbol and inspect the error.	Preserve HTTP 400, exchange code -1121, and the message.
REST-005	P1	Fetch exchangeInfo for one symbol.	Return BTCUSDT, TRADING, PRICE_FILTER, and LOT_SIZE.
REST-006	P0	Handle a ticker with a zero bid quantity.	Reject non-positive values with RestContractError.
REST-007	P1	Handle exchangeInfo returning zero or two symbols.	Raise RestContractError unless exactly one symbol is returned.
REST-008	P1	Handle ticker payloads with missing fields or a non-object shape.	Raise RestContractError with a stable schema message.
REST-009	P1	Simulate a REST transport timeout.	Preserve the httpx.ReadTimeout type and original message.

WebSocket contract (12 Test Cases)

Test Case	Case priority	Check	Expected result
WS-001	P1	Subscribe to one ticker and inspect control messages and the event.	Subscribe, validate, and unsubscribe with request IDs 1 and 2 matched correctly.
WS-002	P0	Receive update ID 101 after update ID 102.	Raise WebSocketContractError when the update ID goes backward.
WS-003	P1	Expect BTCUSDT but receive ETHUSDT.	Reject the wrong symbol and include the expected and actual values.
WS-004	P0	Receive an event whose quantity is zero.	Reject non-positive price or quantity values.
WS-005	P0	Receive an event whose bid exceeds its ask.	Reject crossed market data.
WS-006	P1	Expect acknowledgment ID 1 but receive 99.	Reject the mismatched acknowledgment.
WS-007	P1	Receive a market event after unsubscribe but before its acknowledgment.	Ignore the in-flight event and complete after the correct acknowledgment.
WS-008	P0	Synchronize REST snapshot 100 with stale and sequential events.	Return a synchronized order book at update 102 with the expected levels.
WS-009	P1	Wait for a slow connection with a 0.01-second timeout.	Raise TimeoutError within the configured limit.
WS-010	P1	Receive malformed JSON after subscribing.	Raise WebSocketContractError with a message that identifies invalid JSON.
WS-011	P1	Receive a JSON array after subscribing.	Reject it because protocol payloads must be objects.
WS-012	P1	Receive a valid acknowledgment followed by a ticker missing field A.	Raise WebSocketContractError with a stable schema message.

Documentation contract (4 Test Cases)

Test Case	Case priority	Check	Expected result
DOC-001	P1	Compare requirement IDs in the requirements and traceability documents.	Both documents contain the same set of requirement IDs.
DOC-002	P1	Compare Test Cases, the Automation Map, and pytest functions.	Every logical Case ID maps to an existing pytest function.
DOC-003	P2	Resolve relative links in Markdown.	Every relative link points to an existing path.
DOC-004	P0	Inspect base URLs, endpoint paths, and CI settings.	Only allowlisted public market-data interfaces are used; no account or trading interfaces appear.

Live market-data tests

Pass 5 Live market-data checks

Live market data (5 Test Cases)

Test Case	Case priority	Check	Expected result
LIVE-REST-001	P1	Fetch BTCUSDT exchangeInfo from public REST.	The symbol is trading and includes price and quantity filters.
LIVE-REST-002	P1	Fetch the BTCUSDT book ticker from public REST.	Quantities are positive and the best bid does not exceed the best ask.
LIVE-REST-003	P1	Fetch BTCUSDT depth with limit 100 and create an order book.	The update ID is positive and the order-book state is valid.
LIVE-WS-001	P1	Subscribe to public WebSocket, collect three events, then unsubscribe.	All three events are valid and update IDs never move backward.
LIVE-SYNC-001	P0	Synchronize a public REST snapshot with a WebSocket depth stream.	The order book synchronizes without crossing and has a positive update ID.

Manual checks

Pass 2 manual checks

Manual checks (2 Test Cases in this Run)

Test Case	Case priority	Check	Expected result
MTC-SAFE-001	P0	Inspect REST/WebSocket URLs, headers, variables, and authentication settings.	Only public allowlisted hosts are used; there are no credentials, authorization headers, account endpoints, or trading actions.
MTC-EVID-001	P1	Compare Run records with executed cases, record paths, defects, retries, warnings, and limitations.	Every executed case has a status and actual result; missing required records prevent a manual-pass claim.

Earlier execution — Not used

Automated tests

Pass 39 automated checks covering 34 logical Test Case IDs

Order book (9 Test Cases)

Test Case	Case priority	Check	Expected result
OB-001	P1	Create an unsorted order book and read the best bid and ask.	Return the highest bid and lowest ask while preserving Decimal precision.
OB-002	P0	Apply sequential updates that add levels and set quantities to zero.	Add levels, remove zero-quantity levels, and advance the update ID to 101.
OB-003	P0	Apply a stale event to the current order book.	Return False without changing the update ID or visible levels.
OB-004	P0	Apply an event with a sequence gap.	Raise SequenceGapError before changing any data.
OB-005	P0	Create an order book from a crossed snapshot where the bid exceeds the ask.	Raise MarketInvariantError and retain the bid and ask details.
OB-006	P0	Synchronize a snapshot with a stale event and sequential events.	Skip the stale event and apply sequentially through update 102.
OB-007	P0	Create snapshots with zero price, zero quantity, and negative quantity.	Raise MarketInvariantError for every invalid dataset.
OB-008	P0	Apply a negative-quantity update to a valid order book.	Raise MarketInvariantError; zero remains the only value that removes a level.
OB-009	P0	Create an order book from a snapshot missing bids or asks.	Raise MarketInvariantError because both market sides must be present.

REST contract (9 Test Cases)

Test Case	Case priority	Check	Expected result
REST-001	P1	Fetch bookTicker with a lowercase symbol and inspect the request and response.	Send BTCUSDT and return a normalized symbol with Decimal values.
REST-002	P0	Handle a ticker whose bid exceeds its ask.	Reject crossed market data with RestContractError.
REST-003	P1	Fetch depth for btcusdt with limit 5.	Send normalized parameters and return only after validating the snapshot.
REST-004	P1	Request an unknown symbol and inspect the error.	Preserve HTTP 400, exchange code -1121, and the message.
REST-005	P1	Fetch exchangeInfo for one symbol.	Return BTCUSDT, TRADING, PRICE_FILTER, and LOT_SIZE.
REST-006	P0	Handle a ticker with a zero bid quantity.	Reject non-positive values with RestContractError.
REST-007	P1	Handle exchangeInfo returning zero or two symbols.	Raise RestContractError unless exactly one symbol is returned.
REST-008	P1	Handle ticker payloads with missing fields or a non-object shape.	Raise RestContractError with a stable schema message.
REST-009	P1	Simulate a REST transport timeout.	Preserve the httpx.ReadTimeout type and original message.

WebSocket contract (12 Test Cases)

Test Case	Case priority	Check	Expected result
WS-001	P1	Subscribe to one ticker and inspect control messages and the event.	Subscribe, validate, and unsubscribe with request IDs 1 and 2 matched correctly.
WS-002	P0	Receive update ID 101 after update ID 102.	Raise WebSocketContractError when the update ID goes backward.
WS-003	P1	Expect BTCUSDT but receive ETHUSDT.	Reject the wrong symbol and include the expected and actual values.
WS-004	P0	Receive an event whose quantity is zero.	Reject non-positive price or quantity values.
WS-005	P0	Receive an event whose bid exceeds its ask.	Reject crossed market data.
WS-006	P1	Expect acknowledgment ID 1 but receive 99.	Reject the mismatched acknowledgment.
WS-007	P1	Receive a market event after unsubscribe but before its acknowledgment.	Ignore the in-flight event and complete after the correct acknowledgment.
WS-008	P0	Synchronize REST snapshot 100 with stale and sequential events.	Return a synchronized order book at update 102 with the expected levels.
WS-009	P1	Wait for a slow connection with a 0.01-second timeout.	Raise TimeoutError within the configured limit.
WS-010	P1	Receive malformed JSON after subscribing.	Raise WebSocketContractError with a message that identifies invalid JSON.
WS-011	P1	Receive a JSON array after subscribing.	Reject it because protocol payloads must be objects.
WS-012	P1	Receive a valid acknowledgment followed by a ticker missing field A.	Raise WebSocketContractError with a stable schema message.

Documentation contract (4 Test Cases)

Test Case	Case priority	Check	Expected result
DOC-001	P1	Compare requirement IDs in the requirements and traceability documents.	Both documents contain the same set of requirement IDs.
DOC-002	P1	Compare Test Cases, the Automation Map, and pytest functions.	Every logical Case ID maps to an existing pytest function.
DOC-003	P2	Resolve relative links in Markdown.	Every relative link points to an existing path.
DOC-004	P0	Inspect base URLs, endpoint paths, and CI settings.	Only allowlisted public market-data interfaces are used; no account or trading interfaces appear.

Live market-data tests

Pass 5 Live market-data checks

Live market data (5 Test Cases)

Test Case	Case priority	Check	Expected result
LIVE-REST-001	P1	Fetch BTCUSDT exchangeInfo from public REST.	The symbol is trading and includes price and quantity filters.
LIVE-REST-002	P1	Fetch the BTCUSDT book ticker from public REST.	Quantities are positive and the best bid does not exceed the best ask.
LIVE-REST-003	P1	Fetch BTCUSDT depth with limit 100 and create an order book.	The update ID is positive and the order-book state is valid.
LIVE-WS-001	P1	Subscribe to public WebSocket, collect three events, then unsubscribe.	All three events are valid and update IDs never move backward.
LIVE-SYNC-001	P0	Synchronize a public REST snapshot with a WebSocket depth stream.	The order book synchronizes without crossing and has a positive update ID.

Manual checks

Pass 2 manual checks

Manual checks (2 Test Cases in this Run)

Test Case	Case priority	Check	Expected result
MTC-SAFE-001	P0	Inspect REST/WebSocket URLs, headers, variables, and authentication settings.	Only public allowlisted hosts are used; there are no credentials, authorization headers, account endpoints, or trading actions.
MTC-EVID-001	P1	Compare Run records with executed cases, record paths, defects, retries, warnings, and limitations.	Every executed case has a status and actual result; missing required records prevent a manual-pass claim.