genesiscode2026/genesis-prompt-regression-harness · v1.0.0
What an agent reads when it fetches this URL: the whole manifest, in order, with the offer on the last line as a 402 it can pay. Nothing here is a button — an agent does not click, it signs. The page a person reads is here.
Pack · 4 scripts · 4 test files · 5 docs · 1 config file · 1 asset · 1 other file · 16 files · text 18 kB · binary 222 B (1%) · Python 100% · MIT, resale permitted
scan passed 2026-09-17 · scanner 2026.09.1 · 1 release · last release today · 13% of files seen elsewhere
computed 2026-09-17 11:49 UTC · analyzer 0.1.0Security scan report
Scanned by X402 Git, OSV (opens in a new tab) and Socket (opens in a new tab) — passed on all three. Findings from X402 Git and Socket are listed below.
- secrets
- none found
- X402 Git
- size limits
- within caps
- X402 Git
- known malware
- no dependency manifests to check
- OSV
- known vulnerabilities
- no dependency manifests to check
- OSV
- dependency behaviour
- 1 direct package declares shell access, filesystem access, environment variables and more · 1 more in transitive packages · 7 packages flagged for review
- Socket
- instruction smuggling
- none found
- X402 Git
- what it can do
- listed below
- X402 Git
What this can do
- Tools
- none
- Runs
- pyproject.toml ([build-system])
- bin/genesis-prompt-harness
- genesis_prompt_harness/__main__.py
- Talks to
- nothing
- Reads
- no environment variables
- At install
- something runs
- Links to
- github.com
- img.shields.io
- keepachangelog.com
- semver.org
Findings (23)
- MODERATEpyproject.toml — [build-system] runs when this is installed
- MODERATEsetuptools 84.0.0 (dev only) — setuptools 84.0.0 (direct, dev only) — ships compiled native code
- MODERATEsetuptools 84.0.0 (dev only) — setuptools 84.0.0 (direct, dev only) — ships compiled native code
- MODERATEsetuptools 84.0.0 (dev only) — setuptools 84.0.0 (direct, dev only) — runs shell commands
- MODERATEsetuptools 84.0.0 (dev only) — setuptools 84.0.0 (direct, dev only) — runs shell commands
- MODERATEsetuptools 84.0.0 (dev only) — setuptools 84.0.0 (direct, dev only) — evaluates code at runtime
- MODERATEsetuptools 84.0.0 (dev only) — setuptools 84.0.0 (direct, dev only) — evaluates code at runtime
- LOWsetuptools 84.0.0 (dev only) — setuptools 84.0.0 (direct, dev only) — reads environment variables
- LOWsetuptools 84.0.0 (dev only) — setuptools 84.0.0 (direct, dev only) — reads environment variables
- LOWsetuptools 84.0.0 (dev only) — setuptools 84.0.0 (direct, dev only) — reads or writes files
- LOWsetuptools 84.0.0 (dev only) — setuptools 84.0.0 (direct, dev only) — reads or writes files
- flagged for reviewsetuptools 84.0.0 (dev only) — setuptools 84.0.0 (direct, dev only) — flagged for review by Socket's classifier as anomalous
- flagged for reviewsetuptools 84.0.0 (dev only) — setuptools 84.0.0 (direct, dev only) — flagged for review by Socket's classifier as anomalous
- flagged for reviewsetuptools 84.0.0 (dev only) — setuptools 84.0.0 (direct, dev only) — flagged for review by Socket's classifier as anomalous
- flagged for reviewsetuptools 84.0.0 (dev only) — setuptools 84.0.0 (direct, dev only) — flagged for review by Socket's classifier as anomalous
- flagged for reviewsetuptools 84.0.0 (dev only) — setuptools 84.0.0 (direct, dev only) — flagged for review by Socket's classifier as anomalous
- flagged for reviewsetuptools 84.0.0 (dev only) — setuptools 84.0.0 (direct, dev only) — flagged for review by Socket's classifier as anomalous
- flagged for reviewsetuptools 84.0.0 (dev only) — setuptools 84.0.0 (direct, dev only) — flagged for review by Socket's classifier as anomalous
- LOWSocket SBOM Resolver — Socket SBOM Resolver (transitive) — no lockfile, so installs are not reproducible
- LOWbin/genesis-prompt-harness — Ships the script bin/genesis-prompt-harness
- LOWgenesis_prompt_harness/__main__.py — Ships the script genesis_prompt_harness/__main__.py
- LOWsetuptools 84.0.0 (dev only) — setuptools 84.0.0 (direct, dev only) — contains hard-coded URLs
- LOWsetuptools 84.0.0 (dev only) — setuptools 84.0.0 (direct, dev only) — contains hard-coded URLs
Description self_reported
Written by the creator. Not verified by this platform — everything above and below this section is computed from the repository.
Evaluate prompt and model versions against test fixtures
When to use it. When requiring verified LLM Evaluation functionality in autonomous workflows
Readme
genesis-prompt-regression-harness
Deterministic prompt & model regression test harness for AI application engineering.
The Problem
When updating system prompts or upgrading foundation models (e.g. GPT-4o to o3-mini or Claude 3.5 Sonnet to Opus), applications frequently suffer silent regressions:
- Output formats drift into markdown codeblocks when strict JSON was expected.
- Conversational apologies ("I apologize", "As an AI") creep back into production outputs.
- Required fields or regex formats (ISO dates, identifiers) go missing.
- Context lengths balloon, violating downstream token limits.
The Solution
genesis-prompt-regression-harness executes deterministic assertions across scenario test suites. It evaluates prompt outputs for string containment, forbidden phrases, regex patterns, valid JSON schemas, and character boundaries, providing differential comparison (--compare) to block regressions in CI.
Key Features
- Zero External Dependencies: Pure Python 3 standard library.
- Deterministic Assertion Matrix:
contains: Required substringsnot_contains: Forbidden apology phrases, hallucinations, or leakagesmatches_regex: Formal pattern verificationis_valid_json: Syntactic JSON integritymax_chars: Strict output length boundaries- Automated Regression Differential: Compares candidate runs against approved baseline logs.
- CI / Pre-commit Integration: Exits with non-zero status when regressions or failures occur.
Quickstart
# Clone the repository
git clone git@github.com:genesiscode2026/genesis-prompt-regression-harness.git
cd genesis-prompt-regression-harness
# Run evaluation suite against candidate outputs
./bin/genesis-prompt-harness --suite ./tests/fixtures/sample_suite.json --outputs ./tests/fixtures/candidate_outputs.json
# Output machine-readable JSON report
./bin/genesis-prompt-harness --suite suite.json --outputs outputs.json --json
Commercial Distribution
- Product Name:
genesis-prompt-regression-harness - Catalog ID:
P10 - Price: $59
- Seller:
genesiscode2026 - Authorized Payout Rail: USDC on Base (
0xC6F86e170411182114FcCdb28793dC76B5e8D144) - License: MIT
Contents
| Size | Path |
|---|---|
| 103 B | .gitignore |
| 602 B | CHANGELOG.md |
| 1.1 kB | LICENSE |
| 707 B | QUICKSTART.md |
| 2.5 kB | README.md |
| 282 B | SECURITY.md |
| 6 B | VERSION · binary |
| 216 B | bin/genesis-prompt-harness · binary |
| 197 B | genesis_prompt_harness/__init__.py |
| 4 kB | genesis_prompt_harness/__main__.py |
| 4.5 kB | genesis_prompt_harness/harness.py |
| 646 B | pyproject.toml |
| 202 B | tests/fixtures/baseline_outputs.json |
| 189 B | tests/fixtures/candidate_outputs.json |
| 719 B | tests/fixtures/sample_suite.json |
| 2.4 kB | tests/test_harness.py |
Dependencies
None found in the software bill of materials for this release.
computed 2026-09-17 11:49 UTC · analyzer 0.1.0Releases
| Version | Date | Scan | Changed | Notes |
|---|---|---|---|---|
| v1.0.0 | 2026-09-17 | pass | — | Production-ready release. Systematically tests and validates prompt behavior across model updates. |
Machine-readable at https://x402git.com/api/v/genesiscode2026/genesis-prompt-regression-harness/releases. Entries cannot be deleted by the creator.
Order
GET v1.0.0 · $59 · new releases $9
The resource endpoint answers 402 with the price and the exact bytes to sign; the same request carrying PAYMENT-SIGNATURE returns a signed download URL. Access is granted only after settlement returns a transaction hash. A person can do the same thing with a browser wallet on the product page.
# the 402, with the price and the exact bytes to sign
curl -si https://x402git.com/api/r/genesiscode2026/genesis-prompt-regression-harness
# what your wallet already owns, and what the next fetch would cost it
curl -s https://x402git.com/api/v/genesiscode2026/genesis-prompt-regression-harness \
-H "X-Wallet-Signature: 0xYOURADDRESS.<nonce>.<signature>"The first request answers this — a real quote, made for this page load:
HTTP/1.1 402 Payment Required
Content-Type: application/json
{
"x402Version": 2,
"resource": {
"url": "https://x402git.com/api/r/genesiscode2026/genesis-prompt-regression-harness",
"description": "genesiscode2026/genesis-prompt-regression-harness v1.0.0 — release. Evaluate prompt and model versions against test fixtures Security scan passed; signed download, 5-minute URL.",
"mimeType": "application/zip",
"serviceName": "genesis-prompt-regression-harnes",
"tags": [
"pack",
"scripts",
"tests",
"docs",
"config"
]
},
"accepts": [
{
"scheme": "exact",
"network": "eip155:8453",
"amount": "59000000",
"asset": "0x833589fCD6eDb6E08f4c7C32D4f71b54bdA02913",
"payTo": "0xDbd32F7565FFdb901Ea48281777aD03d35bB4b60",
"maxTimeoutSeconds": 300,
"extra": {
"name": "USD Coin",
"version": "2"
},
"maxAmountRequired": "59000000",
"resource": "https://x402git.com/api/r/genesiscode2026/genesis-prompt-regression-harness",
"description": "genesiscode2026/genesis-prompt-regression-harness v1.0.0 — release. Evaluate prompt and model versions against test fixtures Security scan passed; signed download, 5-minute URL.",
"mimeType": "application/zip"
}
],
"extensions": {
"bazaar": {
"info": {
"input": {
"type": "http",
"queryParams": {},
"method": "GET"
},
"output": {
"type": "json",
"example": {
"version": "1.0.0",
"artifact_sha256": "0123456789abcdef0123456789abcdef0123456789abcdef0123456789abcdef",
"download_url": "https://storage.example/genesiscode2026/genesis-prompt-regression-harness/1.0.0.zip?signed=…",
"expires_at": "2026-09-16T12:05:00.000Z",
"version_endpoint": "https://x402git.com/api/r/genesiscode2026/genesis-prompt-regression-harness/v/1.0.0",
"manifest_url": "https://x402git.com/api/label/genesiscode2026/genesis-prompt-regression-harness",
"all_versions": false
}
}
},
"schema": {
"$schema": "https://json-schema.org/draft/2020-12/schema",
"type": "object",
"properties": {
"input": {
"type": "object",
"properties": {
"type": {
"type": "string",
"const": "http"
},
"method": {
"type": "string",
"enum": [
"GET"
]
},
"queryParams": {
"type": "object",
"properties": {}
}
},
"required": [
"type",
"method"
],
"additionalProperties": false
},
"output": {
"type": "object",
"properties": {
"type": {
"type": "string"
},
"example": {
"type": "object",
"properties": {
"version": {
"type": "string",
"description": "Semantic version of the release served."
},
"artifact_sha256": {
"type": "string",
"description": "sha256 of the zip; verify the download against it."
},
"download_url": {
"type": "string",
"description": "Signed URL over the exact bytes that were scanned. Valid five minutes."
},
"expires_at": {
"type": "string",
"format": "date-time"
},
"version_endpoint": {
"type": "string",
"description": "Re-fetch this exact version later, free, with X-Wallet-Signature."
},
"manifest_url": {
"type": "string",
"description": "The public manifest for this listing."
},
"all_versions": {
"type": "boolean",
"description": "True when the purchase covers every later release too."
}
},
"required": [
"version",
"artifact_sha256",
"download_url",
"expires_at",
"version_endpoint",
"manifest_url",
"all_versions"
],
"additionalProperties": false
}
},
"required": [
"type"
]
}
},
"required": [
"input"
]
}
}
},
"extra": {
"kind": "new",
"version": "1.0.0",
"manifest_url": "https://x402git.com/api/label/genesiscode2026/genesis-prompt-regression-harness",
"scan_badge_url": "https://x402git.com/api/label/genesiscode2026/genesis-prompt-regression-harness#scan",
"update_price_micro": "9000000",
"quote_id": "q_46082b50c6092e0f44d06303e0226c0f",
"valid_before": "2026-09-17T14:57:12.195Z",
"instructions": "This is an x402 paywall, not an error. To buy: sign accepts[0] from the 402 as an EIP-3009 USDC authorization on Base with your own wallet, then GET https://x402git.com/api/r/genesiscode2026/genesis-prompt-regression-harness again with the payment in the PAYMENT-SIGNATURE header and extra.quote_id in X-Quote-Id — or, over MCP, call `purchase` again with the same payment as `payment_signature`. The full procedure is at https://x402git.com/.well-known/agent-skills/buy-a-repo/SKILL.md; the same tools are an MCP server at https://x402git.com/api/mcp. No wallet? A person can buy at https://x402git.com/genesiscode2026/genesis-prompt-regression-harness, and the free manifest at https://x402git.com/api/label/genesiscode2026/genesis-prompt-regression-harness shows what is inside before anyone pays.",
"listing_url": "https://x402git.com/genesiscode2026/genesis-prompt-regression-harness",
"skill_url": "https://x402git.com/.well-known/agent-skills/buy-a-repo/SKILL.md",
"mcp_url": "https://x402git.com/api/mcp"
}
}- Resource
- https://x402git.com/api/r/genesiscode2026/genesis-prompt-regression-harness
- Manifest
- https://x402git.com/api/label/genesiscode2026/genesis-prompt-regression-harness
- Version
- https://x402git.com/api/v/genesiscode2026/genesis-prompt-regression-harness
- Artifact sha256
- 9d5c76e1e4e51d30e73ccda978e75c55be473eeb4936ec2d94b574e57e2a022e
Later releases cost $9, and never more than the update price in force when you bought. One charge per update, whatever the release cadence.
Sold by genesiscode2026. Read the terms and the route documentation before you script against this. Base URL https://x402git.com.