Skip to content
Cypher QA

Open-source AI quality engineering platform

CypherPilot

An AI-augmented quality engineering platform where engineers upload artifacts and receive structured, production-quality outputs — test cases, pytest suites, and root-cause analyses. AI powers the analysis; the platform owns the workflow.

The hosted demo is a static UI preview — API features require a running backend, exactly as documented in the repository.

Inputs

  • Requirement documents

    Analyzed into structured test design

  • OpenAPI specifications

    Parsed for endpoints and auth schemes

  • CI failure artifacts

    Logs, stack traces, screenshots, page source

Provider-agnostic

Analysis engine

AI does the analysis.
The platform owns the workflow.

Pluggable adapters route work to the right model while output contracts stay deterministic — every response validated against typed schemas before it reaches application state.

OpenRouterOllamaGemini

Outputs

  • Structured test cases

    Steps, boundaries, edge cases, risk ratings

  • Executable pytest suites

    Generated fixtures, ZIP export

  • Root-cause reports

    Severity, confidence, suggested fixes

Verified from the public repository — no invented features

Three AI-assisted QA workflows

Each module targets repetitive, high-cognitive-load QA work — and each returns structured, validated output rather than chat text.

Requirement analysis

Requirements → structured test design

Product requirements go in; strongly typed analysis comes out. The platform produces prioritized test cases with steps and expected results, boundary values, edge cases, risk assessments with severity, and automation-feasibility ratings — the output a test lead would spend days writing.

  • Prioritized test cases
  • Boundary & edge cases
  • Risk severity ratings
  • Automation feasibility

API test generation

OpenAPI spec → ready-to-run pytest suites

Paste an OpenAPI specification and receive AI-generated pytest API suites packaged with generated conftest fixtures, auth-header handling derived from the spec's security schemes, and ZIP export. Coverage that used to be skipped because it was tedious becomes routine.

  • Spec parsing & presets
  • pytest suite generation
  • conftest scaffolding
  • ZIP export

Failure analysis

CI logs → root causes with suggested fixes

CI/CD logs, stack traces, screenshots, and page source are analyzed into structured root causes — each with severity, confidence, affected components, and suggested fixes mapped to root-cause IDs. Batch mode processes whole folders of failures at once, with Markdown/JSON/CSV export.

  • Root cause detection
  • Suggested fixes
  • Multi-artifact upload
  • Batch analysis

The AI layer is engineered, not bolted on

Provider abstraction

A registry maps provider names to adapters behind one protocol. Business modules never know which model serves a request — adding a provider means writing one adapter class. Shipped adapters: OpenRouter (cloud), Ollama (local), Gemini.

Versioned prompt management

Prompts live as versioned Markdown files with Jinja2 templating and few-shot examples — no hardcoded strings in Python. Prompts improve without code changes or redeploys of business logic.

Response validation

Model output is parsed and validated against Pydantic schemas before it reaches application state. Malformed AI responses become typed errors, not silent corruption.

Resilience

Retry with backoff and fallback provider chains keep analyses running through provider outages, surfaced through a health dashboard.

A complete platform around the AI

Authentication & RBAC

JWT-based registration and login with bcrypt hashing and role-based access across admin, user, and viewer roles.

Teams & shared sessions

Team workspaces with member roles, session sharing, and per-user plus per-team API rate limiting.

Auditability

An audit log records platform events into a paginated activity feed with team, user, and action filtering.

Webhooks & notifications

HMAC-signed outbound webhooks with retry and backoff, plus in-app and SMTP email notifications with per-user preferences.

Sessions & exports

Every analysis is a stored, searchable session — comparable side-by-side across runs and exportable as Markdown, JSON, or CSV.

Self-hosted first

Runs locally via Docker Compose or one-command installers for Windows, Linux, and macOS. Data stays on your machine unless you choose a cloud provider.

Engineering standards you can verify

  • 470+ automated backend tests (pytest) plus a Vitest component suite, run in CI on every push and pull request.
  • mypy in strict mode and ruff linting gate every change alongside the test suite.
  • Async-first backend: FastAPI, SQLAlchemy 2.0 async sessions, httpx provider communication.
  • Versioned database schema via ten Alembic migrations evolving across 25 shipped releases.
  • Architecture decision records document the reasoning behind the provider layer, prompts, modules, and API design.
  • Dockerized deployment with an nginx-served frontend and healthchecked services.

Built with

  • Python 3.12
  • FastAPI
  • SQLAlchemy 2.0
  • PostgreSQL 16
  • Alembic
  • React 19
  • TypeScript
  • Vite
  • Tailwind CSS
  • Docker
View on GitHub