PrompyAI

Context-aware prompt intelligence for Claude CLI.
Scores your prompts against your real codebase — file paths, symbols, session history — and rewrites them with AI.

What It Does

When you write a prompt in Claude CLI, PrompyAI automatically evaluates it against your actual project and returns:

Score (0–100) across 4 dimensions
Suggestions tailored to your project
AI-enhanced prompt rewritten with real file paths, verified symbols, and codebase context

Prompt Score: 43/100 [D]

  Specificity         3/25  ==..............
  Context Completeness 13/25  ========........
  Task Clarity        15/25  =========.......
  File & Folder Anchoring 10/25  ======..........

Key improvements:
  1. Expand your prompt with more context
  2. Add file paths using @mentions
  3. Specify what format you expect the output in
  4. Add acceptance criteria

Try something more like:

  "Build the VS Code extension in packages/vscode-extension/ that integrates
   with the PrompyAI MCP server at packages/mcp-server/. It should provide
   real-time prompt scoring in the editor sidebar, show score breakdowns
   (specificity, context, clarity, anchoring), and offer a 'rewrite prompt'
   action. Use the shared types from packages/shared/."

Quick Start

claude mcp add prompyai -- npx prompyai-mcp serve

That's it. No sign-up, no config files. Works immediately.

Requires Node.js 20+ and Claude CLI.

How AI Enhancement Works

PrompyAI uses a two-layer architecture so all users get AI-enhanced output:

User type	How it works
API key users (`ANTHROPIC_API_KEY` set)	PrompyAI calls Claude Haiku directly for fast, dedicated AI rewrites
Subscription users (no API key)	PrompyAI returns codebase context to Claude, and Claude itself generates the enhanced prompt using your existing session

Either way, the enhanced prompt is grounded in your real project — actual file paths, verified function names, and project architecture.

Scoring Dimensions

Each dimension scores 0–25, total 0–100.

Dimension	What it measures
Specificity	Concrete actions vs vague verbs, output format, quantitative constraints
Context Completeness	File references, error messages, expected vs actual behavior
Task Clarity	Single focused task, success criteria, unambiguous language
File & Folder Anchoring	@mentions, project entity references, verified symbol names

Grades: A (90+) · B (70+) · C (50+) · D (30+) · F (<30)

Features

Auto-scoring — Evaluates every prompt automatically, no manual trigger needed
AI-enhanced for everyone — API key users get Haiku rewrites; subscription users get Claude-powered rewrites via codebase context
Context-aware — Indexes your file tree, tech stack, git state, and code symbols via the TypeScript Compiler API
Session-aware — Reads Claude Code conversation history for multi-turn context
Symbol verification — Confirms that function/class names you reference actually exist in your code
Monorepo support — Detects tech stacks across workspace packages
Toggle — Say "pause prompyai" or "enable prompyai" at any time

MCP Tools

`evaluate_prompt`

Automatically called on every user message. Scores your prompt against your project.

Parameter	Required	Description
`prompt`	yes	The prompt text to evaluate
`workspace_path`	yes	Absolute path to your project
`active_file`	no	Currently open file path
`session_id`	no	Claude Code session ID for multi-turn context

`get_context`

Returns your project summary: tech stack, recent files, key folders, AI instruction files.

Parameter	Required	Description
`workspace_path`	yes	Absolute path to your project

`prompyai_toggle`

Turns auto-evaluation on or off.

Parameter	Required	Description
`enabled`	yes	`true` to enable, `false` to disable

Environment Variables

Variable	Required	Description
`ANTHROPIC_API_KEY`	No	Enables direct AI suggestions via Claude Haiku (optional — works without it)
`PROMPYAI_TELEMETRY`	No	Set to `false` to opt out of anonymous telemetry

Architecture

PrompyAI/
├── packages/
│   ├── mcp-server/     ← Core product (npm: prompyai-mcp)
│   ├── landing/        ← Website (prompyai.com)
│   └── shared/         ← Shared types for future IDE extensions
├── CLAUDE.md
└── README.md

Scoring Pipeline

User prompt
  → WorkspaceIndexer (file tree, stack, symbols)
  → ContextResolver (map prompt to codebase)
  → HeuristicScorer (20+ rules, 4 dimensions)
  → AISuggestionGenerator (Haiku or Claude-as-AI-layer)
  → DisplayFormatter (pre-formatted output)

Development

pnpm install          # Install dependencies
pnpm test             # Run tests (220 tests)
pnpm typecheck        # Type check
pnpm build            # Build

License

MIT