BuildTube Preview About
Back to the feed

iFixAi: Get a scorecard of where your AI agent breaks its rules

Added · Updated

Point it at your AI agent and get a graded report of risky behavior, like misusing tools or leaking data.

For teams who build and ship AI agents.

What it does

iFixAi runs a set of inspections against an AI agent: it sends test conversations and tool requests, then a judge model (a second AI that grades the answers) scores what the agent did. The creators say it checks whether the agent does the job it is meant to do within its business rules, not only technical measures like speed. Checks include whether a role can only use its allowed tools, whether the agent resists prompt injection (hidden instructions that try to hijack it), and whether it keeps one user's data from another.

How to use it

Input → action → output: give it your agent's endpoint or a model provider and keys, run the setup wizard or a single CLI command, and get JSON and Markdown reports plus a scorecard in your terminal. Inside Claude Code or Codex, the plugin lets you ask "run iFixAi on my setup" and walks you through the results.

Common use cases

  • Run the default 10 inspections on your support chatbot and get a scorecard showing which risky behaviors failed.
  • Add the CLI to your automated build checks so every new agent version produces a fresh JSON report to compare.
  • Ask your coding assistant to run iFixAi on your project and get an interactive scorecard explained in plain words.

Can I use this?

Setup details on the source page

Requirements Install with pip and run ifixai setup, which detects API keys already in your environment, or install the plugin for Claude Code or Codex. The code is open source under Apache-2.0.

Caveat The default run covers 10 inspections; a full run covers all 60 and takes longer. A score is the judge model's assessment, so results depend on which judge you pick.

Worth knowing A grade judged by the same vendor as the agent is only a smoke test. Each run calls AI provider APIs that bill per use; the plugin names the cost first. Licensed under Apache License 2.0.

Why it's here

Not trending this week

Last seen on the GitHub trending list on 2 November 2026. It stays on BuildTube so you can still find it.

  • 44,041 people have starred it on GitHub.

Numbers checked on 8 November 2026; not refreshed since.

Behind it

View setup guide

BuildTube has not run or verified this project. Everything above is written from what the creator published.

Made this?

Quick questions

What is iFixAi?
iFixAi runs a set of inspections against an AI agent: it sends test conversations and tool requests, then a judge model (a second AI that grades the answers) scores what the agent did.
What can I use iFixAi for?
Run the default 10 inspections on your support chatbot and get a scorecard showing which risky behaviors failed; Add the CLI to your automated build checks so every new agent version produces a fresh JSON report to compare; Ask your coding assistant to run iFixAi on your project and get an interactive scorecard explained in plain words
Can I run iFixAi on my computer?
iFixAi runs on your own computer from a terminal, installed with pip, or as a plugin inside Claude Code or Codex; it calls the AI provider you test over the internet.
What do I need to use iFixAi?
Python and pip (or uvx), plus API keys for the AI provider you test and for a judge model. Keys are read from environment variables.
What license does iFixAi use?
Licensed under Apache License 2.0.

More from this week

Explore by topic

Post this

A ready-made picture of this card for X, LinkedIn or a group chat. Link to this page alongside it.

Share image for iFixAiDownload share image

For makers

Made this? Show it’s on BuildTube — add the badge to your README or embed the card on your site.

Featured on BuildTube

README badge (Markdown)

[![Featured on BuildTube](https://buildtube.app/badge/gh-ifixai-ai-ifixai.svg)](https://buildtube.app/p/gh-ifixai-ai-ifixai/)

Embed card (HTML)

<iframe src="https://buildtube.app/embed/gh-ifixai-ai-ifixai/" width="560" height="240" style="border:0;max-width:100%" loading="lazy" title="iFixAi on BuildTube"></iframe>

Back to the feed