AutoResearch + PromptFoo = AutoPrompter. Run it with Neo AI Engineer
-
Updated
Apr 16, 2026 - Python
#
promptfoo
Here are 107 public repositories matching this topic...
Your guide to the Agentic AI evolution. **Prompting Blueprints** offers a curated collection of concepts and tactics for building autonomous AI workflows. Master tool-specific playbooks, backed by structured prompt packs and rigorous evaluations for the latest AI models.
mkdocs gemini llm prompt-engineering generative-ai chatgpt prompt-library promptfoo context-engineering
-
Updated
Aug 28, 2026 - HTML
This repository contains the code snippets used in "LLM Prompt Engineering For Developers"
react python nlp natural-language-processing openai gpt perplexity few-shot-learning gpt-4 llm prompt-engineering chain-of-thought chatgpt langchain chatgpt-api azure-prompt-flow promptfoo general-knowledge-prompting betterprompt
-
Updated
Apr 22, 2024
Policy-as-code for MCP agents: deny risky tool calls before they run, prove what ran with verifiable evidence, and enforce egress in the kernel (eBPF/LSM, Linux). Deterministic, offline-first, bounded claims.
rust ci mcp provenance ebpf ai-agents ai-security policy-enforcement sbom policy-as-code github-actions cyclonedx supply-chain-security openfeature llm-security promptfoo mcp-server agent-security mcp-security evidence-bundles
-
Updated
Aug 30, 2026 - Rust
prompt-evaluator is an open-source toolkit for evaluating, testing, and comparing LLM prompts. It provides a GUI-driven workflow for running prompt tests, tracking token usage, visualizing results, and ensuring reliability across models like OpenAI, Claude, and Gemini.
electron react typescript datascience developer-tools ai-evaluation llm prompt-engineering prompt-testing promptfoo ai-evaluation-tools ai-evaluation-metrics ai-evaluation-framework
-
Updated
Dec 4, 2025 - TypeScript
Community Plugin for Genkit to use Promptfoo
plugin testing firebase ai evaluation prompt prompts evaluation-framework llm llmops prompt-testing llm-eval llm-evaluation llm-evaluation-framework promptfoo genkit genkitx genkit-plugin
-
Updated
Jan 3, 2025 - TypeScript
面向开发者的中文 Eval Harness 源码教材：解析 lm-evaluation-harness、Inspect AI、OpenAI Evals、Promptfoo、DeepEval 与 Harbor，覆盖任务、运行、评分、统计与发布门禁。
benchmark chinese source-code-analysis llm lm-evaluation-harness openai-evals promptfoo llm-as-a-judge deepeval inspect-ai eval-harness
-
Updated
Aug 27, 2026 - Python
VCL VibeBench — open frontier-model comparisons you can fork and re-run. By Vibe Coder's Life.
-
Updated
Aug 25, 2026 - JavaScript
Compare models across prompts, test domains, and scenarios.
-
Updated
Apr 5, 2026 - Python
Python + SQL toolkit for LLM threat intelligence — flags prompt injection, jailbreaks, and data exfiltration mapped to OWASP LLM Top 10 (2025) & MITRE ATLAS.
python sql threat-intelligence red-teaming ai-security detection-engineering pyrit adversarial-ml mitre-atlas prompt-injection llm-security promptfoo owasp-llm-top-10 garak
-
Updated
Aug 17, 2026 - Python
kotlin testing mcp moderation chatbot demo-app rag quarkus langchain4j llm-evaluation promptfoo rag-chatbot mcp-client
-
Updated
Aug 27, 2026 - Kotlin
Real DuckDB Quack infrastructure for multi-agent Werewolf: containerized player nodes, Quack gateway federation, browser runner, and local/hosted LLM evals.
typescript werewolf multi-agent-systems quack duckdb local-llm evals llm-agents promptfoo openai-compatible inspect-ai omlx browser-runner
-
Updated
Aug 12, 2026 - JavaScript
Quickstart guide for using PromptFoo to evaluate LLM prompts via CLI or Colab.
-
Updated
Nov 23, 2025
Sample project demonstrates how to use Promptfoo, a test framework for evaluating the output of generative AI models
testing evaluation prompts evaluation-framework llm llmops prompt-testing llm-eval llm-evaluation llm-evaluation-framework promptfoo
-
Updated
Sep 10, 2024
Prompt optimization and benchmarking for local LLMs: picks the right prompt technique for your task and measures it on Ollama. DSPy-compatible.
python nlp benchmarking ai structured-output mlops dspy llm prompt-engineering chain-of-thought llmops prompt-testing local-llm ollama llm-evaluation prompt-optimization promptfoo prompt-techniques llm-benchmark prompt-compiler
-
Updated
Aug 29, 2026 - Python
Open-source eval harness for RAG and agent systems. Ragas + promptfoo + custom rubrics. Maintained by Paiteq, used by Paiteq + GetWidget.
-
Updated
May 22, 2026 - Python
AI/LLM test strategy for an e-commerce product recommendation engine — prompt regression, hallucination detection, toxicity safety gate, latency SLOs, and contract testing
portfolio ecommerce pytest pact k6 github-actions qa-automation fastapi ai-testing promptfoo hallucination-detection llm-testing prompt-regression
-
Updated
May 25, 2026 - Python
Improve this page
Add a description, image, and links to the promptfoo topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the promptfoo topic, visit your repo's landing page and select "manage topics."