CI 配置模板

GitHub Action 评测门禁 YAML

通用的 Promptfoo 评测 GitHub Action，运行评测、保存结果并执行质量门禁。

文件：prompt-eval-gate.yml版本：v1.0.0下载：2

使用说明

把 API Key 放入 GitHub Secrets；将 check-gate.js 换成项目自己的门禁脚本，并固定数据集和裁判版本。

name: ai-evaluation-gate
on:
  pull_request:
    paths:
      - "prompts/**"
      - "tests/**"
      - "promptfooconfig.yaml"
      - "scripts/check-gate.js"
jobs:
  eval:
    runs-on: ubuntu-latest
    steps:
      - uses: actions/checkout@v4
      - uses: actions/setup-node@v4
        with:
          node-version: 20
          cache: npm
      - run: npm ci
      - name: Run Promptfoo
        run: npx promptfoo eval -c promptfooconfig.yaml -o artifacts/results.json
        env:
          OPENAI_API_KEY: ${{ secrets.OPENAI_API_KEY }}
          OPENAI_BASE_URL: ${{ secrets.OPENAI_BASE_URL }}
          OPENAI_MODEL: ${{ vars.OPENAI_MODEL }}
      - name: Check quality gate
        run: node scripts/check-gate.js artifacts/results.json
      - uses: actions/upload-artifact@v4
        if: always()
        with:
          name: ai-evaluation-results
          path: artifacts/results.json