Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
33 changes: 27 additions & 6 deletions docs/docs/partners-courts/ai-customization.md
Original file line number Diff line number Diff line change
Expand Up @@ -79,12 +79,33 @@ DOCUMENT_EVIDENCE_MODEL="gpt-5-nano" # Optional exact deployment
DOCUMENT_CLASSIFICATION_MODEL="gpt-5-mini" # Optional exact deployment
```

### Model selection and tiers
---

## Supported AI models and enterprise providers

*Last updated: September 2026 (subject to periodic updates for security, quality, and performance).*

LITEFile connects exclusively to enterprise-tier endpoints operating under commercial privacy agreements. User documents, extracted evidence, and case data are **never** used to train, retrain, or improve any public or private artificial intelligence models.

### Currently supported enterprise models and tiers

In `efile/utils/llms.py`, models are arranged into three performance tiers with automatic fallback against the provider's `/models` endpoint:

| Tier | Default & supported models | Primary purpose |
| :--- | :--- | :--- |
| **Small (default)** | `gpt-4o-mini`, `gpt-4.1-nano`, `gemini-2.5-flash-lite`, `claude-3-5-haiku` | Fast fact extraction, caption reading, and single-level category selection |
| **Medium** | `gpt-4o`, `gpt-4.1-mini`, `claude-3-7-sonnet` | Complex multi-party caption extraction and ambiguous case-type matching |
| **Large** | `gpt-4o`, `o3`, `claude-3-7-sonnet` | Advanced edge-case classification and unstructured document review |

### Approved enterprise provider configurations

LITEFile deployments can route requests through any of the following enterprise configurations:

1. **Enterprise OpenAI / Azure OpenAI Service**: Commercial enterprise tier with zero data retention (ZDR) or ephemeral operational processing, and explicit no-training clauses.
2. **Private enterprise gateways**: Custom OpenAI-compatible proxy gateways (such as LiteLLM, vLLM, or court-hosted infrastructure) enforcing local jurisdictional encryption and data-residency boundaries.
3. **Vertex AI / AWS Bedrock endpoints**: Enterprise cloud platforms compliant with FedRAMP, HIPAA, SOC 2 Type II, and state court data requirements.

In `llms.py`, models are arranged in three performance tiers:
### Quality monitoring and human evaluation

- **Small (default)**: `gpt-4o-mini`, `gpt-4.1-nano`, `gemini-2.5-flash-lite`, `claude-3-5-haiku`
- **Medium**: `gpt-4o`, `gpt-4.1-mini`, `claude-3-7-sonnet`
- **Large**: `gpt-4o`, `o3`, `claude-3-7-sonnet`
Approved LITEFile staff may monitor AI performance manually from time to time to evaluate system accuracy, benchmark prompts, and improve the tool. Any manual review is conducted under strict confidentiality and access controls by authorized personnel, and documents are never used to train third-party AI models.

The system automatically verifies model availability against the `/models` endpoint of your configured provider and falls back gracefully.
40 changes: 40 additions & 0 deletions efile_app/efile/templates/efile/terms_of_service.html
Original file line number Diff line number Diff line change
Expand Up @@ -69,6 +69,46 @@ <h2 id="information-sharing">{% translate "How information is shared" %}</h2>
</li>
</ul>
</section>
<section aria-labelledby="artificial-intelligence">
<h2 id="artificial-intelligence">{% translate "Use of artificial intelligence" %}</h2>
<p>
{% translate "LITEFile provides optional artificial intelligence (AI) features to make preparing and submitting court filings faster and easier. We adhere to strict, principle-based standards to protect your privacy and legal data:" %}
</p>
<ul>
<li>
<strong>{% translate "Where AI is used to help route your filing:" %}</strong>
{% translate "When you upload documents, AI can be used to help route your filing to the right place. AI reads your uploaded document to identify case details, party information, and form titles, and recommends the matching court location, case category, case type, and filing codes so you have less to type." %}
</li>
<li>
<strong>{% translate "You can opt out of AI:" %}</strong>
{% translate "Using AI is completely optional. You can opt out of AI assistance at any time—either for a specific filing or by saving a setting to keep AI off for your entire account. Opting out will not delay or prevent your filing. If you opt out, we will only check your document with standard text search for printed form or case numbers, or you can enter all information yourself." %}
</li>
<li>
<strong>{% translate "AI can make mistakes and must be verified:" %}</strong>
{% translate "AI can make mistakes and you should verify the information it gives you. It can omit details or suggest incorrect filing options, and AI suggestions are assistive tools that do not constitute legal advice or establish an attorney-client relationship. You are responsible for reviewing and confirming all information before submitting your filing, and you may need to correct a mistake if pointed out to you by a court clerk. The court, clerk, or judge decides whether a filing is accepted and legally sufficient, not LITEFile or the AI." %}
</li>
<li>
<strong>{% translate "Your documents are never used to train an AI system:" %}</strong>
{% translate "Your documents, case information, and personal data are never used to train, retrain, or improve any public or private AI system or machine learning model." %}
</li>
<li>
<strong>{% translate "Quality monitoring by approved staff:" %}</strong>
{% translate "Approved LITEFile staff may monitor AI performance manually from time to time to evaluate accuracy and improve the tool. Any manual review is conducted under strict confidentiality and access controls by authorized personnel." %}
</li>
<li>
<strong>{% translate "Enterprise AI and data rights:" %}</strong>
{% translate "We use enterprise AI and you keep all rights to your data. We connect exclusively to enterprise-tier AI services governed by commercial confidentiality and strict data-protection agreements. You retain full ownership, copyright, and all rights to your documents and information." %}
</li>
<li>
<strong>{% translate "Handled securely in both directions:" %}</strong>
{% translate "All information transmitted to and from enterprise AI services is protected by encryption in transit and at rest, handled under strict access controls, and retained only as long as necessary to process your filing. In rare cases, the AI service provider may review data for safety and abuse monitoring as permitted by their enterprise terms of service. Such reviews do not include training on your data." %}
</li>
<li>
<strong>{% translate "Supported AI models and provider list:" %}</strong>
{% blocktranslate with docs_url="https://litefile-docs.suffolklitlab.org/docs/partners-courts/ai-customization#supported-ai-models-and-enterprise-providers" as_of_date="September 2026" %}To maintain security, reliability, and accuracy, LITEFile deploys vetted enterprise models and may update them over time. You can review our current list of supported AI models and approved enterprise provider configurations in our <a href="{{ docs_url }}" target="_blank" rel="noopener noreferrer">technical documentation</a> (as of {{ as_of_date }}; subject to periodic updates for security, quality, and performance).{% endblocktranslate %}
</li>
</ul>
</section>
<section aria-labelledby="keeping-information-safe">
<h2 id="keeping-information-safe">{% translate "Keeping your information safe and private" %}</h2>
<p>
Expand Down
2 changes: 1 addition & 1 deletion efile_app/efile/templates/efile/upload_documents.html
Original file line number Diff line number Diff line change
Expand Up @@ -110,7 +110,7 @@ <h2 id="pending-files-heading">{% translate "Selected files" %}</h2>
id="ai-note-on"
{% if ai_opted_out %}hidden{% endif %}>
<i class="fa-solid fa-wand-magic-sparkles" aria-hidden="true"></i>
{% translate "AI will read your first PDF so you have less to type. Your documents are never used to train AI models and are not read by a person." %}
{% translate "AI will read your first PDF so you have less to type. Your documents are never used to train AI models." %}
</p>
<p class="ai-choice__note ai-choice__note--off"
id="ai-note-off"
Expand Down
Loading