Add an assistant prefill option to LlamaLanguageModel - #192

Closed

james-333i wants to merge 144 commits into

huggingface:mainfrom

james-333i:feat/llama-assistant-prefill

Commits on Oct 7, 2025

Initial commit
mattt
committed
8189829
Move MockLanguageModel to test target
mattt
committed
ff3c7c4
Implement spy for precise assertions about tool calling behavior
mattt
committed
8f7861c

Commits on Oct 9, 2025

Refactor Ollama tool calling
mattt
committed
e0716d2
Implement tool calling for Anthropic and OpenAI APIs
mattt
committed
de1e47c
Add support for MLX models
mattt
committed
1dfce4b
Update README
mattt
committed
784593d
Conditionalize MLX tests for Xcode / xcodebuild
mattt
committed
cd873ac

Commits on Oct 10, 2025

Fix tool use for MLX models
mattt
committed
fb9fe79
Fix Instructions and Prompts builders
mattt
committed
68a019b
Fix MLX tool use
mattt
committed
25e4078
Update example usage
mattt
committed
b72bfbd
Add convenience initializer that takes instructions as string
mattt
committed
6e1035a
Update API usage in tests
mattt
committed
757752f
Add CoreMLLanguageModel
mattt
committed
f6a069f
Update CoreML tests
mattt
committed
fb8047e
Formatting
mattt
committed
467da7e
Update README
mattt
committed
b9f61d9

Commits on Oct 12, 2025

Update OpenAILanguageModel to support both chat completions and responses APIs
mattt
committed
e06e653

Commits on Oct 15, 2025

Add support for streaming
mattt
committed
a7a2919
Fix stream delta accumulation for system language model
mattt
committed
d27b8c7

Commits on Oct 16, 2025

Fix streaming for OpenAI completions API
mattt
committed
cb8f4f3

Commits on Oct 21, 2025

Add documentation comments to models
mattt
committed
10de739

Commits on Oct 22, 2025

Add support for llama.cpp models
mattt
committed
489f172
Conditionalize features with Swift 6.1 package traits
mattt
committed
3395206

Commits on Oct 23, 2025

Core ML Improvements (#1)

pcuenca
and
mattt
authored
b7509ea
Update testing section in README
mattt
committed
c8584fe

Commits on Oct 24, 2025

Fix test failures for OpenAI language model
mattt
committed
dd32e36
Test OpenAI completions and responses API variants
mattt
committed
0fa79e3
Fix OpenAI test failure
mattt
committed
b2b18d1
Delete and ignore Package.resolved
mattt
committed
57411fb

Commits on Oct 27, 2025

Fix Anthropic language model test failures
mattt
committed
29f483f
Add configuration for Anthropic API version and betas
mattt
committed
e2344c4
Make JSON schema reference resolution consistent across language models
mattt
committed
d322ba8
Map sampling options to Ollama parameters
mattt
committed
90e5be8
Add LICENSE.md
mattt
committed
faadd01
Update README
mattt
committed
e9ba407
Add CI workflow (#2)
mattt
authored
edb87d6
Restore Ollama test with generation options
mattt
committed
d021f34
Bump version to 0.1.0
mattt
committed
862f7ea
Fix actions/cache step in CI workflow (#3)
mattt
authored
48dbe4f

Commits on Oct 28, 2025

Add APIs for denoting model availability (#4)
mattt
authored
634e1e9
Demonstrate API compatibility (#5)
mattt
authored
4039053
Document support for OpenAI chat completions
mattt
committed
d583dff
Remove unnecessary indirection for GeneratedContent.kind property
mattt
committed
de63ba4
Change initializer `apiKey` parameter to be a token provider closure (#6)
mattt
authored
6a1dc94
Implement tracking for when language model session is responding (#7)
mattt
authored
38fc352
Update README
mattt
committed
41259d1
Implement transcript recording functionality (#8)
mattt
authored
366cbe5
Bump version to 0.2.0
mattt
committed
083cec3
Update README
mattt
committed
b3ba0bb

Commits on Oct 29, 2025

Fix handling of multiline strings in @Guide macro (#11)
mattt
authored
475c20b

Commits on Oct 31, 2025

Fix code example for OpenAI language model Chat Completions
mattt
committed
587115b
Add Linux job to CI workflow (#13)
mattt
authored
50411bb

Commits on Nov 3, 2025

Add `GeminiLanguageModel` (#17)
mattt
authored
78aaa24
Configure llama temperature only for non-greedy samplers (#18)
mattt
authored
ef021d1

Commits on Nov 5, 2025

Include instructions param in OpenAILanguageModel (#20)
twocentstudios
authored
7db874d
Bump version to 0.3.0 in README
mattt
committed
fc1b6b2

Commits on Nov 6, 2025

Update README
mattt
authored
cd47e30

Commits on Nov 9, 2025

Commits on Nov 11, 2025

Fix concurrency isolation for `Generable` macro expansion (#28)
mattt
authored
ef56a24

Commits on Nov 14, 2025

Commits on Nov 17, 2025

Document security best practices for API credentials (#36)
mattt
authored
a43bc71
Actually stream the data (#31)

nathanborror
and
mattt
authored
330b5a3

Commits on Nov 25, 2025

Re-scope image validation method for Core ML adapter (#42)
mattt
authored
f99c8df

Commits on Dec 1, 2025

Add custom generation options for language models (#50)
mattt
authored
e6278ee

Commits on Dec 3, 2025

Commits on Dec 10, 2025

Commits on Dec 11, 2025

OpenAILanguageModel + SystemLanguageModel tools calling support (#49)

airy10
and
mattt
authored
6348767
Pass instructions as system prompt for MLXLanguageModel (#48)

noorbhatia
and
mattt
authored
738a846
Update README
mattt
committed
df893f0

Commits on Dec 15, 2025

Fix missing iOS availability annotations in SystemLanguageModel extensions (#63)
westonwestenborg
authored
a2928a2

Commits on Dec 17, 2025

Refactor message history construction from Transcription in `MLXLanguageModel` (#66)

noorbhatia
and
mattt
authored
2926772
Implement streaming response for MLXLanguageModel (#64)

XMLHexagram
and
mattt
authored
17b0018
Pass entire transcript to Foundation Models session (#61)
mattt
authored
6caaf9d

Commits on Dec 22, 2025

Commits on Jan 5, 2026

Commits on Jan 15, 2026

Fix PartiallyGenerated for array properties (#88)

ethanhuang13
and
mattt
authored
a4329de

Commits on Jan 19, 2026

Commits on Jan 20, 2026

Implement guided generation for `SystemLanguageModel` (#59)
mattt
authored
9440673

Commits on Jan 27, 2026

Fixed build errors under macCatalyst. (#96)
chenyunguiMilook
authored
1fc0588

Commits on Jan 29, 2026

Revert "Revert "Add custom JSON mode generation option for Gemini language mo…" (#84)
mattt
authored
381e712

Commits on Feb 3, 2026

Fix running tests on macOS 15 (#100)
atdrendel
authored
85eda67
Implement prewarm for MLXLanguageModel (#97)
noorbhatia
authored
7110788

Commits on Feb 4, 2026

Implement structured output generation for both LlamaLanguageModel / MLXLanguageModel (#75)

eastriverlee
and
mattt
authored
37b07e2
Fix simulator tests on Xcode 26 (#101)
atdrendel
authored
ec55a17
Fix tool message content format for DeepSeek API compatibility (#99)

ajason
and
mattt
authored
07b44bc
Add public initializers in LanguageModelSession (#102)
mattt
authored
df82601
Document guided generation support for MLX and Llama (#106)
mattt
authored
95075bf

Commits on Feb 5, 2026

Add tool execution delegate (#109)
mattt
authored
e990e12
Implement guided generation for `AnthropicLanguageModel` (#110)
mattt
authored
1b643dc

Commits on Feb 6, 2026

Commits on Feb 11, 2026

Commits on Feb 17, 2026

Make tool schema inclusion behavior consistent with Foundation Models (#129)
mattt
authored
d7ebe6c
Fix race condition in `LanguageModelSession` when streaming responses (#126)
atdrendel
authored
0c242a4
Make follow-up changes to `Locked` (#131)
mattt
authored
9213b6b
Fix incorrect formatting in OpenAI responses API for tool (#125)

noorbhatia
and
mattt
authored
95273b1
Expand test coverage (#133)
mattt
authored
623ea92

Commits on Feb 19, 2026

Document SwiftPM trait resolution workaround in README (#136)
mattt
authored
9ba2e9d

Commits on Feb 24, 2026

Add `UnavailableReason` for `MLXLanguageModel` (#138)
mattt
authored
d504609

Commits on Mar 23, 2026

Commits on Mar 24, 2026

Commits on Jun 19, 2026

Bump mlx-swift-lm to 3.x (3.31.3) (#161)

noorbhatia
and
pcuenca
authored
7ab55fb

Commits on Jun 20, 2026

Attempt to fix CI (#162)
pcuenca
authored
26b0b98

Commits on Jul 2, 2026

Restore CI matrix (#163)
pcuenca
authored
27c7321
Fix crash in Anthropic Message Decoding (#170)

ActuallyTaylor
and
pcuenca
authored
d5d200e
lint (#171)
pcuenca
authored
80c6246
Move to SHAs for actions (#172)
pcuenca
authored
e2ec302
Enable Dependabot monthly GitHub Actions bumps (#159)

hf-dependantbot-rollout[bot]
and
pcuenca
authored
9500db4
Bump the actions group with 2 updates (#173)
dependabot[bot]
authored
f92ebf8
Restore instructions from transcript (#156)
finnvoor
authored
751a334

Commits on Aug 25, 2026