Skip to content

feat: integrate MLCChat module for on-device LLM functionality#2

Open
steven-studio wants to merge 2 commits into
mainfrom
feature/coreml-llama
Open

feat: integrate MLCChat module for on-device LLM functionality#2
steven-studio wants to merge 2 commits into
mainfrom
feature/coreml-llama

Conversation

@steven-studio
Copy link
Copy Markdown
Owner

  • Added MLCChat Swift package and configured library dependencies
  • Set up iOS build settings to include MLCChat’s .a/.framework
  • Updated mlc-package-config.json to support the new model workflow
  • Verified that local LLM inference now runs successfully

Reason:
Enables users to run MLCChat-based on-device LLM inference without relying on external API calls.

- Added MLCChat Swift package and configured library dependencies
- Set up iOS build settings to include MLCChat’s .a/.framework
- Updated mlc-package-config.json to support the new model workflow
- Verified that local LLM inference now runs successfully

Reason:
Enables users to run MLCChat-based on-device LLM inference without relying on external API calls.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant