Hugging Face Chat UI

Use Workers AI with Chat UI, an open-source chat interface offered by Hugging Face.

Prerequisites

You will need the following:

• A Cloudflare account
• Your Account ID
• An API token for Workers AI

Setup

First, decide how to reference your Account ID and API token (either directly in your .env.local using the CLOUDFLARE_ACCOUNT_ID and CLOUDFLARE_API_TOKEN variables or in the endpoint configuration).

Then, follow the rest of the setup instructions in the Chat UI GitHub repository.

When setting up your models, specify the cloudflare endpoint.

{
  "name" : "nousresearch/hermes-2-pro-mistral-7b",
  "tokenizer": "nousresearch/hermes-2-pro-mistral-7b",
  "parameters": {
    "stop": ["<|im_end|>"]
  },
  "endpoints" : [
    {
      "type": "cloudflare",
      // optionally specify these if not included in .env.local
      "accountId": "your-account-id",
      "apiToken": "your-api-token"
      //
    }
  ]
}

Supported models

This template works with any text generation models that begin with the @hf parameter.