Bring Your Own Model

Intro

This article explains how to set up Bring Your Own Model (BYOM).

---

Import Your Model

1. Select AI Models from the main menu.

2. Select Add Model.

Select an Adapter

3. For this example, select Meta (Amazon Bedrock), then select Next.

Select an Account

4. Choose a corresponding account, or create a new one. For this example, select an Amazon Bedrock account.

Import a Model

5. Select the model to import. For this example, import the Llama 3 70B Instruct model.

Configure Tasks

6. Define the Task the model performs, including the input and output schemas.

Configuration

7. Fine-tune the setup, then select Import Model.

Configure Your Model

1. Select the Text Generation service from the AI Service Models page in Admin Settings.

2. Select Add Model.

3. Select your newly imported model — in this case, Llama 3 70B Instruct.

4. The new model is now listed and available for use. Set it as the default model for this service, or leave it available for programmatic use only.

Use Your Model

1. Select AI Playground from the main menu.

Use the Text Generation service with the default Domo model, DomoGPT - Medium v2.2.

2. Ask the model “Who is your creator?” to confirm which vendor it belongs to.

3. Select Llama 3 70B Instruct from the Model dropdown.

4. Ask this model “Who is your creator?”