NVIDIA

Quickly set up the NVIDIA LLM service into your NLX workspace

Integrate NVIDIA

1. Select Resources from your workspace menu and choose Integrations card

2. Click Add integration > Choose NVIDIA from the Type dropdown

3. Provide a name for the integration

4. Go to https://build.nvidia.com/explore/discover

5. Select a desired generative AI model

6. Choose Get API Key (may be prompted to log in)

7. Enter the following into NLX:

   • API key

   • Base URL

Optional:

• Model name: Enter the preferred model (.e.g, "meta/llama-3.1-405b-instruct"). Alternatively, you may specify the model while invoking the LLM in conversation using a Generative node type

1. Click Create Integration

Next steps

To successfully use your NVIDIA integration with conversations created in your workspace, be sure to complete the following:

• create a flow

• add a Generative node type to the Canvas and assign NVIDIAI as the integration > Provide your prompt (follow instructions under Side panel tab of Generative node instructions)

• create a build & deploy