AI models are the brain of AI agents, as they are able to reason, talk, and generate payloads for the tools that the agent can use.

There are two ways to approach models on Blaxel:

  • Using an external model API provider (e.g. OpenAI, Together, etc.): Blaxel acts as a unified gateway for model APIs, centralizing access credentials, tracing and telemetry. You can achieve this by defining workspace integrations to any major model API provider, and creating gateway endpoints on Blaxel for any of their models.
  • Bringing your own model: Deploy a custom model on Blaxel, allowing you to use fine-tuned SLMs/LLMs or any other kind of AI model. When a model is deployed on Blaxel, you get global API endpoint to call it. This option is part of our Enterprise offering, contact us at support@blaxel.ai for more information.

External model APIs

Complete guide for connecting to an external model provider like Anthropic or OpenAI.