Custom Connections

Connect Your Own LLMs

Connect your self-hosted LLMs, local models, or custom API endpoints to power with Palo. Perfect for Ollama, private deployments, and specialized models. Read our integration guide ↗.

View documentation

Add New Custom Connection

Step 1: Verify Compatibility

Ensure your LLM API meets our requirements for integration.

API Endpoint URL *

Your LLM API must be accessible from the internet or through a secure tunnel.

API Format *

Select format...

OpenAI-compatible

Ollama

Anthropic-compatible

Custom (advanced)

Choose the API format your LLM uses.

Compatibility Requirements

✓ Supports HTTP/HTTPS POST requests
✓ Accepts JSON request/response format
✓ Returns streaming or non-streaming responses
✓ Accessible from the internet (or via secure tunnel)

Step 2: Configure Authentication

Set up authentication for your LLM API endpoint.

Connection Name *

Authentication Type

None

Bearer Token

API Key

Basic Auth

Step 3: Model Configuration

Configure the default model and advanced settings.

Default Model Name *

Max Tokens (Optional)

Temperature (Optional)

Timeout (seconds)

Secure Tunnel (Optional)

Use Cloudflare Tunnel for enhanced security and metrics. Included in Connectivity Plus

Enable Secure Tunnel

Automatically creates a secure tunnel for local endpoints

Tunnel Name (Optional)