Skip to main content

Chat API

The Chat API is a high-level wrapper around Large Language Models tightly integrated with the Arrotech Hub tool execution engine.

If you don't want to build your own complex routing logic to decide when an LLM should trigger an MCP tool, the Chat API handles it all for you.

Features​

  • Conversational Memory: Conversations are assigned a conversation_id, and Arrotech Hub stores the message history.
  • Provider Agnostic: Switch seamlessly between OpenAI, Anthropic, or local Ollama instances based on your available providers.
  • Automatic Tool Execution: If a user asks "What is my latest Zoho Lead?", the Chat API will automatically use the user's Zoho connection to fetch the data and summarize it in the response.

Get Started​

To create a new conversation and send a message, look at the POST /chat/conversations and POST /chat/conversations/{conversation_id}/messages endpoints inside the Chat API Reference.