LLM Chat

A Rails app for chatting with LLM models. Powered by ruby_llm. Similar to Librechat.

Ruby LLM provides a basic Rails generator to build a chat UI. This extends it.

What's added

• A redesigned chat screen. Conversations live in a sidebar next to the chat.
• Only models you can actually use. The new-chat list offers models whose provider is configured.
• Per-chat settings. Title, model, system prompt, reasoning effort, and temperature.
• Delete messages. Any user or assistant message can be deleted.
• Cost and token tracking. Each reply shows what it cost, and the settings sheet summarises the conversation's spend and token use.
• Built on Poetry. Poetry components.

Running it locally

Requires Ruby, PostgreSQL, and an API key for at least one provider.

bin/setup
bin/dev

Keys come from the environment or Rails credentials:

export OPENROUTER_API_KEY=...
export OPENAI_API_KEY=...

The server refuses to start until at least one provider has a key.