LLM Chat
Run text through a language model for writing, reasoning, extraction, or transformation.
Audience
Creators building and publishing workflows.
Overview#
LLM Chat is the main text-generation block. It accepts upstream data plus instructions, runs a selected model, and returns a response for the next step.
Use it for rewriting, summarizing, classifying, analyzing, or any job that needs language understanding. The current catalog default is gpt-5.6-terra.
LLM Chat
Ports#
- Input: Input: Connected upstream text or JSON-like content.
- Output: Response: The model's generated text for downstream blocks.
Inspector#
- Prompt: Instructions used when Input is not connected, or as guidance alongside connected data.
- Style / System (optional): Tone, role, and constraints for the model.
- Model: Choose among the current catalog options and trade off quality, cost, and speed. Match the provider requirements for the listing's credential mode.
- Max Tokens: Cap on response length; align it with what the product should return.
- Stream and Safe Mode: Inline toggles for live streaming and safer defaults.
Tips#
- Give each LLM block one clear job instead of stacking many tasks in one prompt.
- Feed raw data through Input; keep transformation instructions in the prompt.
- Use a stronger model for nuanced writing; lighter models for fast utility work.
- Set max tokens close to the expected answer length to avoid waste.
Related#
Was this useful?
Your response helps us improve the documentation.