Skip to main content
View source

Amazon Bedrock

View as Markdown

A RocketRide LLM node that connects Amazon Bedrock-hosted foundation models to a pipeline.

What it does

Provides an llm invoke connection backed by Amazon Bedrock. It is used primarily by agents and other nodes that need an LLM, and can also be wired directly via lanes: text arriving on the questions lane is answered on the answers lane.

Uses langchain-aws (ChatBedrock) on top of boto3 / botocore. The chat client is created once per pipeline run with a fixed temperature of 0; the output token cap is taken from the model's configured output-token limit.

The node automatically prepends a cross-region inference prefix to the model ID based on the configured AWS region: eu. for eu* regions, apac. for ap* regions, and us. otherwise (for example, meta.llama3-3-70b-instruct-v1:0 becomes us.meta.llama3-3-70b-instruct-v1:0 in us-east-1). Model IDs that are ARNs or already carry a us. / eu. / apac. prefix are left untouched.

When you save the node configuration, it is validated with a minimal live API call ("Hi") against the selected model, so credential, model, and region problems surface immediately instead of at pipeline runtime.


Configuration

Lanes

Lane inLane outDescription
questionsanswersSend a question directly, receive a generated answer

Fields

FieldTypeDescription
modelstringBedrock LLM model name or ARN for custom or provisioned models
modelTotalTokensnumberTotal Tokens
profilestringDefault "meta_llama3_3-70b". LLM model

model and modelTotalTokens only appear when the Custom profile is selected; the built-in profiles set both for you.


Profiles

The default profile is Llama 3.3 70B Instruct (meta_llama3_3-70b). All profiles default to region us-east-1.

Anthropic

ProfileModel IDContext
Claude Sonnet 4.5anthropic.claude-sonnet-4-5-20250929-v1:0200K tokens
Claude Haiku 4.5anthropic.claude-haiku-4-5-20251001-v1:0200K tokens
Claude Opus 4anthropic.claude-opus-4-20250514-v1:0200K tokens
Claude Opus 4.5anthropic.claude-opus-4-5-20251101-v1:0200K tokens
Claude Sonnet 3.7anthropic.claude-3-7-sonnet-20250219-v1:0200K tokens
Claude Haiku 3.5anthropic.claude-3-5-haiku-20241022-v1:0200K tokens

Meta

ProfileModel IDContext
Llama 3.3 70B Instruct (default)meta.llama3-3-70b-instruct-v1:0128K tokens
Llama 4 Scout 17B Instructmeta.llama4-scout-17b-instruct-v1:03.5M tokens
Llama 4 Maverick 17B Instructmeta.llama4-maverick-17b-instruct-v1:01M tokens
Llama 3.2 90B Vision Instructmeta.llama3-2-90b-instruct-v1:0128K tokens
Llama 3.2 11B Vision Instructmeta.llama3-2-11b-instruct-v1:0128K tokens
Llama 3.2 3B Instructmeta.llama3-2-3b-instruct-v1:0128K tokens
Llama 3.2 1B Instructmeta.llama3-2-1b-instruct-v1:0128K tokens
Llama 3.1 70B Instructmeta.llama3-1-70b-instruct-v1:0128K tokens
Llama 3.1 8B Instructmeta.llama3-1-8b-instruct-v1:0128K tokens

Amazon

ProfileModel IDContext
Nova 2 Liteamazon.nova-2-lite-v1:01M tokens
Titan Text Expressamazon.titan-text-express-v18K tokens

AI21

ProfileModel IDContext
Jamba 1.5 Largeai21.jamba-1-5-large-v1:0256K tokens
Jamba 1.5 Miniai21.jamba-1-5-mini-v1:0256K tokens

Cohere

ProfileModel IDContext
Command R+cohere.command-r-plus-v1:0128K tokens
Command Rcohere.command-r-v1:0128K tokens

Custom

Select the Custom profile to use any Bedrock model not in the list. Provide the full provider-prefixed model ID (e.g. anthropic.claude-3-7-sonnet-20250219-v1:0) or an ARN for a custom or provisioned model, plus the model's total token limit. Bare model names without a provider prefix are rejected at save time with a validation warning. See the Bedrock model IDs reference for available identifiers.


Authentication

Provide an AWS access key ID and secret access key with permission to invoke the chosen Bedrock model in the configured region. Credentials are passed directly to the Bedrock client and are not persisted by the node.

Save-time validation performs a minimal test invocation and reports provider errors verbatim. One gotcha: Bedrock returns a ValidationException (HTTP 400) when the region does not match your account or model availability, while incorrect keys surface as different error types. If you see a ValidationException during validation, verify the AWS region first.


Schema

FieldTypeDescriptionDefault
bedrock.profilestringModel
LLM model
"meta_llama3_3-70b"
modelstringModel
Bedrock LLM model name or ARN for custom or provisioned models
modelTotalTokensnumberTokens
Total Tokens

Dependencies

  • langchain-aws
  • langchain-core
  • langchain
  • boto3
  • botocore