Skip to content

Conversation

@baasitsharief
Copy link
Collaborator

@baasitsharief baasitsharief commented Oct 13, 2025

  • noticed .global added as a prefix for cross region inference and breaks multiple bedrock models.

Error

Traceback (most recent call last):
  File "llm-service/app/exceptions.py", line 74, in _exception_propagation
    yield
  File "llm-service/app/exceptions.py", line 139, in exception_propagation_wrapper
    return f(*args, **kwargs)
  File "llm-service/app/routers/index/sessions/__init__.py", line 90, in suggest_questions
    suggested_questions=generate_suggested_questions(
  File "llm-service/app/services/chat/suggested_questions.py", line 139, in generate_suggested_questions
    response, _ = querier.query(
  File "llm-service/app/services/query/querier.py", line 228, in query
    chat_engine = build_flexible_chat_engine(configuration, llm, retriever)
  File "llm-service/app/services/query/chat_engine.py", line 285, in build_flexible_chat_engine
    chat_engine: FlexibleContextChatEngine = FlexibleContextChatEngine.from_defaults(
  File "llm-service/.venv/lib/python3.10/site-packages/llama_index/core/chat_engine/condense_plus_context.py", line 156, in from_defaults
    chat_history=chat_history, token_limit=llm.metadata.context_window - 256
  File "llm-service/.venv/lib/python3.10/site-packages/llama_index/llms/bedrock_converse/base.py", line 294, in metadata
    context_window=bedrock_modelname_to_context_size(self.model),
  File "llm-service/.venv/lib/python3.10/site-packages/llama_index/llms/bedrock_converse/utils.py", line 166, in bedrock_modelname_to_context_size
    raise ValueError(
ValueError: Unknown model: global.anthropic.claude-sonnet-4-20250514-v1:0. Please provide a valid Bedrock model name. Known models are: amazon.nova-pro-v1:0, amazon.nova-lite-v1:0, amazon.nova-micro-v1:0, amazon.titan-text-express-v1, amazon.titan-text-lite-v1, amazon.titan-text-premier-v1:0, anthropic.claude-instant-v1, anthropic.claude-v1, anthropic.claude-v2, anthropic.claude-v2:1, anthropic.claude-3-sonnet-20240229-v1:0, anthropic.claude-3-haiku-20240307-v1:0, anthropic.claude-3-opus-20240229-v1:0, anthropic.claude-3-5-sonnet-20240620-v1:0, anthropic.claude-3-5-sonnet-20241022-v2:0, anthropic.claude-3-5-haiku-20241022-v1:0, anthropic.claude-3-7-sonnet-20250219-v1:0, anthropic.claude-opus-4-20250514-v1:0, anthropic.claude-sonnet-4-20250514-v1:0, ai21.j2-mid-v1, ai21.j2-ultra-v1, cohere.command-text-v14, cohere.command-light-text-v14, cohere.command-r-v1:0, cohere.command-r-plus-v1:0, meta.llama2-13b-chat-v1, meta.llama2-70b-chat-v1, meta.llama3-8b-instruct-v1:0, meta.llama3-70b-instruct-v1:0, meta.llama3-1-8b-instruct-v1:0, meta.llama3-1-70b-instruct-v1:0, meta.llama3-2-1b-instruct-v1:0, meta.llama3-2-3b-instruct-v1:0, meta.llama3-2-11b-instruct-v1:0, meta.llama3-2-90b-instruct-v1:0, meta.llama3-3-70b-instruct-v1:0, meta.llama4-maverick-17b-instruct-v1:0, meta.llama4-scout-17b-instruct-v1:0, mistral.mistral-7b-instruct-v0:2, mistral.mixtral-8x7b-instruct-v0:1, mistral.mistral-large-2402-v1:0, mistral.mistral-small-2402-v1:0, mistral.mistral-large-2407-v1:0, openai.gpt-oss-120b-1:0, openai.gpt-oss-20b-1:0, ai21.jamba-1-5-mini-v1:0, ai21.jamba-1-5-large-v1:0, deepseek.r1-v1:0

@mliu-cloudera
Copy link
Collaborator

mliu-cloudera commented Oct 14, 2025

Specifically here, llama-index-llms-bedrock-converse>=0.10.3 adds support (run-llama/llama_index#20064) for the new "Global" cross-Region inference profile (https://aws.amazon.com/about-aws/whats-new/2025/09/amazon-bedrock-global-cross-region-inference-anthropic-claude-sonnet-4/).

@baasitsharief baasitsharief merged commit 39d984d into main Oct 14, 2025
3 checks passed
@baasitsharief baasitsharief deleted the bs/bump-llama-index-bedrock-converse branch October 14, 2025 22:58
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants