Skip to content

[bot] Instrument aws-sdk-bedrockagentcore (43K weekly downloads) #205

Description

@braintrust-bot

Summary

The aws-sdk-bedrockagentcore gem is the official, auto-generated AWS SDK client for Amazon Bedrock AgentCore — AWS's newer (2025-era) managed runtime for deploying and operating AI agents (and non-Bedrock, framework-agnostic agents, e.g. built with LangGraph/CrewAI/Strands) at scale. It exposes a distinct agent-run execution API (invoke_agent_runtime) separate from both raw model invocation and the classic Agents-for-Bedrock API, and is not instrumented by this SDK.

This is a separate gem/service from both aws-sdk-bedrockruntime (tracked in #152 — raw converse/invoke_model calls) and aws-sdk-bedrockagentruntime (classic Bedrock Agents invoke_agent, a distinct gem/API from this one). AgentCore Runtime is purpose-built to host and invoke arbitrary agent code (any framework, any model provider) as a managed session-based execution boundary — a clear, high-value agent-run tracing surface for a Ruby SDK whose stated purpose includes agent-execution observability.

What is missing

No instrumentation exists for any aws-sdk-bedrockagentcore execution surface. Key API:

  • client.invoke_agent_runtime(agent_runtime_arn:, runtime_session_id:, payload:, qualifier:, content_type:, accept:, mcp_session_id:, mcp_protocol_version:, ...) — Invokes a deployed AgentCore Runtime (the hosted agent) for one turn within a session, returning the agent's response payload (supports both buffered and streaming/SSE responses). This is the primary execution entry point for any agent hosted on AgentCore, regardless of the underlying agent framework or model provider — the direct agent-run analog to this SDK's existing model-call instrumentation.
  • Related generative/agent surfaces on the same client: invoke_code_interpreter (executes code in an AgentCore-managed sandbox) and invoke_browser (drives an AgentCore-managed browser tool) — both are tool-execution calls typically made during an agent run.

What a span should capture

  • Input: payload (the agent request body), runtime_session_id, agent_runtime_arn, qualifier (endpoint/version)
  • Metadata: provider (aws-bedrock-agentcore), content_type, mcp_session_id/mcp_protocol_version when present (AgentCore Runtime supports exposing agents as MCP servers)
  • Output: response payload, content_type/accept of the response, streaming status
  • Child spans: invoke_code_interpreter/invoke_browser calls made mid-run, mirroring how this SDK already models tool-call child spans for other integrations

Weekly downloads

43K (as of 2026-08-10; https://clickgems.clickhouse.com/dashboard/aws-sdk-bedrockagentcore) — ClickGems reports Last day / Last week / Last month / Total downloads sourced from RubyGems.org's public download dataset; RubyGems.org itself only exposes total and per-version download counts, not a weekly figure, so ClickGems was used as the directly-reported weekly stat.

Additional signal: current version 1.46.0 (per https://rubygems.org/api/v1/gems/aws-sdk-bedrockagentcore.json, checked 2026-08-10), part of the AWS SDK for Ruby's continuous auto-generated release train; total downloads 2,273,730 — notably high relative to the service's 2025 launch, indicating fast-growing adoption.

Braintrust docs status

not_found — Checked https://www.braintrust.dev/docs/integrations/sdk-integrations (Ruby-relevant tracing integrations list only OpenAI, Anthropic, Ruby LLM/ruby-openai; the separate "Agent frameworks" section lists OpenAI Agents SDK, Claude Agent SDK, LangGraph, CrewAI, AutoGen, Google ADK, Strands Agents SDK, Mastra, Pydantic AI, etc. — no Amazon Bedrock AgentCore entry) and https://www.braintrust.dev/docs generally. No mention of Bedrock AgentCore, BedrockAgentCore, or invoke_agent_runtime anywhere in Braintrust's documentation.

Upstream sources

Braintrust docs sources checked

Local repo files inspected

  • lib/braintrust/contrib.rb — registers only 4 integrations: OpenAI, RubyOpenAI, RubyLLM, Anthropic. No AWS/Bedrock integration of any kind.
  • lib/braintrust/contrib/ — contains only openai/, ruby_openai/, ruby_llm/, anthropic/, and rails/ directories. No bedrock or aws directory.
  • Appraisals — no appraisal scenarios for aws-sdk-bedrockagentcore or any AWS gem
  • braintrust.gemspec — no mention of aws or bedrock
  • Grep for bedrock, Bedrock, AgentCore, invoke_agent_runtime across lib/braintrust/ returns zero matches
  • Confirmed issue [bot] aws-sdk-bedrockruntime gem not instrumented #152 (aws-sdk-bedrockruntime-not-instrumented) covers only the separate Aws::BedrockRuntime::Client (converse/invoke_model); searched all 46 currently-open issues and found no existing issue mentioning BedrockAgent or AgentCore, so this is a distinct, non-duplicate gap from both [bot] aws-sdk-bedrockruntime gem not instrumented #152 and the newly-filed aws-sdk-bedrockagentruntime gap.

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions