Senior Software Engineer II - Agentic Intelligence

Role Overview

AI agents at Honeycomb investigate, reason, and act on real observability data. They live in Canvas: the agentic workspace where engineers go to understand their systems.

Responsibilities

• Design and deliver production-grade agents.
• Build agents that investigate, reason, and act on live observability data inside Canvas.
• Own the agent work; support the whole product.
• Scope, build, ship, and maintain the agents including the evals that tell you whether they got better or are just different.
• Build agents only Honeycomb can build.
• Use a data store that returns high-cardinality queries in seconds to reason over signal a conventional backend can't serve at this fidelity correlating across services, drilling into a single trace, comparing before and after a deploy.
• Extend the surface, and decide what's next.
• Ship new capability into Canvas, the MCP server, and Canvas Skills memory, spatial awareness, a faster Bedrock loop and make the case for what comes after with working code.
• Distinguish hype from signal in a field with plenty of both.

Required/Preferred Qualifications

• AI and agent engineering experience, shipped LLM-based systems in production, not demos, not fine-tuned models in a research context.
• End-to-end ownership on a small team, no handoff queue.
• Current judgment, not just past experience.
• Agent architecture depth, understand how a fast, high-cardinality data store changes what an agent can reason about, and how to design for that.
• Product judgment, can look at what the agent layer does today and see what it should do next and make that case with a prototype, not a deck.

Skills

• AI and agent engineering
• LLM-based systems
• Agent architecture
• High-cardinality data store
• Observability or developer-tools background

Experience

• Experience building and deploying AI and agent systems.
• Experience working with high-cardinality data stores.
• Experience with evaluation frameworks, agent tooling, RAG, and prompt engineering.

Location

• Remote (United States)

Compensation

• $183,340 - $206,000 USD

Application Instructions

Visit the application page to apply for this position. Please ensure you have the required skills and experience as described in the job posting. You will need to provide your current resume and answer a set of questions to proceed. If you have any further questions, feel free to contact the recruitment team.