AI Architect
TripActions · New York, NY
About this role
**About the Role** We are building AI capabilities that improve important human workflows across the company. As **AI Architect**, you will set the technical direction for how we design, evaluate, integrate, and operate AI systems—ensuring they meet clear standards for **quality, reliability, safety, and value**. This is a **strategic, hands-on** role. You will establish reusable architecture and evaluation practices, guide cross-functional teams, and prototype or validate key patterns where needed. You’ll partner with product and engineering leaders to turn high-value opportunities into systems that can be **measured and operated in production**. --- **What You’ll Do** - **Set AI architecture direction:** Define reference architectures and design principles for AI services, agents, model integrations, data/context flows, tools, and human review. Make trade-offs across quality, autonomy, reliability, latency, cost, and complexity. - **Build the evaluation discipline:** Define expected behavior and success measures; design representative datasets and evaluation methods; write and maintain evals; establish regression checks and quality thresholds; use results to prioritize improvements. - **Guide production readiness:** Shape shared practices for tracing/observability, versioning, monitoring, incident response, privacy, security, and lifecycle management of AI systems. - **Enable teams to ship:** Create reusable patterns, reference implementations, and practical guidance. Coach engineers through architecture reviews and help move valuable work from prototype to production. - **Connect architecture to outcomes:** Partner with product, operations, and domain teams to identify workflow needs and measure whether AI improves completion, quality, time, or other agreed outcomes. - **Stay close to implementation:** Prototype high-risk or foundational designs, review critical implementations, and refine architecture using production evidence. - **Track the evolving ecosystem:** Evaluate models, agent runtimes, orchestration approaches, and evaluation tooling against requirements; recommend adoption based on evidence. --- **What We’re Looking For** - **8+ years** of experience in backend software development. - **3+ years** of experience in AI architecture with demonstrated organization-wide impact. - Strong experience designing and delivering production software systems, with substantial work on AI/ML-powered products or services. - Track record of setting technical direction across teams and influencing decisions through evidence and collaboration. - Practical understanding of **LLM applications**, including retrieval and context construction, tool use, agent patterns, model selection, and failure handling. - Experience defining quality expectations and building evaluations.
Listing freshness
CronJobs last confirmed this listing 2h ago. If its source stops confirming the opening for seven days, this page is removed from active inventory.