AI Developer
Salvo Software
About this role
## AI Developer — Salvo Software ### About the role Salvo Software is a global technology company specializing in custom software development and advanced engineering solutions. With distributed teams across the US, LATAM, and India, we build high-performance, scalable systems for complex technical challenges. We’re growing our AI department and looking for a **hands-on AI Developer** to help build and operate **LLM-powered systems**. This is a production-focused role—**you don’t need to be a deep ML researcher**, but you do need strong engineering fundamentals and the ability to learn quickly. ### Core responsibilities **AI / LLM Engineering (core focus)** - Serve and operate **open-source LLMs** using **Ollama** and **llama.cpp** (local and on-prem) - Build and maintain **RAG pipelines** (embeddings, vector databases, chunking strategies, retrieval quality) - Develop **MCP (Model Context Protocol)** integrations connecting LLMs to internal tools and data sources - Build backend services in **Python** to power ML inference and AI-driven product features - Parse and process structured/semi-structured inputs (e.g., **XML/XSD**, Office document formats) - Grow into model optimization over time (e.g., **quantization (GGUF)**, **GPU/CUDA tuning**, offline/air-gapped deployments) **DevOps & Infrastructure (supporting)** - Build and maintain **CI/CD** pipelines for AI services (Azure DevOps preferred; GitHub Actions / GitLab CI also used) - Deploy AI workloads to **Microsoft Azure** and **AWS**; containerize with **Docker** - Automate operational tasks with **Python**, **Bash**, and/or **PowerShell** - Troubleshoot across the stack with a **root-cause** mindset - Support event-driven architectures using **Apache Kafka** (producers/consumers) ### Requirements - **3–5+ years** production engineering experience with **Python** building real services and automated tooling - Hands-on experience with LLM/AI integration (Ollama/llama.cpp), **RAG**, and **MCP** integrations - Cloud & infrastructure experience: **Azure/AWS**, **Docker**, Linux/Windows administration, **CI/CD** automation - Familiarity with observability and operations (e.g., **Prometheus/Grafana**), plus DevSecOps/security awareness - Strong problem-solving, communication, ownership, and ability to collaborate in a distributed/remote team ### Nice to have - GPU/CUDA tuning and model quantization experience - **Terraform**, **Kubernetes**, **Kafka**, or systems languages (Go/Rust/C++) - Experience with compliance frameworks (e.g., **SOC 2**, **ISO 27001**, **Zero Trust**) --- ### Application note Please mention the word **BREAKTHROUGHS** and tag **RMmEwNjo5OGMwOjM2MDA6OjEwMw==** when applying to show you read the job post completely.
Listing freshness
CronJobs last confirmed this listing 2h ago. If its source stops confirming the opening for seven days, this page is removed from active inventory.