Software Engineer - Infrastructure (Mid - Senior) Job at Julius Ai, San Francisco, CA

  • Julius Ai
  • San Francisco, CA

Job Description

Compensation: Competitive base salary and meaningful equity

Benefits: Health & dental insurance, gym reimbursement, daily team meals, commuter benefits

We’re an applied AI lab building coding agents. Julius executes ~1M lines of code every 36 hours for 1M+ users and has generated 3M+ visualizations. All code runs in code sandboxes ( isolated remote containers ) that we manage. We’re revenue‑generating and backed by AI Grant, YCombinator, Bessemer Venture Partners and the founders from Vercel, Notion, Perplexity, Palantir, Replit, Zapier, Intercom, and Dropbox.

The Role

Build and scale the code‑execution sandboxes that power Julius across cloud environments (AWS and GCP). We orchestrate 500k+ containers/month and growing. You’ll own reliability, performance, and security for multi‑tenant compute.

What You’ll Do

  • Design and operate secure, multi‑tenant container infrastructure with fast startup and smart autoscaling.

  • Ship cloud deployments (Helm/Terraform) with SSO, network controls, and audit logging.

  • Drive observability (metrics, traces, logs) with clear SLOs; lead incident response.

  • Optimize images, scheduling, networking, and cost ; build fair‑use and rate‑limiting controls.

What You Bring

  • Production Kubernetes and container internals (Docker/containerd); strong networking fundamentals.

  • Cloud (AWS/GCP/Azure) and IaC (Terraform/Helm).

  • Monitoring/Logging (Prometheus, Grafana, OpenTelemetry, ELK/Vector).

  • Security best practices for containerized, multi‑tenant systems.

Nice to Have

  • gVisor/Kata/Firecracker; Cilium/eBPF; GPU scheduling; serverless autoscaling (KEDA/Knative/Karpenter).

  • You’ve built an AI side project and enjoy tinkering with LLMs.

Why Julius

Small, senior team; massive impact surface; hard infra problems at meaningful scale.

Job Tags

Full time, Remote work

Similar Jobs

Midwest Orthopaedic Consultants

Medical Receptionist (Polish Speaking Required) Job at Midwest Orthopaedic Consultants

Job Description Job Description Midwest Orthopaedic Consultants is calling all customer service rockstars who would like to work at our clinics in Orland Park, IL and Oak Lawn, IL to apply to join our team as a full-time Medical Receptionist . If you have a ...

City of Hyattsville (MD)

Director of Finance Job at City of Hyattsville (MD)

 ...Charter Designation: City Treasurer (Charter-established office; the incumbent serves as City Treasurer) The Director of Finance serves as the City of Hyattsvilles Chief Financial Officer and City Treasurer, a Charter-established office, and is responsible for the... 

Zen Educate

Substitute Teacher for Charter Schools Job at Zen Educate

 ...for the 2026-2027 School Year!\n Were hiring Primary School Teachers for the to support students in classrooms. Youll work with...  ...for students. \n We're looking for adaptable and committed substitute teachers to support learning across a single school building.... 

AMD

Logistics Manager Job at AMD

 ...solve the world's most important challenges. From advancing healthcare and scientific discovery to powering AI and the technologies...  ...while supporting the reliable movement of products through the supply chain. You will collaborate with Supply Chain Planning, Procurement... 

West New York EMS

Long Term Substitute Science Teacher Job at West New York EMS

 ...Closing Date Please make sure to complete an application by clicking here for this job posting. Long Term Substitute Science Teacher Job Attachment View Attachment Salary: From 45000.00 Appointment Status Long Term Sub Start...