Deep InfraDeep Infra

Software Engineer

Added 2 months ago

Description

Software Engineer

What You’ll Do

  • Design, develop, and test inference solutions for state-of-the-art AI models
  • Implement, optimize, and evaluate AI models using Python, C++, CUDA, and NCCL
  • Own and operate production model-serving systems, including monitoring and debugging
  • Build new features, improve system performance, and contribute to overall system design
  • Participate in code reviews and technical discussions to maintain high engineering standards
  • Explore and apply new AI/ML techniques to improve model performance and efficiency
  • Take ideas from concept to production

What You Bring

  • Bachelor’s or Master’s degree in Computer Science, Computer Engineering, or a related field
  • 1–4 years of relevant experience, including early full-time roles or research
  • Strong fundamentals in data structures, algorithms, and software design
  • Proficiency in Python and experience working with AI/ML frameworks (e.g., PyTorch, TensorFlow)
  • Hands-on experience building, shipping, and maintaining software systems
  • Familiarity with AI models, Transformers, and Diffusers
  • Experience working with version control (Git) and collaborative development workflows
  • Ability to debug, optimize, and improve existing systems
  • Strong communication skills and ability to work independently in a fast-paced environment

Bonus

  • Experience with C++, CUDA, or AI inference
  • Contributions to open-source ML projects

Why DeepInfra

  • Work on cutting-edge AI model serving - the systems that power the next generation of LLMs and multimodal models.
  • Small team, huge impact: your work ships directly to customers.
  • Opportunity to learn from engineers building high-performance inference at scale.
  • Fast-paced environment with ownership, autonomy, and end-to-end responsibility.

Company

Deep Infra provides low-latency, cost-efficient inference infrastructure and a marketplace of 100+ models for scalable AI deployment.

See more software engineer remote jobs