AI Software Engineer

Software Engineer - AI

The MangoBoost AI SW group is looking for highly motivated, dynamic Software Engineers to help us develop/test/automate/implement software for our cutting-edge DPU technology. Are you passionate about new technology and looking forward to working on next-generation AI and DPU Products?

As a software engineer in the AI SW group, you will be establishing software solutions for a multitude of platforms working directly with NVIDIA and AMD GPUs alongside our MangoBoost DPUs. You will have a direct impact on the MangoBoost AI SW stack used to demonstrate world-class leadership in DPU accelerated AI. You should be comfortable working with the standard AI software stack (Pytorch, CUDA, ROCm) and cutting-edge concepts (RAG, Vector Databases) as well as writing new libraries for improving system-level performance.

What you’ll be doing:

• Developing, Testing and Maintaining the MangoBoost AI SW stack.
• Innovate and improve our GPU and DPU libraries with new features to improve system-level performance of distributed AI.
• Understand and use the NVIDIA and AMD GPU performance monitoring systems
• Multiple opportunities to collaborate and communicate effectively with teams from all around the globe.

What we need to see:

• BS or MS or PhD degree in Computer Engineering, Computer Science, or equivalent experience
• Background in solving problems that apply to large complex systems deployed at scale.
• Strong programming skills, OOPS, Data structures, and Algorithms.
• Strong programming ability in C, C++ and Python.
• Familiarity with computer architecture (e.g.: x86, ARM CPUs, GPUs)

Ways to stand out from the crowd:

• Background including shipping system software and optimization of AI system software
• Knowledge of GPU API's such as: CUDA, OpenCL, ROCm
• Experience in performance analysis, particularly of GPU applications
• You have worked on computer algorithms and proven ability to choose the best possible algorithms to nail complex problems
• Knowledge or experience in compute architecture, operating systems, and compilers.
• Familiarity with Kubernetes for orchestrating AI workloads across multi-node GPU clusters
• Experience deploying and optimizing containerized inference/training pipelines using Docker and Kubernetes
• Understanding of Kubernetes-native tools such as Helm, Kustomize, or custom operators for managing AI infrastructure

With highly competitive salaries and a comprehensive benefits package, MangoBoost is an up and coming startup that is widely considered to be one of the technology world’s most desirable employers. We have some of the most brilliant and talented people in the world working for us. If you're creative and independent, with a genuine passion for technology, we want to hear from you.