Middleware Engineer
Job Description
We are looking for a Middleware Development Engineer specializing in Rust to design and build high-impact systems software.
Experience: 6+ years
Location: Remote Position Type: Full-time
About the Role In this role, you will bridge the gap between low-level hardware compute capabilities and developer-friendly runtime APIs. Your focus will be on developing Rust-based GPU middleware and actively driving open-source ecosystems focused on multi-vendor hardware acceleration. You will design, optimize, and maintain safe, ergonomic, and high-performance abstractions that connect modern Rust applications (used in AI, HPC, and performance-critical fields) with underlying compute stacks.
This role involves close collaboration with internal engineering teams, open-source maintainers, and the broader developer community to build tools that scale seamlessly from local machines to distributed production cluster environments.
Responsibilities
• Architecture & Design: Develop and maintain reliable Rust middleware and runtime abstraction layers for GPU-accelerated operations.
• Open Source Stewardship: Contribute directly to open-source crates and ecosystem bindings, shaping API designs, implementing new features, and reviewing community code.
• Safe Abstractions: Create high-performance, memory-safe Rust interfaces over low-level compute concepts, including memory management, kernel execution, module loading, and asynchronous workflows
• System Integration: Optimize data paths and integration layers between Rust AI/HPC applications and underlying GPU hardware stacks.
• Performance Engineering: Diagnose complex system-level bottlenecks related to concurrency, multi-device scheduling, memory layouts, and latency
• Benchmarking & Validation: Build robust testing strategies using representative workloads to analyze throughput, resource utilization, and execution
• Cross-Functional Collaboration: Partner with architects, performance experts, and product teams to align technical roadmaps with open-source evolution and business strategy.
Qualifications
• Degree in Computer Science, Software Engineering, or equivalent practical experience.
Required Skills
• Strong 6+ professional software engineering background with a deep focus on Rust
• .Solid grasp of systems programming principles: memory management, concurrency models, and low-level optimization.
• Practical, hands-on understanding of GPU computing fundamentals
• Proven experience participating in open-source workflows (PRs, issue triage, RFCs, and code reviews).
• Ability to profile, benchmark, and debug across application, runtime, and infrastructure layers.
Preferred Skills
• Strong proficiency in C++ (highly preferred due to low-level backend integration)
• Familiarity with parallel programming models and API ecosystems like SYCL, CUDA, or OpenCL
• Excellent written and verbal English communication skills, suitable for open-source community engagement and cross-functional teamwork.
