About the Role

Software Engineer - Kernels

What MatX Is Building

MatX is on a mission to be the compute platform for AGI. We are developing vertically integrated full-stack solutions from silicon to systems including hardware and software to train and run the largest ML workloads for AGI. We primarily use the Rust programming language.

What You'll Do Here

• Design and optimize kernels that interface directly with our hardware

• Work in partnership with our ML Research and Hardware Engineering teams

• Provide expertise and guidance on hardware architecture from a programmer's perspective, ensuring seamless integration with the software stack

Who You Are

• Bachelor of Computer Science or equivalent degree

• Experience optimizing software for specialized hardware, employing techniques such as parallelism, SIMD programming, C, assembly-level optimization, or GPU/CUDA programming

• Language: at least one of assembly, C++, C, Zig, or Rust

• This is a hybrid role that will require you to work from our Mountain View, CA office 3 days a week on Tuesday through Thursday

Bonus Points If You Have

• Experience implementing kernels for ML models such as Transformers

• Experience using and implementing distributed parallelism techniques such as AllReduce, AllToAll, data parallelism, tensor parallelism.

• Familiarity with how compilers work

Compensation

The US base salary for this full-time position is determined based on a variety of factors including role, experience, location, job related skills, and relevant education and training. Career length is only a guideline for compensation.

• 0-5 years of experience - $120,000 - $200,000 + equity

• 5-10 years of experience - $120,000 -$300,000 + equity

• 10+ years experience - $120,000 - $400,000 + equity

What We Offer

• A Stake in our success A cash/equity mix that fits your needs and option to do early exercise

• Health & Wellness Company subsidized Health, Dental, Vision, and Life insurance; Pre-tax Health Savings Accounts with generous company contribution (even if you don’t)

• Time To Recharge 4 weeks paid time off (accrued), 12 company holidays, and 3 weeks remote/flexible work per year

• Support to Parents Up to 12 weeks of paid parental leave, regardless of your path to parenthood

• Learning & Development $1,500 yearly towards your professional development e.g. conferences, courses, and other learning opportunities

• Team Connection Team Lunches, quarterly off-sites, and regular town halls

• Financial Wellbeing 401K and/or Roth IRA, with 5% company contribution, even if you don’t!

• Flexible Spending Accounts Pre-tax spend accounts for medical, dental/vision, dependent care, parking, and transit expenses

• Commute On Us For those commuting up to 1 hour, put your rideshare cost on our company card and reclaim the drive-time to get work done!

• MatX E[x]tras $50 per month to use on the perks you care about most 

• Remote Perks We work remotely Monday & Friday, supported by home-tech setup, and remote wifi expense reimbursement

As part of our dedication to the diversity of our team and our focus on creating an inviting and inclusive work experience, MatX is committed to a policy of Equal Employment Opportunity and will not discriminate against an applicant or employee on the basis of race, color, religion, creed, national origin or ancestry, sex, gender, gender identity, gender expression, sexual orientation, age, physical or mental disability, medical condition, marital/domestic partner status, military and veteran status, genetic information or any other legally recognized protected basis under federal, state or local laws, regulations or ordinances.

All candidates must be authorized to work in the United States and work from our offices in Mountain View Tuesdays-Thursdays.

This position requires access to information that is subject to U.S. export controls. This offer of employment is contingent upon the applicants capacity to perform job functions in compliance with U.S. export control laws without obtaining a license from U.S. export control authorities.

MatX does not accept unsolicited resumes from individual recruiters or third-party recruiting agencies in response to job postings. No fee will be paid to third parties who submit unsolicited candidates directly to our hiring managers or People team and any resumes submitted are deemed to be the property of MatX.

About the Company

MatX is a computer hardware company based in Mountain View, California, specializing in designing high-throughput chips optimized for large language models (LLMs) and advanced AI workloads. Their hardware is purpose-built to maximize performance for the world’s largest AI models, delivering up to 10 times more computing power compared to conventional solutions. MatX’s chips are engineered for both training and inference, focusing on superior performance-per-dollar and scalability, supporting clusters with hundreds of thousands of chips. This enables AI labs and startups to train and deploy models at a scale and cost previously unattainable, making it possible for even small teams to work with models on the scale of GPT-4 and serve millions of users efficiently.

Working at MatX offers the opportunity to be at the forefront of AI hardware innovation, directly impacting the accessibility and advancement of artificial intelligence. Employees are part of a mission-driven team dedicated to accelerating the development of smarter, more useful AI models, with the vision of democratizing access to powerful AI tools for people of all backgrounds. The company’s culture values technical excellence, low-level hardware control for expert users, and the chance to solve some of the most challenging problems in AI infrastructure. With recent significant funding and a focus on rapid growth, MatX provides a dynamic environment for those passionate about pushing the boundaries of what AI hardware can achieve.
More roles from
MatX
Department
Location
MatX

Software Engineer - Kernels

Type
full-time
Department
Software
Location
Mountain View
Salary
Apply Now