Senior Machine Learning Engineer, Quantized Training Job at Nvidia, Santa Clara, CA

TUQ5eTBOTjNQNWVHeGVuZFNRR0JzSDhPL2c9PQ==
  • Nvidia
  • Santa Clara, CA

Job Description

We are now looking for a Senior Machine Learning Engineer for Quantized Training.NVIDIA is seeking machine learning engineers to support next-generation recipes for mixed-precision training. In this role you will (1) distill LLM research literature into its core, (2) translate literature into experiments at scale, (3) create insights to support or refute the efficacy of a technique, and (4) generate reproducible training recipes.What you'll be doing:Review state-of-the-art literature in quantized trainingBuild robust, reproducible, and portable training recipesProvide engineering support to customers using HW and SW approachesCollaborate closely with hardware, software, and research teams to assess and adopt deep learning algorithmic advancements in quantizationWork with production SW teams to realize recipes in production workflowsWhat we need to see:Experience with PyTorch or similar frameworks such as jax/xla/etcProficient in the math of machine learningFamiliarity with FP8 for trainingPublished research or significant contributions to the field of AI, particularly in algorithm development for hardware-software co-designPhD, M.S. degree or equivalent experience in Computer Science or a related field5+ YoE working in ML / AIStrong written and oral communication skillsStrong programming skills and ability to debug ML systemsWays to stand out from the crowd:Experience in LLM training, fine-tuning and optimization (quantization, sparsity)Familiarity with MX formats for trainingExperience with Transformer Engine, Megatron-LM, or NeMoGPU computing is the most productive and pervasive platform for deep learning and AI. It begins with the most advanced GPUs and the systems and software we build on top of them. We integrate and optimize every deep learning framework. We work with the major systems companies and every major cloud service provider to make GPUs available in data centers and in the cloud. We craft computers and software to bring AI to edge devices, such as self-driving cars and autonomous robots. AI has the potential to spur a wave of social progress unmatched since the industrial revolution.NVIDIA is widely considered to be one of the technology world’s most desirable employers. This opportunity offers you the ability to collaborate with some of the most forward-thinking and hard-working people in the world, shaping the future of AI in a creative and autonomous work environment that encourages innovation. Do you love the challenge of influencing the long-term opportunities that expand NVIDIA’s impact on the datacenter and beyond? If so, we want to hear from you!The base salary range is 180,000 USD - 339,250 USD. Your base salary will be determined based on your location, experience, and the pay of employees in similar positions.You will also be eligible for equity and benefits. NVIDIA accepts applications on an ongoing basis. NVIDIA is committed to fostering a diverse work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.SummaryLocation: US, WA, Seattle; US, CA, Santa ClaraType: Full time Nvidia

Job Tags

Full time,

Similar Jobs

Research Psychiatric Center

Registered Nurse RN Psych Adult Job at Research Psychiatric Center

 ...and cannot be combined with other bonuses or HCA loan/scholarships. Do you have the career opportunities as a(an) Registered Nurse RN Psych Adult you want with your current employer? We have an exciting opportunity for you to join Research Psychiatric Center which is... 

Horizon Fence

Fence Installer Job at Horizon Fence

 ...Job Description Job Description **We offer Year round work for our Fence Installers! Join Horizon Fence as a Full Time Fence Installer in South Portland, ME, and take your career to new heights! We are seeking experienced fence installers who are passionate about... 

Idaho State Job Bank

Medical Assistant Training Program Job at Idaho State Job Bank

Medical Assistant Training Program at St. Luke's Health System in Twin Falls, Idaho, United States Job Description Overview At St. Luke's,...  ...supportive, and inclusive culture that delivers exceptional patient experiences. For your application to be considered you must upload an... 

Domino's Franchise

Delivery Driver(05106) - 630 3rd St. Job at Domino's Franchise

 ...Job Description Job Description Job Description Delivery Driver We recognize our delivery experts as the ambassadors of Domino's Pizza - from fresh out of the oven to the customer's door - our drivers make it happen. Money! Our delivery experts are paid cash... 

The UPS Store #0906

Full-Time Assistant Center Manager Job at The UPS Store #0906

The Assistant Center Manager helps the Center Manager run the day-to-day operations of this retail location. He or she may be required to open and close the center, help manage productivity and ensure the centers team delivers world-class customer service to all customers...