Job Details

On-device ML Infrastructure Engineer (ML User Experience APIs & Integration)

Seattle, Washington, United States

Software and Services

Summary

Posted: May 22, 2025

Weekly Hours: 40

Role Number: 200605980

Apple is the best place to do on-device machine learning, and this team sits at the heart of that discipline, interfacing with research, SW engineering, HW engineering, and products. This amazing team is responsible for enabling the Research to Production lifecycle of cutting edge ML models that power magical user experiences on Apple’s hardware and software platforms. We build critical infrastructure that begins with onboarding the latest machine learning architectures to embedded devices, optimization toolkits to better suit target devices, machine learning compilers and runtimes that execute these models as efficiently. Our team also benchmark, analyze and debugging toolchains needed to improve on new model iterations. This infrastructure underpins most of Apple’s critical machine learning workflows across Camera, Siri, Health, Vision, etc. Our team plays an integral part of Apple Intelligence. Our group is looking for an ML Infrastructure Engineer, with a focus on ML user experience APIs and Integration. Our team is responsible for developing new ML model conversion & authoring APIs that will be a part of CoreML tools (CoreML’s authoring/conversion toolkit). This role takes ownership for integrating the APIs into internal and external systems (e.g., HuggingFace.)

Description

As an engineer in this role, you will focused on developing, using APIs in Core ML tools that enable ML engineers to efficiently author/convert ML models to CoreML. You will ideate, design, and stress test the gamut of optimizations required to ingest these models, ranging from source level optimizations (e.g., in the PyTorch program), to custom optimizations after converting to CoreML’s model representation. We are building the first end-to-end developer experience for ML development that, by taking advantage of Apple’s vertical integration, allows developers to iterate on model authoring, optimization, transformation, execution, debugging, profiling and analysis. The coremltools authoring and conversion APIs are the entrypoint to the rest of the infrastructure stack. We are looking for someone who is highly self motivated and passionate about ML modeling (architectures, training vs inference trade-offs, etc.), ML deployment optimizations (e.g., quantization). If you have a proven track record of developing and working with the internals of an ML python library, writing high quality code and shipping software, we strongly encourage you to apply.

Minimum Qualifications

• Bachelors in Computer Sciences, Engineering, or related discipline.

• Highly proficient in Python programming, familiarity with C++ is required.

• Proficiency in at least one ML authoring framework, such as PyTorch, TensorFlow, JAX, MLX.

• Strong understanding of ML fundamentals and modeling, including common architectures such as Transformers.

• Understanding of common ML inference optimizations, such as quantization, pruning, KV caching, etc.

Preferred Qualifications

• Experience with any on-device ML stack, such as TFLite, ONNX, etc.

• Experience with designing Python APIs and production deployment of python packages is a strong plus.

• Experience with HuggingFace or any other model repository

• Experience with MLIR/LLVM or any compiler toolchains

• Good communication skills, including ability to communicate with cross-functional audiences.

Pay & Benefits

At Apple, base pay is one part of our total compensation package and is determined within a range. This provides the opportunity to progress as you grow and develop within a role. The base pay range for this role is between $135,400 and $250,600, and your base pay will depend on your skills, qualifications, experience, and location.

Apple employees also have the opportunity to become an Apple shareholder through participation in Apple’s discretionary employee stock programs. Apple employees are eligible for discretionary restricted stock unit awards, and can purchase Apple stock at a discount if voluntarily participating in Apple’s Employee Stock Purchase Plan. You’ll also receive benefits including: Comprehensive medical and dental coverage, retirement benefits, a range of discounted products and free services, and for formal education related to advancing your career at Apple, reimbursement for certain educational expenses — including tuition. Additionally, this role might be eligible for discretionary bonuses or commission payments as well as relocation.Learn more about Apple Benefits. (https://www.apple.com/careers/us/benefits.html)

Note: Apple benefit, compensation and employee stock programs are subject to eligibility requirements and other terms of the applicable plan or program.

Apple is an equal opportunity employer that is committed to inclusion and diversity. We seek to promote equal opportunity for all applicants without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, Veteran status, or other legally protected characteristics.Learn more about your EEO rights as an applicant (https://www.eeoc.gov/sites/default/files/2023-06/22-088_EEOC_KnowYourRights6.12ScreenRdr.pdf) .

Apple is an equal opportunity employer that is committed to inclusion and diversity. We seek to promote equal opportunity for all applicants without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, Veteran status, or other legally protected characteristics.Learn more about your EEO rights as an applicant (https://www.eeoc.gov/sites/default/files/2023-06/22-088_EEOC_KnowYourRights6.12ScreenRdr.pdf) .

Apple will not discriminate or retaliate against applicants who inquire about, disclose, or discuss their compensation.

Apple participates in the E-Verify program in certain locations as required by law.Learn more about the E-Verify program (https://www.apple.com/jobs/pdf/EverifyPosterEnglish.pdf) .

Apple is committed to working with and providing reasonable accommodation to applicants with physical and mental disabilities. Reasonable Accommodation and Drug Free Workplace policy Learn more .

Apple is a drug-free workplace. Reasonable Accommodation and Drug Free Workplace policy Learn more .

Apple will consider for employment all qualified applicants with criminal histories in a manner consistent with applicable law. If you’re applying for a position in San Francisco, review the San Francisco Fair Chance Ordinance guidelines applicable in your area.

It is unlawful in Massachusetts to require or administer a lie detector test as a condition of employment or continued employment. An employer who violates this law shall be subject to criminal penalties and civil liability.