Job Details

Role Number: 200628070-3956

Summary

The Video Computer Vision and Video Engineering teams are centralized applied research and engineering organizations responsible for developing real-time on-device Computer Vision, Machine Perception and Image Quality, technologies across Apple products. We balance research and product to deliver Apple quality, groundbreaking experiences, innovating through the full stack, and partnering with HW and SW teams to influence SW architecture, sensors, silicon, PD/ID roadmaps that brings our vision to life.

Description

The Architecture team within our organization is responsible for bringing together computer vision algorithms, firmware, and low-level software teams to drive some of the most exciting programs across many Apple products! We do this by enabling the co-design of computer vision algorithms and systems through a deep understanding of the complexities and trade-offs between algorithm performance, imaging pipeline, system resources, and real-time constraints. To be successful in this role, you not only have to be an excellent engineer, but also a phenomenal collaborator—comfortable communicating with a wide range of experts and leaders across many different domains, from firmware and OS to feature and experience. Are you ready to be a part of the next big thing at Apple?

Minimum Qualifications

• BS in Computer Science, Electrical engineering, or other relevant fields with a minimum of 8 years relevant proven experience.

• Validated ability to work in a highly multi-functional environment at the intersection of Computer Vision, Embedded Systems, ISP, Mechanical and Electrical engineering, Optical Science, Human Factors or similar.

• Proven track record in developing and improving CV perception algorithms and ISP pipelines.

• Demonstrated experience in optimizing computer vision algorithms for performance, power, and memory on embedded platforms. Familiarity with firmware integration, operating system constraints, power and memory constraints, and low-level software development for image signal processing (ISP) in real-time applications.

• Strong understanding of perception sensing technologies including color and monochrome cameras, depth sensors, and IMUs. Ability to understand and articulate trade-offs between multiple sensing solutions and their impact on both high-level algorithms and low-level system performance.

Preferred Qualifications

• Breadth of knowledge in some areas of computer vision including either classical methods or ML. These areas may include Image Enhancement, SLAM, calibration, scene understanding, gaze tracking, human representation, and activity recognition.

• Experience in translating ambiguous, high-level product goals into detailed feature-level architectures and system requirements. Proven ability to derive defensible end-to-end requirements at the system level and decompose them into module/component specific requirements that include firmware, ISP, and OS constraints.

• Strong leadership skills to drive large multi-functional efforts, resolve conflicts, and present results to the highest levels of Apple leadership. Demonstrated ability to bridge the gap between high-level algorithm design and low-level system optimization—including the challenges of optimizing ISP performance under tight power and latency constraints.

• Experience in optimizing and fine-tuning ISP pipelines, including tasks like noise reduction, color correction, demosaicing, and dynamic range enhancement.

• Ideal candidates will also have exposure to modern innovative techniques including vision transformers, foundation models, and vision-language models, with a focus on integrating these methods into resource-constrained environments.

• Proficiency in debugging and optimizing performance at the firmware or OS level, with specific expertise in tuning ISP performance to ensure tight integration between hardware capabilities and algorithmic performance.

Pay & Benefits

At Apple, base pay is one part of our total compensation package and is determined within a range. This provides the opportunity to progress as you grow and develop within a role. The base pay range for this role is between $181,100 and $318,400, and your base pay will depend on your skills, qualifications, experience, and location.

Apple employees also have the opportunity to become an Apple shareholder through participation in Apple’s discretionary employee stock programs. Apple employees are eligible for discretionary restricted stock unit awards, and can purchase Apple stock at a discount if voluntarily participating in Apple’s Employee Stock Purchase Plan. You’ll also receive benefits including: Comprehensive medical and dental coverage, retirement benefits, a range of discounted products and free services, and for formal education related to advancing your career at Apple, reimbursement for certain educational expenses — including tuition. Additionally, this role might be eligible for discretionary bonuses or commission payments as well as relocation. Learn more about Apple Benefits. (https://www.apple.com/careers/us/benefits.html)

Note: Apple benefit, compensation and employee stock programs are subject to eligibility requirements and other terms of the applicable plan or program.

Apple is an equal opportunity employer that is committed to inclusion and diversity. We seek to promote equal opportunity for all applicants without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, Veteran status, or other legally protected characteristics. Learn more about your EEO rights as an applicant (https://www.eeoc.gov/sites/default/files/2023-06/22-088_EEOC_KnowYourRights6.12ScreenRdr.pdf) .