AI Engineer Multi-Modal Microscopy Representation Alignment & Post-Training

Current HHMI Employees click here to apply via your Workday account.

TLDR: Build the model backbone for the next era of AI-powered spatial biology.

Please include a cover letter with your application detailing your qualifications and experience for this position. Describe a deep learning project you have executed ideally a creative use of supervised fine tuning of a pre-trained vision transformer U-Net architecture or related topic. Projects in computer vision for microscopy image analysis are especially relevant. Include a link to a code repository if possible. If you contributed to a joint project please describe your specific contributions. Briefly discuss the projects results limitations and challenges you encountered. Finally include a link to your GitHub profile personal website or similar and/ or any relevant projects at the bottom of your cover letter.

About the role:

: HHMI is investing $500 million over the next 10 years to support AI-driven projects and to embed AI systems throughout every stage of the scientific process in labs across HHMI. The Foundational Microscopy Image Analysis (MIA) project sits at the heart of Our ambition is big: to create one of the worlds most comprehensive multimodal 3D/4D microscopy datasets and use it to power a vision foundation model capable of accelerating discovery across the life sciences.

We are seeking a highly skilled AI Research Engineer to join our team and advance our AI-driven scientific initiatives. You will build methods for supervised adaptation of pre-trained microscopy vision models and cross-modality representation learning/ alignment. You will build robust pipelines that adapt foundation models to specialized microscopy tasks and develop algorithms that align image level embeddings across modalities (e.g. fluorescence electron microscopy brightfield ).

In collaboration with other engineers and scientists you will use these models for scalable vision tasks instance segmentation tracking classification and more. You will utilize probabilistic models to produce uncertainty-aware predictions across scales. This role requires deep knowledge of the underlying models and practical implementation skills to maximize biological impact. You will lead rigorous model evaluations implement novel architectures and ensure all work meets the highest standards of reproducible open science. Success in this role requires close collaboration with our microscopy experts cellular biologists neuroscientists and computer scientists to ensure models can be deployed in large data real-world scenarios.

Strong programming skills in Python PyTorch and/ or JAX are required along with the ability to reason about neural network behavior from first principles. The role also requires knowledge of microscopy data formats and tools such as Zarr and Neuroglancer. We seek candidates who can think critically about model design understand how architectural choices and regularization affect model behavior and design rigorous experiments to evaluate models. Domain expertise in microscopy image analysis is not necessary but will be highly valued. Because this is a team project we value a clean shared code base and git-based collaborative workflows. Familiarity with state-of-the-art vision frameworks such as DinoV3 SAM CellPose or Vision Transformers is required. We are looking for candidates with experience in ML model deployment workflow orchestration and high-throughput data processing as well as experience working with large biological datasets in scalable GPU-based computing environments.

What we provide:

• A competitive compensation package with comprehensive health and welfare benefits.

• A supportive team environment that promotes collaboration and knowledge sharing.

• Access to a world-class computational infrastructure and large high-quality datasets.

• The opportunity to engage with world-class researchers software engineers and AI/ML experts contribute to impactful science and be part of a dynamic community committed to advancing humanitys understanding of fundamental scientific questions.

• Amenities that enhance work-life balance such as on-site childcare free gyms available on-campus housing social and dining spaces and convenient shuttle bus service to Janelia from the Washington D.C. metro area.

• Opportunity to partner with frontier AI labs on scientific applications of AI (see youll do:

  • Youll be responsible for the post-training process of our multi-modal microscopy vision foundation model which includes model fine tuning on annotated data and aligning learned representations across multiple microscopy modalities.

  • Design and execute rigorous experiments to evaluate model performance on a wide distribution of microscopy images and model architectures.

  • Collaborate with Scientists at Janelia and the broader academic community to integrate our model into their workflows across a wide variety of vision tasks.

  • Collaborate with interdisciplinary teams potentially mentor junior engineers and direct or assist in directing the work of others to meet project goals while advising stakeholders on data strategies and best practices.

  What you bring:

  • Masters or PhD degree in Computer Science Applied Mathematics Computational Neuroscience or a related fieldor an equivalent combination of education and relevant experience.

  • 3 years of experience fine-tuning spatial transformer networks contrastive learning model distillation RLHF and/or cross-modal alignment methods.

  • Familiarity with state of the art vision fine tuning methods such as low-rank adaptation (LoRA) linear probing etc.

  • Strong programming skills in Python PyTorch and JAX. Skills in Javascript are a plus.

  • Familiarity with computational tools in microscopy and connectomics data (Cellpose CAVE Flood Filling Networks Neuroglancer Zarr).

  • Experience with ML model deployment workflow orchestration and high-throughput data processing and model training.

  • Keen interest to work in a truly interdisciplinary environment and learn about cellular/molecular biology (e.g. transcriptomics) & neuroscience.

  Physical Requirements:

  Remaining in a normal seated or standing position for extended periods of time; reaching and grasping by extending hand(s) or arm(s); dexterity to manipulate objects with fingers for example using a keyboard; communication skills using the spoken word; ability to see and hear within normal parameters; ability to move about workspace. The position requires mobility including the ability to move materials weighing up to several pounds (such as a laptop computer or tablet).

  Persons with disabilities may be able to perform the essential duties of this position with reasonable accommodation. Requests for reasonable accommodation will be evaluated on an individual basis.

  Please Note:

  This job description sets forth the jobs principal duties responsibilities and requirements; it should not be construed as an exhaustive statement however. Unless they begin with the word may the Essential Duties and Responsibilities described above are essential functions of the job as defined by the Americans with Disabilities Act.

  Compensation Range

  AI Engineer I: $96325.60 (minimum) - $120407.00 (midpoint) - $156529.10 (maximum)

  AI Engineer II: $123125.60 (minimum) - $153907.00 (midpoint) - $200079.10 (maximum)

  AI Engineer III: $149515.20 (minimum) - $186894.00 (midpoint) - $242962.20 (maximum)

  AI Engineer IV: $184453.60 (minimum) - $230567.00 (midpoint) - $299737.10 (maximum)

  Pay Type: Salary

  HHMIs salary structure is developed based on relevant job market data. HHMI considers a candidates education previous experiences knowledge skills and abilities as well as internal consistency when making job offers. Typically a new hire for this position in this location is compensated between the minimum and the midpoint of the salary range.

  #LI-BG1

  Compensation and Benefits

  Our employees are compensated from a total rewards perspective in many ways for their contributions to our mission including competitive pay exceptional health benefits retirement plans time off and a range of recognition and wellness programs. Visit our Benefits at HHMI site to learn more.

  HHMI is an Equal Opportunity Employer

  We use E-Verify to confirm the identity and employment eligibility of all new hires.