{"@context":"https://schema.org","@type":"JobPosting","directApply":"https://schema.org/False","title":"Lead Machine Learning Engineer, Inference & Performance","description":"

About Egen:

Egen is a fast-growing and entrepreneurial company with a data-first mindset. We bring together the best engineering talent working with the most advanced technology platforms, including Google Cloud and Salesforce, to help clients drive action and impact through data and insights. We are committed to being a place where the best people choose to work so they can apply their engineering and technology expertise to envision what is next for how data and platforms can change the world for the better. We are dedicated to learning, thrive on solving tough problems, and continually innovate to achieve fast, effective results. If this describes you, we want you on our team.

About the opportunity:

As a Senior AI Engineer, you will be at the forefront of our Generative AI initiatives. We treat AI as a software engineering discipline. You will be responsible for the full lifecycle of our AI features—specifically document intelligence and RAG pipelines—taking them from initial prototype to robust, scalable production services. You will solve for real-world constraints like latency, error handling, and cost optimization.

You’ll collaborate with a diverse range of clients to translate business needs into high-performance AI architectures. This role requires a blend of deep technical expertise in LLMs and a disciplined Software Engineering approach to ensure our solutions are robust, ethical, and scalable.

What You Will Do:

Optimize Inference: Build and tune production LLM serving with vLLM and SGLang—maximizing throughput and minimizing latency through batching, paged attention, quantization, and KV-cache strategies
Profile & Accelerate Training: Instrument and profile training runs to find bottlenecks, then resolve them with the right attention implementations (e.g. FlashAttention) tuned to the underlying hardware (H200, GB200)
Engineer for the Hardware: Apply a working understanding of GPU architecture and attention internals to choose the right approach per accelerator, rather than relying on defaults
Serve at Scale: Deploy and operate multiple models within shared GPU clusters on GKE, with autoscaling, efficient bin-packing, and graceful handling of mixed workloads
Drive Efficiency: Own GPU utilization as a first-class metric—measure it, improve throughput-per-dollar, and continuously raise the ceiling on what our fleet can deliver
Collaborate & Consult: Work directly with clients to understand performance, latency, and cost requirements, and translate them into pragmatic serving and training architectures

Your Technical Toolkit:

Core Languages: Mastery of Python and shell scripting; comfort reading and reasoning about lower-level (CUDA-adjacent) performance code is a strong plus
Inference Frameworks: Hands-on experience with vLLM, SGLash, or comparable high-performance serving stacks
GPU & Model Internals: Solid grasp of GPU architecture, the fundamentals of LLM inference, and the attention mechanism—including where the bottlenecks live and how FlashAttention and similar techniques address them across hardware generations (H200, GB200)
Profiling: Fluency with profiling tools to diagnose training and inference bottlenecks (compute-bound vs. memory-bound, kernel-level analysis)
Infrastructure: Strong Kubernetes (GKE) experience—deploying and autoscaling multiple models on shared GPU clusters on Google Cloud
Mindset: A strong software engineering foundation—you write clean, maintainable code, measure before optimizing, and understand the full SDLC

Basic Qualifications:

Bachelor's or Master's degree in Computer Science, Engineering, or a related technical field
5+ years of experience in ML/AI engineering, with a meaningful portion focused on performance, infrastructure, or systems
Proven track record of deploying and optimizing models in a production environment
Demonstrated experience profiling and improving GPU utilization for training and/or inference
Experience with Classic Machine Learning (neural nets, training, tuning) is a strong plus
Knowledge of Data Engineering and SQL

Personal Attributes:

Ownership: You take pride in your work and see optimizations through from profile to production
Curiosity: Hardware and serving frameworks change fast; you are a lifelong learner who stays ahead of the curve
Rigor: You measure before you optimize and let data, not intuition, guide where you spend effort
Consultative Spirit: You enjoy interacting with clients and can translate technical complexity into business value
Ethics: You prioritize responsible AI development and data privacy

Compensation & Benefits:

This role is eligible for our competitive salary and comprehensive benefits package to support your well-being:

Comprehensive Health Insurance
Paid Leave (Vacation/PTO)
Paid Holidays
Sick Leave
Parental Leave
Bereavement Leave
401 (k) Employer Match
Employee Referral Bonuses

Check out our complete list of benefits here - https://egen.ai/people/#benefits

Important:

All roles are subject to standard hiring verification practices, which may include background checks, employment verification, and other relevant checks.

EEO and Accommodations:

Egen is an equal opportunity employer and is committed to inclusion, diversity, and equity in the workplace. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, disability status, protected veterans’ status, or any other characteristic protected by federal, state, or local laws. Egen will also consider qualified applications with criminal histories, consistent with legal requirements. Egen welcomes and encourages applications from individuals with disabilities. Reasonable accommodations are available for candidates during all aspects of the selection process. Please advise the talent acquisition team if you require accommodations during the interview process.

","identifier":"https://remote.com/jobs/egen-c16qg28l/lead-machine-learning-engineer-inference-performance-j1ppikb9","employmentType":"FULL_TIME","hiringOrganization":{"@type":"Organization","name":"Egen","sameAs":"https://egen.ai","logo":"https://cdn.talent-assets.remote.com/company_logos/18eca797-a55e-4086-a826-724cc1855cb7company_logo.png"},"datePosted":"2026-07-02T19:39:13Z","applicantLocationRequirements":[{"@type":"Country","name":"Albania"},{"@type":"Country","name":"Algeria"},{"@type":"Country","name":"American Samoa"},{"@type":"Country","name":"Andorra"},{"@type":"Country","name":"Angola"},{"@type":"Country","name":"Anguilla"},{"@type":"Country","name":"Antigua and Barbuda"},{"@type":"Country","name":"Argentina"},{"@type":"Country","name":"Armenia"},{"@type":"Country","name":"Aruba"},{"@type":"Country","name":"Australia"},{"@type":"Country","name":"Austria"},{"@type":"Country","name":"Azerbaijan"},{"@type":"Country","name":"Bahamas"},{"@type":"Country","name":"Bahrain"},{"@type":"Country","name":"Bangladesh"},{"@type":"Country","name":"Barbados"},{"@type":"Country","name":"Belgium"},{"@type":"Country","name":"Belize"},{"@type":"Country","name":"Benin"},{"@type":"Country","name":"Bermuda"},{"@type":"Country","name":"Bhutan"},{"@type":"Country","name":"Bolivia"},{"@type":"Country","name":"Bosnia and Herzegovina"},{"@type":"Country","name":"Botswana"},{"@type":"Country","name":"Brazil"},{"@type":"Country","name":"British Virgin Islands"},{"@type":"Country","name":"Brunei"},{"@type":"Country","name":"Bulgaria"},{"@type":"Country","name":"Burkina Faso"},{"@type":"Country","name":"Burundi"},{"@type":"Country","name":"Cabo Verde"},{"@type":"Country","name":"Cambodia"},{"@type":"Country","name":"Cameroon"},{"@type":"Country","name":"Canada"},{"@type":"Country","name":"Cayman Islands"},{"@type":"Country","name":"Central African Republic (CAR)"},{"@type":"Country","name":"Chad"},{"@type":"Country","name":"Chile"},{"@type":"Country","name":"China"},{"@type":"Country","name":"Christmas Island"},{"@type":"Country","name":"Cocos (Keeling) Islands"},{"@type":"Country","name":"Colombia"},{"@type":"Country","name":"Comoros"},{"@type":"Country","name":"Cook Islands"},{"@type":"Country","name":"Costa Rica"},{"@type":"Country","name":"Cote d'Ivoire"},{"@type":"Country","name":"Croatia"},{"@type":"Country","name":"Curacao"},{"@type":"Country","name":"Cyprus"},{"@type":"Country","name":"Czech Republic"},{"@type":"Country","name":"Democratic Republic of the Congo"},{"@type":"Country","name":"Denmark"},{"@type":"Country","name":"Djibouti"},{"@type":"Country","name":"Dominica"},{"@type":"Country","name":"Dominican Republic"},{"@type":"Country","name":"Ecuador"},{"@type":"Country","name":"Egypt"},{"@type":"Country","name":"El Salvador"},{"@type":"Country","name":"Equatorial Guinea"},{"@type":"Country","name":"Eritrea"},{"@type":"Country","name":"Estonia"},{"@type":"Country","name":"Ethiopia"},{"@type":"Country","name":"Falkland Islands (Malvinas)"},{"@type":"Country","name":"Faroe Islands"},{"@type":"Country","name":"Fiji"},{"@type":"Country","name":"Finland"},{"@type":"Country","name":"France"},{"@type":"Country","name":"French Guiana"},{"@type":"Country","name":"French Polynesia"},{"@type":"Country","name":"Gabon"},{"@type":"Country","name":"Gambia"},{"@type":"Country","name":"Georgia"},{"@type":"Country","name":"Germany"},{"@type":"Country","name":"Ghana"},{"@type":"Country","name":"Gibraltar"},{"@type":"Country","name":"Greece"},{"@type":"Country","name":"Greenland"},{"@type":"Country","name":"Grenada"},{"@type":"Country","name":"Guadeloupe"},{"@type":"Country","name":"Guam"},{"@type":"Country","name":"Guatemala"},{"@type":"Country","name":"Guernsey"},{"@type":"Country","name":"Guinea"},{"@type":"Country","name":"Guinea-Bissau"},{"@type":"Country","name":"Guyana"},{"@type":"Country","name":"Haiti"},{"@type":"Country","name":"Honduras"},{"@type":"Country","name":"Hong Kong"},{"@type":"Country","name":"Hungary"},{"@type":"Country","name":"Iceland"},{"@type":"Country","name":"India"},{"@type":"Country","name":"Indonesia"},{"@type":"Country","name":"Ireland"},{"@type":"Country","name":"Isle of Man"},{"@type":"Country","name":"Israel"},{"@type":"Country","name":"Italy"},{"@type":"Country","name":"Jamaica"},{"@type":"Country","name":"Japan"},{"@type":"Country","name":"Jersey"},{"@type":"Country","name":"Jordan"},{"@type":"Country","name":"Kazakhstan"},{"@type":"Country","name":"Kenya"},{"@type":"Country","name":"Kiribati"},{"@type":"Country","name":"Kosovo"},{"@type":"Country","name":"Kuwait"},{"@type":"Country","name":"Kyrgyzstan"},{"@type":"Country","name":"Laos"},{"@type":"Country","name":"Latvia"},{"@type":"Country","name":"Lebanon"},{"@type":"Country","name":"Lesotho"},{"@type":"Country","name":"Liberia"},{"@type":"Country","name":"Libya"},{"@type":"Country","name":"Liechtenstein"},{"@type":"Country","name":"Lithuania"},{"@type":"Country","name":"Luxembourg"},{"@type":"Country","name":"Macao"},{"@type":"Country","name":"Madagascar"},{"@type":"Country","name":"Malawi"},{"@type":"Country","name":"Malaysia"},{"@type":"Country","name":"Maldives"},{"@type":"Country","name":"Mali"},{"@type":"Country","name":"Malta"},{"@type":"Country","name":"Marshall Islands"},{"@type":"Country","name":"Martinique"},{"@type":"Country","name":"Mauritania"},{"@type":"Country","name":"Mauritius"},{"@type":"Country","name":"Mayotte"},{"@type":"Country","name":"Mexico"},{"@type":"Country","name":"Micronesia"},{"@type":"Country","name":"Moldova"},{"@type":"Country","name":"Monaco"},{"@type":"Country","name":"Mongolia"},{"@type":"Country","name":"Montenegro"},{"@type":"Country","name":"Montserrat"},{"@type":"Country","name":"Morocco"},{"@type":"Country","name":"Mozambique"},{"@type":"Country","name":"Namibia"},{"@type":"Country","name":"Nauru"},{"@type":"Country","name":"Nepal"},{"@type":"Country","name":"Netherlands"},{"@type":"Country","name":"New Caledonia"},{"@type":"Country","name":"New Zealand"},{"@type":"Country","name":"Nicaragua"},{"@type":"Country","name":"Niger"},{"@type":"Country","name":"Nigeria"},{"@type":"Country","name":"Niue"},{"@type":"Country","name":"Norfolk Island"},{"@type":"Country","name":"Northern Mariana Islands"},{"@type":"Country","name":"North Macedonia"},{"@type":"Country","name":"Norway"},{"@type":"Country","name":"Oman"},{"@type":"Country","name":"Pakistan"},{"@type":"Country","name":"Palau"},{"@type":"Country","name":"Palestine"},{"@type":"Country","name":"Panama"},{"@type":"Country","name":"Papua New Guinea"},{"@type":"Country","name":"Paraguay"},{"@type":"Country","name":"Peru"},{"@type":"Country","name":"Philippines"},{"@type":"Country","name":"Poland"},{"@type":"Country","name":"Portugal"},{"@type":"Country","name":"Puerto Rico"},{"@type":"Country","name":"Qatar"},{"@type":"Country","name":"Republic of the Congo"},{"@type":"Country","name":"Réunion"},{"@type":"Country","name":"Romania"},{"@type":"Country","name":"Rwanda"},{"@type":"Country","name":"Saint Helena"},{"@type":"Country","name":"Saint Kitts and Nevis"},{"@type":"Country","name":"Saint Lucia"},{"@type":"Country","name":"Saint Pierre and Miquelon"},{"@type":"Country","name":"Saint Vincent and the Grenadines"},{"@type":"Country","name":"Samoa"},{"@type":"Country","name":"San Marino"},{"@type":"Country","name":"Sao Tome and Principe"},{"@type":"Country","name":"Saudi Arabia"},{"@type":"Country","name":"Senegal"},{"@type":"Country","name":"Serbia"},{"@type":"Country","name":"Seychelles"},{"@type":"Country","name":"Sierra Leone"},{"@type":"Country","name":"Singapore"},{"@type":"Country","name":"Slovakia"},{"@type":"Country","name":"Slovenia"},{"@type":"Country","name":"Solomon Islands"},{"@type":"Country","name":"Somalia"},{"@type":"Country","name":"South Africa"},{"@type":"Country","name":"South Korea"},{"@type":"Country","name":"South Sudan"},{"@type":"Country","name":"Spain"},{"@type":"Country","name":"Sri Lanka"},{"@type":"Country","name":"Sudan"},{"@type":"Country","name":"Suriname"},{"@type":"Country","name":"Swaziland"},{"@type":"Country","name":"Sweden"},{"@type":"Country","name":"Switzerland"},{"@type":"Country","name":"Taiwan"},{"@type":"Country","name":"Tajikistan"},{"@type":"Country","name":"Tanzania"},{"@type":"Country","name":"Thailand"},{"@type":"Country","name":"Timor-Leste"},{"@type":"Country","name":"Togo"},{"@type":"Country","name":"Tonga"},{"@type":"Country","name":"Trinidad and Tobago"},{"@type":"Country","name":"Tunisia"},{"@type":"Country","name":"Turkey"},{"@type":"Country","name":"Turkmenistan"},{"@type":"Country","name":"Turks and Caicos Islands"},{"@type":"Country","name":"Tuvalu"},{"@type":"Country","name":"Uganda"},{"@type":"Country","name":"Ukraine"},{"@type":"Country","name":"United Arab Emirates (UAE)"},{"@type":"Country","name":"United Kingdom (UK)"},{"@type":"Country","name":"United States"},{"@type":"Country","name":"Uruguay"},{"@type":"Country","name":"U.S. Virgin Islands"},{"@type":"Country","name":"Uzbekistan"},{"@type":"Country","name":"Vanuatu"},{"@type":"Country","name":"Vatican City (Holy See)"},{"@type":"Country","name":"Vietnam"},{"@type":"Country","name":"Wallis and Futuna Islands"},{"@type":"Country","name":"Yemen"},{"@type":"Country","name":"Zambia"},{"@type":"Country","name":"Zimbabwe"}],"jobLocationType":"TELECOMMUTE","baseSalary":{"@type":"MonetaryAmount","currency":"USD","value":{"@type":"QuantitativeValue","minValue":159300,"maxValue":250100,"unitText":"YEAR"}}}