Job Description

Together AI is seeking a Senior Software Engineer for a new small autonomous DX engineering team that will focus on shipping impactful APIs and services to improve the core developer experience of our platform – primarily for customers doing inference on our platform.

This role is for someone who thrives on shipping new features & APIs, and has expertise in building backend API services, integrating with complex backend systems, and has ideally worked with LLM APIs. You will work as a part of a small team to ship APIs and services that developers and enterprises are excited about.

Some of what you’ll work on:

• Design and build new APIs to improve the developer experience of our platform like web search, code interpreter, and MCP support


• Build an agent workflow API to enable our customers to stitch together our AI models and tools in an easy to use way with retries and fallbacks


• Prototype new APIs for common custom problems like solving OCR – including trying out different solutions, benchmarking them, and shipping the best one

Required Qualifications

• 3+ years experience writing high-performance, well-tested, & production quality code


• Bachelor’s degree in computer science or equivalent industry experience


• Experienced programmer in TypeScript, Python, or both


• Experience designing, shipping, scaling, and maintaining APIs


• Experience building with LLMs & using their capabilities like function calling a plus


• Experience with Kubernetes or containers a plus

Key Responsibilities

• Design, ship, scale, and maintain APIs and services from 0 -> 1


• Analyze and improve existing distributed systems and APIs


• Write clear, well-tested, and maintainable software for both new and existing systems

About Together AI

Together AI is a research-driven artificial intelligence company. We believe open and transparent AI systems will drive innovation and create the best outcomes for society, and together we are on a mission to significantly lower the cost of modern AI systems by co-designing software, hardware, algorithms, and models. We have contributed to leading open-source research, models, and datasets to advance the frontier of AI, and our team has been behind technological advancement such as FlashAttention, Hyena, FlexGen, and RedPajama. We invite you to join a passionate group of researchers and engineers in our journey in building the next generation AI infrastructure.

Compensation

We offer competitive compensation, startup equity, health insurance and other competitive benefits. The US base salary range for this full-time position is: $160,000 - $260,000 + equity + benefits. Our salary ranges are determined by location, level and role. Individual compensation will be determined by experience, skills, and job-related knowledge.

Equal Opportunity

Together AI is an Equal Opportunity Employer and is proud to offer equal employment opportunity to everyone regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity, veteran status, and more.

Please see our privacy policy at

Job Tags

Similar Jobs