About the Role

We are hiring Software Engineers to build and scale our Mentiora AI inference quality platform. You will work on developing robust, high-performance systems that power our evaluation frameworks and provide seamless user experiences through modern web applications.

You'll work directly with the founding team. As an early hire, you'll have high autonomy and visibility, and play a central role in product, research, and engineering strategy.

What We Offer

• Competitive compensation

• Access to compute and tooling resources from top-tier partners

• Opportunity to shape core product strategy

• A collaborative, impact-driven team culture

Responsibilities

• Working directly with our clients to implement, tailor, and deploy complex software solutions for real-world problems.

• Design and build scalable infrastructure and deploy it within clients’ premises:

  • Scalable backend systems and data pipelines for evaluation and benchmarking of AI agents

  • Client-facing web applications and dashboards for quality metrics visualization

  • Implement APIs and integrations with multiple LLM providers and cloud services

  • Ensure system reliability, performance, and security across all platform components

• Collaborate with AI/ML teams to productionize research findings

• Example tasks

  • Implement “Experiment starter” dialog, allowing to start multiple jobs for a matrix of parameters.

  • Configure a job running service for Google Cloud and Databricks deployments.

  • Create a python backend, wire LLM judge generation there and deploy to all clients and to the demo.

  • Add authentication and user management to the frontend.

  • Talk to a client and get golden datasets from them for all evaluation metrics in a format we can import.

  • Migrate to OpenRouter for Gemini models, across deployments.

Minimum Qualifications

• Bachelor's or Master's degree in Computer Science, Software Engineering, or a related field

• 3+ years of professional software development experience

• Strong proficiency in Python for building APIs and working with SQL

• Strong proficiency in frontend development with TypeScript and React

• Experience building full-stack applications with modern frameworks like Next.js

• Solid knowledge of databases (Postgres), SQL, and data access toolkits like Prisma

• Knowledge of Infrastructure as Code (Terraform), containerization (Docker, Kubernetes), and CI/CD pipelines

Preferred Qualifications

• Experience working with AI/ML systems or developer tools

• Experience working with AI/ML libraries and frameworks in Python

• Background in building high-scale, low-latency systems

• Experience with observability and monitoring systems

• Previous experience at a fast-growing startup