You will report directly to one of the co-founder, work hand-in-hand with engineers & ML
engineers, and take an active role in the building of our Product:
Data Science:
● You will use LLMs & other data science models to understand AI agents & how to
improve them.
● In particular, you need a solid understanding of ML models in order to suggest areas
of improvement to the ML team.
Metrics & KPIs:
● Develop & refine performance metrics (or DS models) in the context of Customer
Support (How to measure “accuracy”? etc.). You will be at the forefront of LLMs
development & need to build innovative approaches to measure their quality.
● Design “AB tests” experiments in the context of LLMs to help continuously
measure & improve the performance of the AI agents.
Audits & Reporting:
● Conduct deep-dives & audits on large (>1million) textual data (Customer Support
discussions). Your goal will be to audit i) the quality of the Customer Service (human
or AI) ii) how to improve it.
● Summarize findings & recommendations during internal and client meetings
● Build reports & dashboards.