AI Product Analyst

Description:

Office based opportunity

I'm working with a business that's investing heavily in AI and building products used across multiple professional services sectors.

What will you actually be doing?

Getting under the skin of AI products, analysing user behaviour, output quality, performance trends and areas where things aren't working as expected.
Building dashboards, defining KPIs and using SQL and Python to turn complex datasets into meaningful insights.
Working closely with AI engineers and product teams to evaluate LLM outputs, identify regressions and understand whether new features are genuinely improving performance.
Developing evaluation datasets and scoring frameworks to measure AI accuracy, reliability and quality.
Looking beyond the obvious numbers, whether that's understanding why certain users abandon tasks, why answers are being regenerated or why performance varies between different types of queries.
Presenting your findings directly to senior stakeholders and helping influence product priorities and future investment.

What kind of background would work?

You could be a Product Analyst, Senior Data Analyst, AI Analyst, Data Science Consultant or someone working in AI evaluation.

Interested in people who bring a combination of:

Strong SQL and Python skills, with experience independently building analysis and dashboards.
Product analytics, including KPIs, experimentation, user behaviour, segmentation or A/B testing.
Exposure to AI, machine learning, generative AI or LLM-powered products.
An understanding of how AI systems are evaluated, ideally including model output quality, scoring frameworks or evaluation datasets.
Experience working with technical teams and translating complex findings into clear business recommendations.
The confidence to challenge decisions and back up your recommendations with evidence.

Why consider it?

You'll have the opportunity to establish how AI product performance is measured, help shape the evaluation approach and influence how these products develop.

You'll work closely with people building AI solutions, have direct exposure to senior decision-makers and see your analysis translate into real product changes.

If you're currently working in data, product analytics or AI evaluation and want a role where your work has a much bigger influence on the product itself, we'd love to have a conversation.

Get in touch to find out more.

52461MS

INDLON

The Portfolio Group are acting on behalf of our client in recruiting for this position