All articles

The Hidden Reason Your AI Hire Isn't Working

Nearly three in four candidates hired as "AI engineers" fail basic skills assessments. The problem is not the talent market. It is the job title.

Oraniq4 min read

Nearly three in four candidates hired as "AI engineers" fail basic skills assessments. Assessment firm Andela found this across companies that were convinced they had solved their AI talent problem. The companies blamed the market. The real cause was the job title.

"AI engineer" is not a role. It is three roles collapsed into one posting, assessed with a single interview process, and measured against expectations that no one person can meet.

Three archetypes, one job description

AI work in a real business breaks into three distinct patterns. Each requires different skills. Each fails in a different way when you get the wrong person.

The Prototyper validates concepts fast. They run experiments, build proofs of concept, and tell you whether an idea is worth pursuing before serious resource is committed. Their output is clarity, not production code. Speed is their value. A good prototyper will have an answer for you in days, not months.

The Builder takes a validated idea and makes it run in the real world. This means data pipelines, API integrations, and connecting the AI layer to the CRM, the ERP, the document store, whatever the business already runs on. The Builder's job is not to prove the concept works in isolation. It is to make it work in context, connected to real data, real users, and real constraints. This phase is where most AI projects stall, not because the model is wrong, but because integration is harder, slower, and less glamorous than the demo suggested.

The Scaler keeps a live system reliable. They think about uptime, governance, audit trails, cost per query, and what happens when an edge case the prototype never encountered hits production at volume. Their concerns, compliance, monitoring, fallback behaviour, are invisible when things work and catastrophic when they don't. Most companies do not think about the Scaler until something breaks.

What actually happens when you hire the wrong one

Prototyper hired to build. You get impressive demos and nothing deployable. The prototyper optimises for speed and proof of concept. They are not thinking about the integration work that turns an experiment into a system that handles real data, real exceptions, and real users. Six months later you have screenshots and a production environment that still does not connect to your data warehouse.

Builder hired to validate. You over-engineer the discovery phase. Before anyone has confirmed the approach is right, there are staging environments, architecture decisions, and data pipeline choices that lock you into assumptions you have not tested. Rebuilding costs more than starting clean would have. The Builder's instinct is to make things production-ready. That instinct is wrong when you do not yet know what you are building.

Scaler brought in too early. Everything slows down. Governance conversations happen before there is anything worth governing. The team spends two weeks on compliance frameworks for a system that may not survive the next sprint. The Scaler is not wrong to raise these concerns. The timing is wrong.

Scaler brought in too late. This is the most expensive failure. A live system, real users, no monitoring, no fallback behaviour, no audit trail. Discovered when something breaks in front of a client. In comparable projects, fixing a production system that was never built for reliability costs three to five times more than building it right the first time.

The question most organisations skip

Before any AI hire, the first question is not "do you know AI?" It is: which phase are we actually in?

Discovery needs a Prototyper. Integration needs a Builder. A live system with users and real data needs someone who thinks about reliability, not features.

Most organisations skip this question. They post an "AI engineer" role because that is what the market is posting. They assess for generic AI competence because that is what the assessments measure. They hire someone who can do one of the three jobs reasonably well and neither of the other two. Then they wonder why the project stalls at integration, or why the prototype never made it to production, or why the live system broke at the worst possible moment.

The 75% failure rate Andela found is not a talent shortage. It is a clarity problem. Companies do not know which phase they are in, so they cannot hire for what that phase actually requires.

There is a structured way out. Assess candidates across three dimensions: the technical discipline they come from, their seniority level, and which of the three archetypes fits their natural working pattern. A senior data engineer who thrives in ambiguous early-stage work is a Prototyper. The same person who prefers clear specs and stable requirements is a Builder. Both are strong. Neither is wrong. They are just not the same hire.

Get clear on the phase. Then find the archetype the phase requires.