Practiced one out loud? Paste your answer into the free self-check and get a score in 30 seconds
What the interviewer is testing
Whether you can choose the simplest architecture that solves the task, and explain the predictability, cost and testing differences.
Answer framework
- Workflow: code defines the steps (classify, retrieve, draft, check); the LLM fills specific steps.
- Agent: the model decides which steps to take and in what order, using tools in a loop.
- Choose a workflow when the path is known: it is cheaper, faster, easier to test and to audit.
- Choose an agent when the path depends on what is discovered, such as open-ended research or debugging.
- Hybrid: a workflow with one bounded agentic step is often the best fit.
Sample answer
The difference is who controls the path. In a workflow my code decides the sequence: for example, classify the ticket, retrieve the policy, draft a reply, check it against rules, send it for review. The model does specific jobs inside fixed steps. In an agent, the model decides what to do next, which tool to call and when it is finished.
I default to workflows when I can write the steps down, because they are predictable. Each step can be tested on its own, costs and latency are bounded, and it is easy to explain to compliance what happened. Agents make sense when the next step genuinely depends on what was found, such as investigating a production incident, where you cannot know in advance which logs or services matter.
Most real systems end up hybrid: a workflow that handles routing, permissions and final checks, with one bounded agentic step inside it, such as research with a step limit. I would start with the workflow version, measure where it fails, and add autonomy only where that failure is about needing flexible steps.
Likely follow-ups
Common mistakes
- Building an agent for a task with fixed steps.
- Assuming agents are always more capable.
- Forgetting testing and audit requirements.
- Not bounding the agentic part of a hybrid.
The 0 to 1 AI Engineer Interview Playbook covers the answer frameworks, system-design walkthroughs and an 8-week plan.
Get the playbook 40% off with code EARLYBF until Nov 3, 11:59 PM PTEARLYBF: 40% off until Nov 3Smaller start: Score your answers against 50 rubrics, $9. 50 AI engineer questions, one rubric each, PDF on Gumroad.
Interviewing for PM or TPM? See the full PM package, $59 on Gumroad: a resume system, a PM, TPM and PGM interview handbook, a 1:1 cheat sheet and a PM playbook. PM and TPM content, not AI engineer prep.
Related questions
Based on question #52 in the full question bank.