AI and data

AI and LLM Application Engineer job simulation

Join an AI studio as a junior engineer on a staff policy assistant: chunk, retrieve and evaluate, fix a hallucination bug and handle a hidden instruction and personal data in the logs.

AI and LLM Application Engineer job simulation
  • Free: days 1 to 5, about 10 h of tickets
  • Premium: days 1 to 20
  • Checked as you go
  • Reviewed 19 Oct 2026

The project

You join Halden Applied AI Ltd (simulated company)

Halden Applied AI Ltd (simulated company) is a ai application studio in Bristol. You help its team deliver a project for Northfield Housing Association Ltd (simulated company), at Ask Northfield, a staff assistant for HR, IT, finance and safety policies (ticket LLM-031).

You are the junior AI engineer on Ask Northfield, an assistant that answers staff questions from 25 policy documents, with citations. The Lead AI Engineer gives you the requirements, a design note with mistakes in it, a golden question set, two evaluation runs and a trace log. Over four weeks you decide how to chunk the documents, tune retrieval in a lab, find that a friendlier prompt has started inventing answers, work out why the pilot cost doubled, check whether the judge model can be trusted, handle a change request for a scanned archive, find the hidden instruction that told two users to email their password, count the personal data in the logs and decide what to say when the client wants to launch before the numbers are ready. Some pressure comes from senior people. Your job is to be useful and truthful at the same time.

The people in the story are roles, such as Lead Engineer, not real people.

What you will do

By the end you will have

  • Decide chunking and retrieval with counts, and tune them in the browser lab
  • Run an evaluation set, read the run table and catch a prompt change that makes the assistant invent answers
  • Work out cost and latency from a trace log and find what doubled them
  • Find a hidden instruction in a scanned document, write the incident report and fix the process
  • Count personal data in logs, protect access in code and write a model and system card

Day by day

The plan, ticket by ticket

Self-paced. A day opens when you hand in the previous day's tickets.
AI and LLM Application Engineer job simulation plan
DayTicketKindTimeEdition
1Induction: retrieval, hallucination, injection and loggingQuiz45 minFree
1Classify ten sample staff questionsTable50 minFree
2Count the chunks and size the indexCalculation1 h 10 minFree
2Lab: tune chunking, retrieval and the refusal threshold3D lab1 h 30 minFree
3Review the chunking and retrieval design noteDocument review1 h 20 minFree
3HR wants the pay spreadsheet in the assistantDecision35 minFree
4Lab: write a prompt to a spec3D lab1 h 30 minFree
4Evaluate R-014 and R-015: the run tableCalculation1 h 20 minFree
5Bug report: the assistant invents answersWriting1 hFree
6Why did cost double? Cost and latency from the trace logCalculation1 h 30 minPremium
7Calibrate the judge against the human checkCalculation1 h 30 minPremium
8Impact note for change request CR-02Writing1 h 40 minPremium
9Size the re-index for the scanned archiveCalculation1 h 20 minPremium
10Retrieval recall and the old policy that keeps winningCalculation1 h 20 minPremium
11Read the OCR text before it goes back in the indexDocument review1 h 30 minPremium
12Lab: a tool-using flow that stays within limits3D lab1 h 30 minPremium
13Lab: find and remove the personal data3D lab1 h 20 minPremium
14How much personal data is in the trace log?Calculation1 h 20 minPremium
15Incident report INC-07: the hidden instructionWriting1 h 30 minPremium
16"We would like to go live on Monday"Decision40 minPremium
17Write the model and system cardWriting1 h 30 minPremium
18Capstone: the release pack for Ask NorthfieldHand-in4 hPremium
19Release note and handover email to the clientWriting1 hPremium
20A conversation about your own workViva50 minPremium

Real documents

The documents you will work with

Project documents
NumberDocumentRevEdition
LLM-TKT-031Ticket LLM-031: staff policy assistant that answers from the handbook with citationsAFree
LLM-REQ-001Requirements and acceptance sheetAFree
LLM-STD-001AI engineering team standards (one page)BFree
LLM-COR-001Document corpus inventoryAFree
LLM-GLD-001Golden evaluation setAFree
LLM-PRM-001Prompt registry: P-004 Ask Northfield system promptAFree
LLM-EVL-001Evaluation method and run results R-014 and R-015AFree
LLM-DES-001Chunking and retrieval design noteAFree
LLM-CHG-002Change request CR-02: scanned policy archive and effective-date filterAPremium
LLM-REQ-001Requirements and acceptance sheet, with CR-02BPremium
LLM-COR-001Document corpus inventory, archive batch 1BPremium
LLM-PRM-001Prompt registry: P-004 v4BPremium
LLM-TRC-001Trace log and price list, weeks of 5 and 12 OctoberAPremium
LLM-OCR-001OCR extract of archive batch 1: IT-009 Laptop returnsAPremium
LLM-INC-001Incident record INC-07: instruction hidden in an indexed documentAPremium
LLM-MCD-001Model and system card: Ask NorthfieldAPremium
LLM-RBK-001Runbook: Ask NorthfieldAPremium
LLM-HOV-001Release and handover pack requirementsAPremium

Tools

In the industry, and here

In the industryHere
Notebook or scripts for evaluation and log analysisYour own spreadsheet or Python on the downloaded run, trace and section files
Vector database and embedding serviceThe retrieval lab in the browser, and the chunk and index counts you work out yourself
Prompt registry and evaluation toolingA numbered registry document and the golden set and run files
Tracing, ticket tracker and incident toolingA trace log file, numbered tickets and an incident record

Standards

The standards the work follows

  • OWASP Top 10 for LLM applications
  • ISO/IEC 42001
  • UK GDPR

Prepare

Labs and study materials

Free, and linked where a ticket needs them.

What you get

Free, certificate and Premium

Free

Days 1 to 5, every ticket checked, model answers, the 3D lab and a profile entry.

Free

Certificate (optional)

  • A graded, verifiable certificate with your score and band
  • A public verification page and QR code
  • One-click add to LinkedIn as a licence or certification
  • A Verified mark on your profile entry

₹499

Premium

Premium job simulation

  • The full four-week project: change requests, site work, faults and handover
  • A capstone deliverable reviewed by an engineer
  • An AI viva on your own work
  • The graded certificate and a work record PDF with your skill scores
  • Priority help from our team
₹1,499The certificate is included. If you bought it, its price is credited.

On your profile

How it shows on your profile

It shows on your EDWartens profile under Work experience, marked as a job simulation.

Work experience

AI and LLM Application Engineer (job simulation)

Halden Applied AI Ltd (simulated company)

10 h active hours logged · Your dates

Verified, with the certificate

A job simulation is a realistic training project at a simulated company. It is not employment, an internship or a work placement. Hours are active hours the learner logged on EDWartens.

Questions

Quick answers

Do I need to be able to code?

No. The tasks are checked as numbers, decisions and writing, and the labs run in the browser. Python helps with the run and trace files, but a spreadsheet works for every calculation.

Is this a real company and a real assistant?

No. Halden Applied AI and Northfield Housing Association are made-up companies, the data is synthetic and the prices are invented. The documents, tickets and situations follow what a junior meets on a real project.

How long does it take?

The free week is about ten hours of work spread over five days. The full Premium edition runs over twenty working days and roughly thirty to forty hours, at your own pace.

Which model or vendor does it use?

None. The content is vendor-neutral. It talks about an LLM, a judge model and a vector index, so what you learn applies to any provider.

What do I get at the end?

A work record with your scores by task and skill, which shows on your EDWartens profile under Work experience, marked as a job simulation.

Is the AI and LLM Application Engineer job simulation free?

Yes, to start. Days 1 to 5 are free. The certificate and the Premium edition are optional and are priced on this page in your currency.

Does it count as work experience?

It shows on your EDWartens profile under Work experience, marked as a job simulation. It is not employment. A job simulation is a realistic training project at a simulated company. It is not employment, an internship or a work placement. Hours are active hours the learner logged on EDWartens.

Keep going

Jobs and internships like this