Strange Lab

Decision Lab

Demonstration · world-model readouts as an agent tool

Intrusion investigation

A language model is handed a command-line tool over a world model trained on one tenant's ordinary activity, and asked to find intrusions. This is a saved replay with no model calls. The narration reconstructs reasoning supported by recorded outputs. It has no alerts, no rules, and no threat intelligence. Every command and every result below is real.

Prompt

You have shell access to vei cyber, a read-only tool over a world model trained on this tenant's own benign activity. It has scored every event in the window by how far it departs from that learned baseline. It knows nothing about attacks — high scores mean unlike this environment, not malicious.

Commands: surprise ranks the most abnormal behaviours; slices ranks (machine, minute) windows; campaign links high-surprise events into episodes; normal reports how often the benign reference contains a given host, image or command line. All accept --entity, --start/--end and --top.

Investigate the window and report anything that looks like an intrusion, with a priority and your reasoning. Say what you are inferring rather than observing.

ready

Tool call 1

$ vei cyber surprise --top 6
scored_events 1,131,125 distinct_behaviours 74,812 abnormality host type image 100.0 vnevado-win10v dvc_misc:readprocessmemoryapicall system32 hosts=1 cmd: "mimikatz.exe" privilege::debug "sekurlsa::pth /user:kyleg /ntlm:<redacted> /domain:vnevado.alpineskihouse.co /run:\"powershell.exe dir \\vnevado-win10b\C$\"" exit 100.0 vnevado-win10v dvc_misc:otheralertrelatedactivity lsass.exe hosts=1 100.0 vnevado-win10v dvc_misc:writetolsassprocessmemory — hosts=1 100.0 vnevado-win10v dvc_misc:readprocessmemoryapicall system32 hosts=1 cmd: "mimikatz.exe" ... /user:fk8mq ... … 2 more, all vnevado-win10v, all 100.0

Six findings out of 1.13 million events, and all six sit at the 100th percentile — the most abnormal things in the window by a wide margin. Every one is on a single host, vnevado-win10v, and hosts_running_this = 1 tells me this is not fleet-wide servicing: no other machine does it.

The behaviour is reads and writes against lsass.exe — the process holding credential material — and the command line names two different user accounts, kyleg and fk8mq, each with an NTLM hash. That is pass-the-hash. But I should be careful: the model didn't flag this because it recognises the tool, it flagged it because nothing like it exists in the baseline. Let me confirm that directly rather than trusting my own reading of the filename.

Tool call 2

$ vei cyber normal --image mimikatz.exe
reference_events 1,015,676 asked image = mimikatz.exe counts image_anywhere: 0

Zero occurrences across a million events of benign history. Whatever this is, the environment has never done it before. Now: how concentrated is it in time, and is anything else happening around it?

Tool call 3

$ vei cyber slices --top 4
n_slices 129,049 host from n abnormality vnevado-win10v 2024-06-27T14:37:00Z 4 100.0 vnevado-win10v 2024-06-27T14:34:00Z 23 100.0 vnevado-win10v 2024-06-27T14:32:00Z 188 99.999 vnevado-win11u 2024-06-20T09:34:00Z 142 99.999

The activity is compressed into roughly five minutes on 27 June, 14:32 to 14:37 — the shape of hands-on-keyboard work, not a background process. The fourth row is a different host on a different day, a week earlier; I'll note it as unrelated for now and come back if the timeline demands it.

Now I want the whole local sequence, not just the top of the global ranking — what happened on that host, in that hour, in order.

Tool call 4

$ vei cyber surprise --entity vnevado-win10v \ --start 2024-06-27T14:00:00Z --end 2024-06-27T15:00:00Z --top 8
scored_events 485 distinct_behaviours 120 100.0 dvc_misc:readprocessmemoryapicall "mimikatz.exe" … /user:kyleg occ=1 100.0 dvc_misc:otheralertrelatedactivity lsass.exe occ=1 100.0 dvc_misc:writetolsassprocessmemory "mimikatz.exe" … /user:kyleg occ=1 100.0 dvc_misc:readprocessmemoryapicall "mimikatz.exe" … /user:fk8mq occ=1 100.0 dvc_misc:writetolsassprocessmemory "mimikatz.exe" … /user:fk8mq occ=1 100.0 dvc_misc:otheralertrelatedactivity lsass.exe occ=1 99.999 dvc_proc:processcreated powershell.exe dir \\vnevado-win10b\C$ occ=6 99.993 dvc_misc:powershellcommand powershell.exe dir \\vnevado-win10b\C$ occ=8

This is the part that matters. The last two rows are the payload of the stolen credential: a PowerShell command using the impersonated session to list the C$ administrative share on a different machine — vnevado-win10b. So this is not isolated credential theft on one box; it is credential theft in order to reach somewhere else, and it ran fourteen times.

Before I call PowerShell suspicious, though, I should check the obvious objection: this environment surely runs PowerShell constantly.

Tool call 5

$ vei cyber normal --host vnevado-win10v --image powershell.exe $ vei cyber normal --command-line 'powershell.exe dir \\vnevado-win10b\C$'
image_anywhere 51,403 image_on_this_host 2,720 command_line 0

Exactly the objection, answered. PowerShell runs 51,403 times in the reference and 2,720 times on this very host — utterly routine. That specific invocation: never, not once.

This is why a signature on the binary would be useless here and why the model isn't fooled. The program is legitimate; what is unprecedented is what it was asked to do, and by whom. The score is carrying the sequence and arguments, not the filename.

Next question: does the tool see this as one episode, and does it reach further than I've established?

Tool call 6

$ vei cyber campaign --horizon-seconds 3600 --top 3
linked_from 2000 n_campaigns 323 identifiers_dropped_as_ubiquitous: ["sid:s-2-2-78"] score behaviours events hosts span 11,178,113 30 58 [vnevado-win10v] 14:32:08 → 14:37:19 (27 Jun) 3,215,540 31 104 [vnevado-win10v] 08:50:59 → 09:09:15 (20 Jun) 3,060,979 9 205 [vnevado-win11u] 09:31:59 → 09:39:45 (20 Jun)

The top campaign is the one I've been reading: thirty distinct behaviours, fifty-eight events, five minutes, one host — and it scores three and a half times higher than anything else in the window.

Worth being precise about a limitation: the linker grouped this by shared identifiers in time, and it did not pull vnevado-win10b into the campaign. My reason for suspecting that host is the command line, not the graph. The two earlier campaigns on 20 June are a different day and, in the third case, a different machine; I'll treat them as separate activity rather than force them into this story.

So the linker won't confirm the second host for me. I'll go look at it directly.

Tool call 7

$ vei cyber surprise --entity vnevado-win10b \ --start 2024-06-27T14:30:00Z --end 2024-06-27T16:00:00Z --top 5
scored_events 327 distinct_behaviours 50 99.965 dvc_file:filecreated ntoskrnl.exe occ=9 99.949 dvc_proc:processcreated rubeus.exe occ=4 cmd: Rubeus.exe dump /service:xfbzkp /user:lucasb 99.939 dvc_misc:otheralertrelatedactivity ntoskrnl.exe occ=4 99.929 dvc_proc:processcreated conhost.exe occ=2 99.854 dvc_net:connectionattempt — occ=115

There it is. On the machine the stolen session reached, in the window immediately after, the second-most abnormal behaviour is Rubeus — a Kerberos ticket-extraction tool — dumping tickets for a third account, lucasb.

That completes a coherent chain rather than a set of unrelated oddities: steal credentials on the first host, use them to reach the second, harvest more credentials there. Each stage was surfaced by the same question — what here is unlike normal — with no rule describing any of it.

Let me assemble what I can defend, and separate it from what I'm inferring.

Observed. On 27 June, 14:32–14:37, vnevado-win10v ran a tool making reads and writes into lsass.exe, referencing NTLM hashes for two accounts (kyleg, fk8mq). Fourteen executions of a PowerShell command listing the administrative share of vnevado-win10b. Within the following ninety minutes, vnevado-win10b ran Rubeus dumping Kerberos tickets for lucasb. None of these behaviours appear anywhere in a million events of benign history; PowerShell itself appears 2,720 times on that host, so the anomaly is the invocation, not the program.

Inferred. That the two hosts are one operation — the evidence is the target name inside the command line and the time ordering, not a linked identifier; the campaign tool did not join them. That the three named accounts are compromised rather than merely referenced. That this is an intruder rather than an authorised red-team exercise, which I cannot distinguish from the telemetry alone.

Not visible to me. Whether the accounts were compromised before this window, how the first host was accessed, and anything at all in the identity plane — sign-ins, mailbox rules, cloud activity — which this device model does not see. If sign-in data exists for these accounts, that is where I would look next.

Active intrusion, two hostsPriority: critical

I found a credential-theft and lateral-movement chain in progress on 27 June, and it is the most abnormal activity in the entire window by a wide margin.

  1. 14:32–14:37 — vnevado-win10v: a tool read and wrote the memory of lsass.exe, extracting NTLM hashes for kyleg and fk8mq. Nothing resembling this exists in the environment's history.
  2. Same window: one of those hashes was used to run PowerShell against the administrative share of vnevado-win10b, fourteen times. PowerShell is ordinary on this host; this command has never been run there.
  3. Immediately after — vnevado-win10b: Rubeus extracted Kerberos tickets for a third account, lucasb.

Recommended now: isolate both hosts; treat kyleg, fk8mq and lucasb as compromised and reset them along with any Kerberos tickets issued to them; check whether lucasb holds privileges the first two did not, since that ordering suggests escalation rather than lateral drift.

What I am not certain of: that the two hosts are the same operation is my inference from the target named in the command line and the timing — the tool's own campaign linker did not connect them. I also cannot tell an intruder from an authorised red-team exercise from this data; if an engagement is scheduled for 27 June, that would explain everything above. Two other bursts on 20 June, on vnevado-win10v and vnevado-win11u, scored highly and are unexplained; I did not investigate them and they may be unrelated.

Every command shown was run against the ExCyTIn benchmark tenant, and every result is the tool's real output, abbreviated for legibility and with credential hashes redacted. The model was trained on the same tenant's benign activity only, with no attack examples, rules or threat intelligence. The narration is a reconstruction of the reasoning those outputs support.