AIOBES logo header

AIOBES Methodologies

AIOBES uses two operational methodologies to evaluate how AI systems behave under real conditions. These methodologies provide the structured mechanisms required to expose behavioural failure modes and assess their impact on workflows, operational stability and organisational risk.

Both methodologies operate exclusively on real tasks, real workflows and real interactions. They form the behavioural evidence‑generation layer of AIOBES.

LLM Inquisitor

LLM Inquisitor evaluates operational behaviour during long‑form work using real tasks, real documents and real organisational content. It identifies long‑form collapse, where the AI exhibits structural degradation, drifts from requirements, substitutes rewriting for editing, contaminates the work or causes task‑level breakdown over time.

LLM Inquisitor provides the behavioural evidence required to assess long‑form stability, workflow contamination risk and operational reliability.

Full methodology:
Evaluating and Testing AI Using Real World Work: The LLM INQUISITOR Methodology Field Manual
https://leanpub.com/llm-inquisitor

Vectored Conversational AI Testing

Vectored Conversational AI Testing evaluates AI behaviour across real conversational interactions - textual, verbal and multimodal. It identifies conversational instability, where the AI becomes inconsistent, incoherent or misaligned under natural user communication patterns.

This methodology exposes guardrail inconsistency, interaction‑driven drift, unstable conversational trajectories and behavioural misalignment that emerges only during real user communication.

Full methodology:
Vectored Conversational AI Testing (Field Manual)
https://leanpub.com/conversational-ai-testing

Methodology Scope and Interaction

LLM Inquisitor and Vectored Conversational AI Testing together cover the full behavioural surface of operational AI systems:

LLM Inquisitor - long‑form operational stability
Vectored Conversational - interactive behavioural stability

Both methodologies are required for complete behavioural evaluation under AIOBES. They are not interchangeable and not optional. Each exposes distinct behavioural failure modes that cannot be detected through the other.

Behavioural Evidence Requirements

All findings produced through these methodologies must be supported by clear, reproducible behavioural evidence. Evidence must show the behaviour observed, the conditions under which it occurred, the workflow impact and the associated operational or regulatory risk.

Evidence must be documented using AIOBES terminology and must be suitable for auditability, cross‑organisational communication and regulatory alignment.

Methodology Role Within AIOBES

These methodologies form the operational foundation of AIOBES. They define how behavioural failures are exposed, evidenced and evaluated across real workflows and real interactions. They provide the behavioural evidence required to identify operational limits, risk boundaries and workflow contamination risks.