Topic Guide · Threats & Resilience

AI & Synthetic Media

AI-mediated influence, synthetic content, adversarial model vulnerabilities, human oversight, and delegated agents in the information environment.

Curated listening notes and source-linked material from the existing analysis. These guides are starting points, not rankings.

Start listening
On this page

Listen & learn

Start Here

4 complementary conversations. The order is a suggested route in, not a score or a claim of agreement.

Suggested first listen

#12 Tammekänd on Deepfakes

Tammekänd

  • Provides a foundational discussion of synthetic audio, imagery, and video, alongside the contest between generation and detection.
  • Frames deepfakes as a problem of authenticity and trust, not merely a collection of impressive technical demonstrations.

Listening notes: reviewed episode summary.

Complementary perspective

#86 Nick Starck and David Bierbrauer on Vulnerabilities in the Military Use of AI

Nick Starck and David Bierbrauer

  • Examines how adversarial manipulation can turn an apparently useful AI capability into a source of operational risk.
  • Encourages listeners to consider threat models and human verification alongside performance claims—a counterweight to capability-first enthusiasm.

Listening notes: reviewed episode summary.

Complementary perspective

#227 Matthew Canham on Agentic AI and the Cognitive Security Institute

Matthew Canham

  • Explores the shift from AI that generates content to AI assistants that perform tasks and act on a user’s behalf.
  • Raises the possibility that trusted assistants themselves become targets for manipulation, making delegation and oversight central security questions.

Listening notes: reviewed episode summary.

Complementary perspective

#238 Bill Wall on AI in Information Operations

Bill Wall

  • Discusses practical applications of AI to information operations and analysis, including making complex commercial relationships easier to investigate.
  • Offers an operator-oriented perspective on analyst capacity, narrative monitoring, and the emerging competition between automated information systems.

Listening notes: reviewed episode summary.

What the Corpus Says

Selected existing syntheses, not new findings or a claim that guests agree.

Key Concepts & Frameworks

Conceptual starting points in the existing topic registry.

Challenges Practitioners Identify

Constraints and recurring problems described in the corpus.

Approaches Practitioners Recommend

Practitioner proposals, not independently validated recommendations.

Tools, Methods & Techniques

Methods and capabilities discussed in the corpus; effectiveness is not implied by inclusion.

Tensions & Open Questions

Both sides are retained. A tension is not an endorsement of either pole.

Canonical tension

AI-Enabled Operational Tempo and Scale vs Reliable Human Control

How far should organizations automate analysis, content, targeting, and decisions when increased tempo may also introduce brittleness, opacity, cascading error, and loss of contextual control?

Automate to increase tempo, scale, and responsiveness

Volume and latency exceed unaided capacity, and bounded automation can be monitored, reversed, and contained.

Retain validation, explainability, and human control

Ambiguous social meaning, opaque models, contaminated data, or consequential decisions require accountable validation.

Automation can be tiered by task and consequence, with human-on-loop or human-in-loop controls.

Source: CT-001 · AI-Enabled Operational Tempo and Scale vs Reliable Human Control

Canonical tension

AI as Analytic Capability vs Epistemic Degradation

The same technology can improve sensing and analysis while lowering the cost of synthetic content, identity spoofing, manipulation, and ambient uncertainty.

Use AI to detect, filter, verify, and understand

Machine processing can detect artifacts, correlate sources, filter noise, and expose coordination at scale.

Manage AI-driven deception, noise, and uncertainty

Cheap generation, spoofed identity, automated persuasion, and poisoned environments can outpace verification.

Both poles can intensify together; analytic gains do not cancel epistemic degradation.

Source: CT-003 · AI as Analytic Capability vs Epistemic Degradation

Canonical tension

Personalized and Immersive Influence vs Privacy, Authenticity, and Consent Safeguards

How far should actors use AI, identity data, biometrics, XR, and microtargeting when those same capabilities increase surveillance, covert manipulation, identity exposure, and trust risks?

Exploit personalization, biometrics, and immersive systems for tailored effects

Fine-grained data can improve relevance or protection when their use is authorized, bounded, and testable.

Protect privacy, consent, authenticity, and autonomy

Intimate data, covert adaptation, and synthetic identity create autonomy and trust harms that ordinary notice cannot control.

Data minimization, disclosure, consent, audit, and explicit red lines can bound some forms of personalization.

Source: CT-004 · Personalized and Immersive Influence vs Privacy, Authenticity, and Consent Safeguards

Connections Across the Corpus

Explicitly selected themes and narratives, with the reason each is relevant here.