Topic Guide · Planning & Analysis
Assessing whether information activities contributed to observed outcomes: baselines, evaluation design, attribution, measures, alternative explanations, and feedback.
Curated listening notes and source-linked material from the existing analysis. These guides are starting points, not rankings.
Listen & learn
5 complementary conversations. The order is a suggested route in, not a score or a claim of agreement.
Suggested first listen
Kara Masick
Listening notes: reviewed episode summary.
Complementary perspective
DeRosa and Castillo
Listening notes: reviewed episode summary.
Complementary perspective
Cassandra Brooker
Listening notes: reviewed episode summary.
Complementary perspective
Ben Kessler
Listening notes: reviewed episode summary.
Complementary perspective
Russ Burgos
Listening notes: reviewed episode summary.
Selected existing syntheses, not new findings or a claim that guests agree.
Topic synthesis · recurring pattern
A dominant theme is the difficulty of linking observed outcomes back to a specific action, actor, or variable when multiple influences, adversary adaptation, deniable activity, cross-platform narrative flow, or exogenous shocks are present. The core issue is credible causal linkage, not merely source identification.
Topic synthesis · recurring pattern
Many items describe assessment systems that count outputs, exposure, or engagement rather than actual effects, and that lack robust MOE/MOP frameworks tied to behavioral, cognitive, or mission-relevant outcomes. This produces misleading conclusions and false confidence.
Topic synthesis · recurring pattern
A recurring concern is that influence and cognitive effects may emerge slowly, persist unevenly, or decay over time, making one-off or short-window evaluations inadequate without pre-operation baselines, repeated measurement, and durability assessment.
Conceptual starting points in the existing topic registry.
Existing topic
Concepts focused on experimentation, evaluation, measurement, rapid feedback, lessons learned, and iterative adaptation in operational and strategic contexts.
Source: KCFT-08 · Operational Learning, Assessment & Adaptation
Existing topic
Frameworks emphasizing feedback loops, adaptation, emergence, cybernetics, systems thinking, complexity, and nonlinear interactions in strategic competition.
Why it is here: The relevant connection is feedback and interacting causes in evaluation, not every application of cybernetics.
Source: KCFT-05 · Complex Adaptive Systems & Cybernetic Competition
Constraints and recurring problems described in the corpus.
Topic synthesis · recurring pattern
Some items focus on how pressure to demonstrate success, compare information effects to kinetic effects, or use legacy doctrinal expectations can distort program design and undermine trust in assessment results. Credibility is treated as an institutional as well as analytic problem.
Topic synthesis · recurring pattern
Some effects are difficult to measure because the relevant phenomena are private, silent, suppressed, or only indirectly observable, such as inner speech, self-censorship, social ties, or other non-kinetic outcomes.
Practitioner proposals, not independently validated recommendations.
Topic synthesis · recurring pattern
Items repeatedly call for pre-campaign baselines, defined indicators, and standardized assessment frameworks so change can be tracked consistently over time and across efforts.
Topic synthesis · recurring pattern
The cluster strongly favors quasi-experiments, experiments, A/B testing, Bayesian updating, Most Likely Cause reasoning, and other methods that improve causal claims and reduce bias in contested environments.
Topic synthesis · recurring pattern
Items recommend combining qualitative and quantitative evidence, source verification, OSINT-first workflows, and disciplined questioning to improve confidence where direct measurement is difficult.
Methods and capabilities discussed in the corpus; effectiveness is not implied by inclusion.
Topic synthesis · recurring pattern
Many items focus on measuring persuasion, narrative shifts, propaganda patterns, audience receptivity, and behavioral or cognitive state so campaigns can be planned and evaluated more rigorously.
Source: TTP-02 · Assessment, Modeling, & Decision-Support Systems
Topic synthesis · recurring pattern
Bayesian methods, RCTs, triangulation, scoring rubrics, play taxonomies, ontologies, and other formal frameworks are used to standardize assessment and make judgments more defensible and comparable.
Source: TTP-02 · Assessment, Modeling, & Decision-Support Systems
Both sides are retained. A tension is not an endorsement of either pole.
Canonical tension
How should a professionalizing field build evidence and capability without overfitting to what can be measured, standardized, or optimized in advance?
Repeatable processes, tests, standards, and optimization make performance governable and improvable.
Adaptive systems make fixed metrics suppress novelty, miss emergence, and create fragility.
Exploration can generate candidates for proving, while tests can reserve space for novelty and challenge.
Source: CT-015 · Standardized Proving and Optimization vs Complexity-Aware Exploration
Canonical tension
To what extent can language, attitudes, and behavior be standardized across populations when identity, inner speech, culture, and social context reshape meaning?
Communication attributes can be operationalized sufficiently to aggregate, compare, and link them to outcomes.
Identity, culture, structure, memory, and inner speech alter meaning, so observable language is only partial.
Mixed methods can locate patterns and then interpret, revise, or reject constructs in context.
Source: CT-016 · Codified Behavioral Measurement vs Contextual Meaning-Making
Canonical tension
How confidently can organizations anticipate narratives, effects, and technological change in complex information environments without overcommitting to brittle models?
Recurring patterns, quality data, validated models, and explicit uncertainty can improve anticipation.
Adaptive actors, nonlinear feedback, regime change, sparse data, and model effects make precision fragile.
Models can support ranges, indicators, and updating without making deterministic claims.
Source: CT-009 · Predictive Sensemaking Confidence vs Complex-System Uncertainty
Explicitly selected themes and narratives, with the reason each is relevant here.
Cross-cutting theme
Actors need durable capabilities to observe contested environments, verify sources and media, attribute activity, assess effects, and anticipate change while representing uncertainty honestly.
Why it is here: Assessment depends on an evidence infrastructure that can observe, verify, attribute, and represent uncertainty.
Source: TH-02 · Epistemic Infrastructure for Contested Reality
Cross-cutting theme
The field advances when research, doctrine, education, communities of practice, experimentation, career paths, acquisition, and operational feedback translate knowledge into repeatable practitioner capability.
Why it is here: Evaluation methods become useful when research, training, and operational feedback connect.
Source: TH-09 · Knowledge-to-Practice Pipelines for a Professionalizing Field