> For the complete documentation index, see [llms.txt](https://osintelligence-llc.gitbook.io/osintelligence/llms.txt). Markdown versions of documentation pages are available by appending `.md` to page URLs; this page is available as [Markdown](https://osintelligence-llc.gitbook.io/osintelligence/part-ii-the-discipline/5-sixteen-practices/references-and-provenance.md).

# References & provenance

### References

Mei, L., et al. (2025). "A Survey of Context Engineering for Large Language Models." [arXiv:2507.13334](https://arxiv.org/abs/2507.13334) · Amershi, S., et al. (2019). "Guidelines for Human-AI Interaction." *CHI 2019* · a16z (2019). "The Empty Promise of Data Moats" · Bai, Y., et al. (2022). "Constitutional AI." [arXiv:2212.08073](https://arxiv.org/abs/2212.08073) · Baker, M. (2016). "1,500 scientists lift the lid on reproducibility." *Nature* 533 · Bengio, Y., et al. (2009). "Curriculum Learning." *ICML 2009* · Chambers, C. D. (2013). "Registered Reports." *Cortex* 49(3) · Clark, L., et al. (2019). "What Makes a Good Conversation?" *CHI 2019* · Deng, G., et al. (2024). "AI Runtime Infrastructure." [arXiv:2603.00495](https://arxiv.org/abs/2603.00495) · Dettmers, T., et al. (2023). "QLoRA." *NeurIPS 2023* · Dietterich, T. G. (2000). "Ensemble Methods in Machine Learning." *MCS 2000* · Du, Y., et al. (2023). "Improving Factuality and Reasoning through Multiagent Debate." [arXiv:2305.14325](https://arxiv.org/abs/2305.14325).

Giannou, A., et al. (2023). "Looped Transformers as Programmable Computers." *ICML 2023* · Guu, K., et al. (2020). "REALM." *ICML 2020* · Halevy, A., Norvig, P., & Pereira, F. (2009). "The Unreasonable Effectiveness of Data." *IEEE Intelligent Systems* 24(2) · Henderson, P., et al. (2018). "Deep Reinforcement Learning That Matters." *AAAI 2018* · Heuer, R. J. & Pherson, R. H. (2010). *Structured Analytic Techniques for Intelligence Analysis.* CQ Press · Alansari, A., & Luqman, H. (2025). "Large Language Models Hallucination: A Comprehensive Survey." [arXiv:2510.06265](https://arxiv.org/abs/2510.06265) · IEC 61511 (2016). *Functional Safety – Safety Instrumented Systems* · Inan, H., et al. (2023). "Llama Guard." [arXiv:2312.06674](https://arxiv.org/abs/2312.06674) · Ji, Z., et al. (2023). "Survey of Hallucination in NLG." *ACM Computing Surveys* 55(12) · Jiang, H., et al. (2023, 2024). "LLMLingua / LLMLingua-2." *EMNLP 2023 / ACL 2024* · Kaplan, J., et al. (2020). "Scaling Laws for Neural Language Models." [arXiv:2001.08361](https://arxiv.org/abs/2001.08361) · van der Graaf, J., et al. (2023). "How to Design and Evaluate Personalized Scaffolds for Self-Regulated Learning." *Metacognition and Learning* 18:783–810.

Shao, E., et al. (2025). "SciSciGPT: Advancing Human–AI Collaboration in the Science of Science." *Nature Computational Science* ([arXiv:2504.05559](https://arxiv.org/abs/2504.05559)) · Lewis, P., et al. (2020). "Retrieval-Augmented Generation." *NeurIPS 2020* · Liang, T., et al. (2024). "Encouraging Divergent Thinking through Multi-Agent Debate." *EMNLP 2024* · Takerngsaksiri, W., et al. (2024). "Human-In-the-Loop Software Development Agents (HULA)." [arXiv:2411.12924](https://arxiv.org/abs/2411.12924) · Luu, D. (2017). "Files Are Hard" · Ma, X., et al. (2023). "LLM-Pruner." *NeurIPS 2023* · Manakul, P., et al. (2023). "SelfCheckGPT." *EMNLP 2023* · Ilager, S., & Buyya, R. (2021). "Energy and Thermal-aware Resource Management of Cloud Data Centres: A Taxonomy and Future Directions." [arXiv:2107.02342](https://arxiv.org/abs/2107.02342) · Kholkar, G., & Ahuja, R. (2025). "Policy-as-Prompt: Turning AI Governance Rules into Guardrails for AI Agents." [arXiv:2509.23994](https://arxiv.org/abs/2509.23994) · Munafò, M. R., et al. (2017). "A Manifesto for Reproducible Science." [*Nature Human Behaviour* 1](https://doi.org/10.1038/s41562-016-0021) · Nosek, B. A., et al. (2018). "The Preregistration Revolution." *PNAS* 115(11) · NVIDIA (2025). "Data Flywheel" · Park, J. S., et al. (2023). "Generative Agents." *UIST 2023* · Patterson, D., et al. (2021). "Carbon Emissions and Large Neural Network Training." [arXiv:2104.10350](https://arxiv.org/abs/2104.10350) · Pillai, T. S., et al. (2014). "All File Systems Are Not Created Equal." *OSDI 2014* · Pineau, J., et al. (2021). "Improving Reproducibility in ML Research." *JMLR* 22.

Radford, A., et al. (2023). "Robust Speech Recognition via Large-Scale Weak Supervision." *ICML 2023* · Sahoo, P., et al. (2025). "A Systematic Survey of Prompt Engineering." [arXiv:2402.07927](https://arxiv.org/abs/2402.07927) · Schwartz, R., et al. (2020). "Green AI." *CACM* 63(12) · Shankar, S., et al. (2024). "Who Validates the Validators?" [arXiv:2404.12272](https://arxiv.org/abs/2404.12272) · Strubell, E., et al. (2019). "Energy and Policy Considerations for Deep Learning in NLP." *ACL 2019* · Summers, A. E. (2013). *Safety Controls, Alarms, and Interlocks as Independent Protection Layers.* SIS-Tech · Toyer, S., et al. (2024). "Tensor Trust." *ICLR 2024* · Yang, Y., et al. (2025). "Minimizing Hallucinations and Communication Costs: Adversarial Debate and Voting Mechanisms in LLM-Based Multi-Agents." *Applied Sciences* 15(7):3676 · Wang, X., et al. (2023). "Self-Consistency Improves Chain of Thought Reasoning." *ICLR 2023* · White, J., et al. (2023). "A Prompt Pattern Catalog." [arXiv:2302.11382](https://arxiv.org/abs/2302.11382) · Wu, T., Terry, M., & Cai, C. J. (2022). "AI Chains." *CHI 2022* · Zamfirescu-Pereira, J. D., et al. (2023). "Why Johnny Can't Prompt." *CHI 2023* · Zheng, L., et al. (2023). "Judging LLM-as-a-Judge." *NeurIPS 2023* · Borrill, P. (2026). "Unix Tools and the FITO Category Mistake: Crash Consistency and the Protocol Nature of Persistence." [arXiv:2603.01384](https://arxiv.org/abs/2603.01384) · Zhuge, M., et al. (2024). "Agent-as-a-Judge: Evaluate Agents with Agents." *ICML 2025*; [arXiv:2410.10934](https://arxiv.org/abs/2410.10934).

**Anchors of the accreted entries (§5.16–§5.37):** Anderson, J. R. (1983). *The Architecture of Cognition.* Harvard UP · Argyris, C., & Schön, D. A. (1978). *Organizational Learning.* Addison-Wesley · Basili, V. R., & Weiss, D. M. (1984). "A Methodology for Collecting Valid Software Engineering Data." *IEEE TSE* 10(6) · Beer, S. (1972). *Brain of the Firm.* Allen Lane · Boyd, J. R. (1987). *A Discourse on Winning and Losing*; Osinga, F. P. B. (2007). *Science, Strategy and War.* Routledge · Brooks, F. P. (1975). *The Mythical Man-Month.* Addison-Wesley · Chen, S., et al. (2023). "Extending Context Window of Large Language Models via Positional Interpolation." [arXiv:2306.15595](https://arxiv.org/abs/2306.15595) · Cockburn, A. (2006). *Agile Software Development: The Cooperative Game* (2nd ed.). Addison-Wesley · Csikszentmihalyi, M. (1990). *Flow.* Harper & Row · Deming, W. E. (1986). *Out of the Crisis.* MIT CAES (the Shewhart cycle) · Gawande, A. (2009). *The Checklist Manifesto.* Metropolitan Books · Gelernter, D. (1985). "Generative Communication in Linda." *ACM TOPLAS* 7(1) · Hadamard, J. (1945). *The Psychology of Invention in the Mathematical Field.* Princeton UP · Haynes, A. B., et al. (2009). "A Surgical Safety Checklist to Reduce Morbidity and Mortality in a Global Population." *NEJM* 360(5) · Kahneman, D. (2011). *Thinking, Fast and Slow.* FSG · Kelly, K. (1998). *Out of Control.* Basic Books · Khattab, O., et al. (2023). "DSPy." [arXiv:2310.03714](https://arxiv.org/abs/2310.03714) · Knuth, D. E. (1984). "Literate Programming." *The Computer Journal* 27(2) · Kolb, D. A. (1984). *Experiential Learning.* Prentice-Hall · Liu, N. F., et al. (2024). "Lost in the Middle: How Language Models Use Long Contexts." *TACL* 12 · Miller, G. A. (1956). "The Magical Number Seven, Plus or Minus Two." *Psychological Review* 63(2) · Nonaka, I., & Takeuchi, H. (1995). *The Knowledge-Creating Company.* Oxford UP · Packer, C., et al. (2023). "MemGPT: Towards LLMs as Operating Systems." [arXiv:2310.08560](https://arxiv.org/abs/2310.08560) · Parnas, D. L., & Clements, P. C. (1986). "A Rational Design Process: How and Why to Fake It." *IEEE TSE* 12(2) · Perrow, C. (1984). *Normal Accidents.* Princeton UP · Reynolds, L., & McDonell, K. (2021). "Prompt Programming for Large Language Models." *CHI EA 2021* · Schön, D. A. (1983). *The Reflective Practitioner.* Basic Books · Senge, P. M. (1990). *The Fifth Discipline.* Doubleday · Simonton, D. K. (1988). *Scientific Genius: A Psychology of Science.* Cambridge UP · Suchman, L. (1987). *Plans and Situated Actions.* Cambridge UP · Sumers, T., et al. (2024). "Cognitive Architectures for Language Agents." *TMLR* · Sweller, J. (1988). "Cognitive Load During Problem Solving." *Cognitive Science* 12(2) · Urbach, D. R., et al. (2014). "Introduction of Surgical Safety Checklists in Ontario, Canada." *NEJM* 370(11) · Weick, K. E. (1993). "The Collapse of Sensemaking in Organizations: The Mann Gulch Disaster." *ASQ* 38(4) · Yao, S., et al. (2023). "ReAct: Synergizing Reasoning and Acting in Language Models." *ICLR 2023*.

**In-series companions:** [*The Sovereign Triad*](/osintelligence/part-i-the-architecture/1-the-sovereign-triad.md) (Chapter 1; the promoted §1.5.1) · [*The Guard Changes at 23:26Z*](/osintelligence/part-iii-the-evidence-what-broke/10-the-guard-changes-at-23-26z.md) (Chapter 10; the cascade catalogue §5.10 summarizes) · [*Corpus-Sovereign Self-Distillation*](/osintelligence/part-iv-the-evidence-what-worked/18-corpus-sovereign-self-distillation.md) (Chapter 18; the H3 quantitative axis) · [*Sovereign Domain Pruning*](/osintelligence/part-iv-the-evidence-what-worked/16-sovereign-domain-pruning.md) (Chapter 16; source of the §5.25–5.31 protocols) · [*Stateless by Construction*](/osintelligence/part-i-the-architecture/4-stateless-by-construction.md) (Chapter 4; the §5.33 discipline in full) · [*Multi-Agent OODA Mesh*](/osintelligence/part-ii-the-discipline/6-multi-agent-ooda-mesh.md) (Chapter 6; §5.8's standalone treatment) · [*Sovereign Optimization Flywheel*](/osintelligence/part-ii-the-discipline/8-sovereign-optimization-flywheel.md) (Chapter 8; §5.34 in full) · [*Sovereign Safety Architecture*](/osintelligence/part-i-the-architecture/3-sovereign-safety-architecture.md) (Chapter 3; §5.35 in full) · [*Watcher KL-Drift Floor*](/osintelligence/part-iv-the-evidence-what-worked/19-watcher-kl-drift-floor.md) (Chapter 19; §5.37's daemon under training) · *Sharded-MCP Architecture* (the memory hierarchy §5.18 prototypes manually).

### AI-assistance disclosure

Large language models were used as research tools in the preparation of this chapter: Claude Opus 4.6 (Anthropic; first draft through 2026-04-16T23:26Z); Claude Opus 4.7 (Anthropic; post-transition revisions); Claude Sonnet, web (Anthropic; status tracking, literature pulls). The model versions and roles named above keep the provenance of this chapter auditable. No AI system is listed as an author or credited as a contributor, in line with COPE and ICMJE guidance: an AI system cannot take responsibility for the work, cannot assert competing interests, and cannot enter a licence agreement. The author verified every claim in this chapter against the sealed artifacts and is solely accountable for it.

**Citation (preferred):** Kistner, J. (2026). *Sixteen Practices for Sovereign Human–AI Collaboration: A Practitioner's Methodology Formalized.* version 1.0.0. OSINTelligence LLC research whitepaper. Cited in-series by title.

**License:** CC BY 4.0 (text). Code and data artifacts MIT per repository license.

**Corresponding author:** Jamey Kistner, <jamey.kistner@osintelligence.io>, OSINTelligence LLC (Columbus, OH).

***

*The Sovereign Stack · Sixteen Practices · Chapter 5 · Part II · v1.0.0 · License CC BY 4.0 · © Jamey Kistner, OSINTelligence LLC*
