Don’t Let AI Go Rogue: Human Governance for Agentic Systems
As AI systems become more capable of reasoning, using tools, accessing data, and taking action on their own, a new question is becoming impossible to ignore: how much autonomy should we actually give them?In this episode of Ship Happens, host Per Krogslund sits down with Justin Kuiper, Lead Architect at Future Tech, to explore the security and governance challenges of agentic AI—and what engineers can do to keep increasingly autonomous systems within safe and understandable boundaries.
With a background in Air Force space operations and cybersecurity, Justin brings lessons from mission-critical systems to the rapidly evolving world of AI. He explains how different environments prioritize availability, confidentiality, and mission assurance, and why those tradeoffs become even more important when software can make decisions and take actions with real-world consequences.
Per and Justin dig into the importance of human governance, least privilege, agent identity, observability, break-glass controls, and specification engineering. They explore the risk of “confident misalignment”—when an AI system confidently pursues an outcome that isn't actually what its human operators intended—and why giving agents more capability doesn't mean giving them unlimited authority.
The conversation also looks at AI in space, data sovereignty, model selection, token economics, and the emerging challenge of securing entire agent ecosystems rather than individual applications.
The practical message for builders is clear: define what your agents are allowed to do, know who is responsible for their actions, constrain their access, observe what they're doing, document the system, and keep humans in control when the stakes are high.
Because autonomous software can move fast. Your governance needs to move with it.
What You’ll Learn:
• Why agentic AI introduces a different class of security and governance challenges
• What space systems can teach us about designing software for high-consequence environments
• Why human governance becomes more important as AI systems become more autonomous
• What “confident misalignment” means and why it can be dangerous
• How least privilege can be applied to AI agents and the tools they use
• Why every agent needs a clear identity and an accountable owner
• How observability and break-glass controls can help keep autonomous workflows under control
• Why the workflow—not just the individual application—can become the security problem
• How specification engineering can create stronger guardrails around AI behavior
• What data sovereignty means in an increasingly agent-driven ecosystem
• How model selection and token economics factor into AI architecture
• Why organizations need to decide on an agentic operating model before deploying autonomous systems
• Why “fail closed” can be an important principle for high-consequence AI systems
About Justin Kuiper:
Justin Kuiper is a Lead Architect at Future Tech with a background in Air Force space operations and cybersecurity. His experience working with complex, mission-critical systems gives him a unique perspective on the challenges of securing increasingly autonomous technology.
In this episode, Justin connects lessons from space systems and cybersecurity with the emerging world of agentic AI, exploring how engineers can build systems that are not only capable, but also constrained, observable, and accountable.
Chapters:
00:00 Satan in the Workflow
01:25 Meet Justin Kuiper
03:22 Securing Software in Space
06:06 AI Security and Black Boxes
11:33 Human Governance for Agents
13:51 Least Privilege for Tools
16:03 Agent Identity and Accountability
17:27 Agents in Production Workflows
19:55 Confident Misalignment Risks
20:52 Accountability for AI Weapons
22:12 Technology That Explores
22:38 Balancing Human Control
24:05 Losing Institutional Know-How
26:19 Specification Engineering Guardrails
26:52 AI in Space: The Timeline
27:44 Model Choices and Sovereignty
28:44 Tokenomics and the Data Mesh
30:31 Securing Agent Ecosystems
34:31 The Monday Morning Playbook
37:56 Avoiding Overengineering
40:03 Trust in Autonomous Software Receive SMS online on sms24.me
TubeReader video aggregator is a website that collects and organizes online videos from the YouTube source. Video aggregation is done for different purposes, and TubeReader take different approaches to achieve their purpose.
Our try to collect videos of high quality or interest for visitors to view; the collection may be made by editors or may be based on community votes.
Another method is to base the collection on those videos most viewed, either at the aggregator site or at various popular video hosting sites.
TubeReader site exists to allow users to collect their own sets of videos, for personal use as well as for browsing and viewing by others; TubeReader can develop online communities around video sharing.
Our site allow users to create a personalized video playlist, for personal use as well as for browsing and viewing by others.
@YouTubeReaderBot allows you to subscribe to Youtube channels.
By using @YouTubeReaderBot Bot you agree with YouTube Terms of Service.
Use the @YouTubeReaderBot telegram bot to be the first to be notified when new videos are released on your favorite channels.
Look for new videos or channels and share them with your friends.
You can start using our bot from this video, subscribe now to Don’t Let AI Go Rogue: Human Governance for Agentic Systems
What is YouTube?
YouTube is a free video sharing website that makes it easy to watch online videos. You can even create and upload your own videos to share with others. Originally created in 2005, YouTube is now one of the most popular sites on the Web, with visitors watching around 6 billion hours of video every month.
