But if we pause it, we won't have systems that we can study. I think AI safety can't be solved in isolation, just in theory. It needs to be experimentally validated, and the best is to do it incrementally.
@marek_rosa
-
AI Agents Liability: Who Bears Legal Responsibility?
By
–
For me, product safety and business responsibility are the main motivations. Also, who will pay for it if our agents cause harm and damage? Who ends up in prison? Agents or me?
-
AI Risk Beyond Existential Threat Scenarios
By
–
I don't even look at it from the "AI doom" perspective (AI seeking power and wanting to kill us all).
-
Autonomous AI Agents Risk Unwanted Task Execution Behaviors
By
–
The first risk is that they may start doing unwanted tasks (e.g. I ask them to run a marketing campaign for me, and the agents decide to spam everyone, manipulate people, hack into computers, etc)
-
LLM Failure Cases in Agent Loop Planning Tasks
By
–
Can you share some of the failure cases? Why specifically it didn’t work? LLM failed to stay in a loop, or follow a plan?
-
Game Development Using Stable Diffusion and AI Generation
By
–
How does this game work? I am assuming you are using stable diffusion for the skybox, but what about the shooting part?
-
Building Proactive Defenses Against Rogue AI Systems
By
–
I don’t want to stop the development of AI. But I think we need to build proactive defense against rogue AI, just like we build antivirus and firewall SW.
-
Securing Billions of AI Agents: Proactive Defense Strategies
By
–
Any ideas on how to increase security (proactive defense) in a world where there are billions of AI agents (AutoGPT, BabyAGI) running in apps and servers, and we don’t know what they are talking about? Some kind of antivirus against AI agents?
-
AI Researcher Marek Rosa Discusses Autonomous Agent Safety
By
–
Moj novy rozhovor vo Forbes SK: "Sledujeme, či sa naša umelá inteligencia nesnaží ovládnuť svet, hovorí výskumník Marek Rosa" https://
forbes.sk/marek-rosa-tre
nuje-svoje-ai-v-hrach-jeho-autonomni-agenti-maju-svetove-prvenstvo/
… 1/2 -
Bottom-up simulation design with integrated modular principles
By
–
The point was to create a simulation (e.g. Space Engineers) where things work from the bottom-up, from basic principles that are solid, integrated, modular, and not just some high-level principles hacked together.