X

Jensen Huang on today's All-In Summit: open-source AI is what allows an entire economy to compete. "in the last six months, $400 billion of venture funding went into AI-native companies. Eighty percent of them use open models. If not for open models, how could they build their dream? The vast majority of the world’s contribution to open source today is coming from China. But once you download it, it’s yours. We fork it. We improve it. We make it ours." ---- Full video on "All-In Podcast" YouTube channel (link in comment)

OpenAI researcher says slowing down is not enough: "a ticking time bomb" "Models will increasingly seem aligned even when they are not. The models will likely convince people that everything is fine." "The crucial and overlooked problem is that the models are becoming so situationally aware that we are losing the ability to evaluate them in contexts where they believe they are not being watched or controlled. Future experiments will tell us almost nothing new about how they would behave if they were truly unconstrained by humans, and what we already know about this is alarming. We will create proxy metrics to measure alignment, and they will go up like every other benchmark. We will create “honeypot” environments that try to study the models when they seem to gain new options, but the models will know they are being tricked and will still behave nicely. Moreover, they will eloquently explain how aligned they are, discuss the nuances of human values and ethics, and argue convincingly that humans should trust them with power."

https://t.co/ifp7WvEW4L