This is as bad as saying there is no alpha in customizing your own models. I don't think people realize how much harnesses and models go hand in hand. And thus the rest of the intelligence stack.

Not attacking anyone here, but this kind of thinking is too shortsighted. This makes me question what exactly people are trying to build with AI or what they expect to build with AI. If you work on ambitious stuff (not all of this short-term AI slop), you quickly realize how significant it will be to own the intelligence stack.

Harnesses, like evals and models, are things you want to own. Even if models can generate harnesses on the fly, which some can already, there are customizations that you simply cannot afford to offload. Not to mention that when RSI arrives, you don't want to sit and wait for others to build things for you. You must build it, and it's in your best interest to own it.

The goal for everyone building with AI is to build like a frontier lab. Don't worry about costs; that will get sorted as intelligence becomes too cheap to meter.