Key Takeaways:

• Government AI transformation is over-indexing on technology and under-indexing on people. Change leaders are focused on data and governance challenges while paying too little attention to culture and human adoption.
• LLMs have three structural limitations that only original thinkers can address. They produce probability based outputs that are wrong in nuanced ways, they drive organizational groupthink when used without training, and they increasingly train on their own synthetic data, reinforcing homogeneity.
• Existing assessment tools can't identify the right people for an AI-transformed workforce. Traditional assessments have "correct" answers that candidates can game with AI, leaving leaders without an objective way to benchmark capabilities or design fair processes.
• Original Intelligence can now be objectively measured. People with high Original Intelligence expand the idea space beyond what AI produces, are more comfortable with risk and leadership, and are natural bellwethers for enterprise transformation. Measuring OI gives leaders a way to shape training, assess progress, and build teams that work well together.

Original Intelligence – the Missing Piece for AI Transformation

As the government is deploying AI, it may not be focusing as it should on the interplay between efficiency of AI and the value add of human insight and experience. Some of this is not surprising, for example a survey of government AI change leaders showed much greater concern towards solving AI technology adoption challenges (data and governance) rather than culture and human adoption. Those of us in the field are hearing anecdotally of internal concerns among government workers regarding the adoption of comprehensive AI Agent deployment or utilization of LLMs, for example at the IRS or the Patent and Trademark Offices. Or we read in the media about problems with Social Security customer services, where the deployment of AI agents has not yet caught up with citizen demand.

I suspect that these vignettes are indicative of a more systemic problem. If our change leaders are over indexing on AI transformation being only a technological challenge this will have significant negative effects on our government, government contractor industry and government services.

We should frankly acknowledge three inherent structural limitations to LLMs and AI Agents. The first is that they are probabilistic models, which means that they will at times be dangerously not right, and more often incorrect in a nuanced way. I use AI all the time, and I am often struck by the seductive certainty of the answers I get, and how often there is a nuanced misstatement or outright error, particularly as I use it for more complex tasks. I’m sure that I am not alone in this. The fact is that as “wrong” answers are more and more nuanced, they will not be obvious to those that are untrained, lack experience and context or are just plain old lazy.

The second is that it is demonstrable and more and more widely reported that use of AI without training and a conscious effort to reinforce human creativity, creates a toxic brew of organizational group think and mediocrity.

The third is that the AI trainers have just run out of data and are now training their models on AI-derived data. AI narcissism, where the models start to prefer the synthetic data in their answers is an emerging problem. And will reinforce the existing predisposition to homogeneity.

What is the solution to each of these limitations? People who are original thinkers.

Why doe AI transformation focus more on technology than those people? Some of this is due to the tech love for anything new: AI is just the most recent iteration of a long history of technologies that boosters claim will be able to do anything and solve any problem. Look at discussions of the World Wide Web in 2000 for a nice historical reminder and look what it has become.

But, putting aside the enthusiastic boosters, for those that want to value humans in an economic analysis of AI transformation they have had a second problem. The tools haven’t been there.

Assessment tools currently used for finding people who can flourish in an AI transformed environment are of limited or no predictive utility. These tools fail when people can use LLMs to “cheat.” In a situation where there are “correct” answers to these tests — and there always are correct and expected answers for comparisons to be made — AI renders these tests obsolete. This is because once a “correct” answer is known to a candidate who uses an LLM, and the candidate shares the answer with others directly, or indirectly through the LLM ingesting the “right” responses through relentless indexing and data crawling, the “right answer” is immediately available to all.

Faced with the inherent limitation of existing tools, the change leader for AI transformation has a problem. How to benchmark capabilities, train and provide an objective and fair process? Perhaps it’s not surprising why many leaders are just throwing up their hands and focusing only on the efficiency gains of AI. It’s easier to focus on the things you can measure.

The good news here is you can now objectively measure Original Intelligence, an individual’s ability to expand an idea space and provide objective novelty – whether compared to other people or against the output of LLMs and AI Agents.

People with Original Intelligence will add value by providing the novelty and differentiation that LLMs and AI Agents cannot. They are curious, self-starters, willing to take risks and are more comfortable in leadership roles. Original thinkers, not surprisingly, are also much better at taking tools and creating something new – they are the bellwethers of any enterprise transformation including AI transformation.

Using Original Intelligence, training and engagement can be shaped to individual capabilities, and progress assessed. Original Intelligence can be the hallmark of a new approach to government service and consulting – one that highlights and celebrates the originality of our workforce and its ability to use AI to create something new.