🏝 TheTechOasis 🏝

Breaking down the most advanced AI systems in the world to prepare you for your future.

5-minute weekly reads.

The AI industry looks unstoppable.

Hailed by some as the most important technology ever created by humans, people will look back at the end of 2022 as the moment humanity finally realized the potential this tech, or should I rather say science, has to dramatically change society.

But will it?

Many are convinced that no regulation or arbitrary decisions can cripple the growth of the technology, but the reality is that AI is really walking on shaky grounds.

OpenAI is chaining lawsuit after lawsuit, with a diverse set of plaintiffs that include George R.R Martin, author of Game of Thrones, and Sarah Silverman, while big tech companies are lobbying the hell out of Washington and Brussels to tame the lion before it bites.

In particular, the EU looks poised to be a profound pain in the butt for these companies, with its AI Act spearheading the efforts to regulate AI.

The fears are such that Microsoft’s Copilot, a 30 dollars license product that embeds a distilled version of ChatGPT into every Microsoft product known to man, has such a hefty price partially justified by Microsoft to cover the potential fines of using such technology in lieu of their customers.

Additionally, although later denied, rumors had it that OpenAI could leave the EU were regulations to bite.

But any set of countries that were to cripple AI would surely suffer from that decision as other countries embrace it, right?

No politician would do that! They would get stomped by the people, right?

… Right?

Well, actually they may be even incentivized to do so.

Fear Drives Humans

A recent study by IE University, one of the top business schools in the world, revealed that 68% of Europeans want their governments to introduce rules to safeguard jobs from AI advancement.

In other words, fuck progress, I just simply want to protect my job.

Despite being a technology that is already capable of detecting Alzheimer’s disease in brain scans or detecting Parkinson’s disease by simply looking at the eyes of the patient, people first and foremost want to protect themselves, and that includes jobs.

And what is the AI industry doing to calm down society?

Well, besides making it worse, not much more.

OpenAI released a report that stated that around 80% of the US workforce was somehow affected by AI, with 19% having more than 50% exposure.

In layman’s terms, one in every person in the US market could soon see half of its activities completely taken by AI.

McKinsey jumped onto the sad train and claimed that by 2030, 30% of current work activities would be already automated, causing more than 12 million people in the US alone to change jobs.

To make matters worse, many voices in Silicon Valley, including the likes of Sam Altman, CEO of OpenAI, and Elon Musk, have openly called for the deployment of Universal Basic Income.

In other words, many tech tycoons that are completely in the line of fire not only agree with McKinsey, but they feel that most people won’t be able to switch jobs and will be, unequivocally and timelessly out of the market.

Something’s off if some of the most capitalist people in the world are actively requesting basic income.

And considering they are the guys and gals behind the steering wheel of this technology, no surprises then when we see laypeople get scared.

But, honestly, I don’t think AI is going to be stopped based on these terms.

Geopolitics and AI

If we take Europe as an example, I as a European can only but watch in sadness as the continent becomes more and more irrelevant.

For instance, as Scott Galloway explained, a European start-up is much more prone to fail than an American one, despite Europe having some of the best schools and talent in the world.

Europe is losing ground by the day as the US looks stronger than ever despite the political turmoil and the BRIC countries are developing at insane speeds despite some fears of collapse.

It’s no surprise then that despite the extremely hawkish regulation that Europe intends to install for AI, public leaders like Macron are actively demanding ‘European AI champions’ and launching a $500 million AI fund.

Three weeks later, a three-week-old AI Frency company, Mistral, raised $113 million at a quarter of a billion valuation.

Coincidence? You tell me.

But even in the case that Europe’s stance continued to be hawkish, it would only be implemented if the US backed the hell out of it.

And today that’s not the case. As outlined by this article, the US’ posture will most probably not be focused on regulation, but simply on litigation, as it always has been in the US.

But if that’s the case, OpenAI and others are in a far, far worse position, as the problem here is much harder to solve.

In fact, it hasn’t been proven to be solvable.

The Transparency Problem

As mentioned, in the US experts think that the most probable outcome will be that AI issues will be solved not by regulation, but by litigations.

If someone feels negatively impacted by an AI, they sue the company behind it. Simple.

The problem?

With today’s understanding of the AI algorithms running behind the likes of ChatGPT, Claude, or DALL-E, the companies behind these models have lost even before the litigation starts.

‘Your black box model discriminates me’

Just picture yourself as a judge.

A plaintiff has sued an insurance company that doesn’t want to cover the accident this person had with his insured car.

The reason?

A super fancy and advanced AI algorithm saw the image of the impact and concluded that the fault was of the plaintiff and, thus, the insurance company wasn’t going to back him.

Naturally, as a judge, you will ask the insurance company to explain how the model reached that conclusion.

The answer? “We don’t know, the model is a black box so we really can’t thoroughly explain how it made that decision.”

Now, what would you do? Of course, the insurance company is paying that man.

Put simply, we have no fricking clue, today, how current state-of-the-art AI models behave.

They are at most times unpredictable, and they even manage to develop new capabilities we can’t even see coming (which is why we describe them as ‘emergent capabilities’).

Hence, without answering the ‘great question’, most AI companies would soon run out of money as they have to deal with guaranteed-to-lose litigations all across the board.

But why can’t we explain models?

From statistics to decisions

Although we absolutely understand how they compute every calculation they do, we can’t predict why neurons activate and in what situations.

But what is a neuron?

Most current top systems at the center of the discussions are neural networks, networks of millions or even billions of interconnected elements we define as neurons that, ironically, are simple weighted linear calculations that coarsely resemble human neurons.

Each of these neurons has an activation function, a step-function formula that determines if that neuron activates for a certain prediction or not.

In other words, some neurons fire in certain situations, like when ChatGPT writes in German, and others will activate for ChatGPT to write in Shakespeare’s style.

Therefore, the solution seems clear, right?

To explain how a neural network makes a decision, we simply need to see what neurons were activated in that prediction and, as we know what makes these neurons ‘fire’ — that’s literally the term, like in neuroscience — we will know the reasoning process.

Taking the car crash example, if the neurons that fired only explicitly fired in cases where the crashed car has signs of being at high speed when crashing, the insurance company can now not only explain the thought process of the model, it has also gained incredibly valuable insights from the image, i.e. that the insured man was traveling at a very high speed.

But, as it turns out, this is easier said than done.

As proven by research, neurons are polysemantic, meaning that they fire to multiple, unrelated situations.

In layman’s terms, a neuron can fire to write a poem in Russian and to predict the impact of the Ukrainian War on oil prices.

Unsurprisingly, most researchers who tried to gain an understanding of how models made decisions and based their assumptions at the neuron level miserably failed.

But a recent study might have the key to uncovering the holy grail of AI, model explainability, by introducing a new concept that might as well change completely how humans understand AI.

Subscribe to Full Premium package to read the rest.