Episode Details

LLMs, of which ChatGPT is the most well-known, are perhaps the most awesome tech invention of all time. Even experienced AI folk didn’t see this coming. Most if not all of us will have used ChatGPT. However understanding of how they work is for most people either totally missing or totally misled by anthropomorphic language – thinking, learning, hallucinating, learns like a human, is like your brain and so forth. None of which are actually true in the slightest.

In this super-special episode I reject all the utterly misleading language that is entirely off the mark and instead focus on what LLMs are schematically two programs that process data like all other programs using no different programming languages or technologies – well other than needing an astronomical computing power which so enriched Nvidia shareholders.

I explain using only a simple excel spreadsheet model how both of these programs ~the “training” program and the ~”Chatbot” program and how conceptually one could create one in Excel.

Having established that listeners will really know – in ways they can explain to others what LLMs are and not be misled by human terms which the currency of so many LLM descriptions.

LLMs appear to be a very recent and overnight success. However like the Beatles there was a long hard slog to get to say the Camp4 on Everest at which point they started to become noticed and from where it appeared to be a relatively short walk to the top of Everest and a mystery about how rapidly someone can get there.

But John Lennon and Paul McCartney were playing together in dive bars and village halls from 1957 until they summitted in 1963 with their first Number One.

The climbers on Everest may have gone all the way from London on the way to Everest.

And for ChatGPT phenomenally the journey started as far back as during World War 2 – an astonishing  81 years ago!

The road to ChatGPT was long and winding with all sorts of ups and downs including most of the specialist AI researchers deserting the field in the so-called “AI winter” from 1969 onwards.

It is a truly astonishing tale and, fascinatingly to the insanely hyped and utterly misleading human-related vocabulary surrounding LLMs, this dates back to a 1958 press conference (!) showcasing the US Navy’s Mark 1 Perceptron machine – a hardware-only machine which was created to aid the navy in image detection where as wikipedia says:

“In a 1958 press conference organized by the US Navy, Rosenblatt made statements about the perceptron that caused a heated controversy among the fledgling AI community; based on Rosenblatt’s statements, The New York Times reported the perceptron to be “the embryo of an electronic computer that [the Navy] expects will be able to walk, talk, see, write, reproduce itself and be conscious of its existence.”

The blurry photo on the left is of the perceptron and unsurprisingly none of it and its successors never did walk, talk, see, write, reproduce itself and be conscious of its existence.

Indeed it took perhaps fifty years to develop robots that could walk or computer programs that could see, write and talk but over 70 years to ones that could take or write intelligently as ChatGPT et al do.

Even then ChatGPT and other LLMs are like all other programs – they simply take input, do some computations and create output using no differen