Ethan Mollick's first impressions on Gemini Advanced

Ethan Mollick, one of my few LLM/AI sources, just dropped his first impressions on Gemini Advanced, released today, but which he’s been testing for a month in early access. Let me start with the headline: Gemini Advanced is clearly a GPT-4 class model. The statistics show this, but so does a month of our informal testing. And this is a big deal because OpenAI’s GPT-4 (the paid version of ChatGPT/Microsoft Copilot) has been the dominant AI for well over a year, and no other model has come particularly close....

February 8, 2024

YouTube video summaries via ChatGPT

Just Tell Me cleverly leverages ChatGPT to provide short, insightful summaries of YouTube videos. Have you ever wasted some time watching a youtube video, that got you kind of interested because of the click-baity topic, but in the end turned out to be nothing more BUT click-bait? Or have you ever wanted to just quickly recall what a video that you’ve watched some time ago was about? Just Tell Me has you covered!...

February 6, 2024

Linus Torvalds on the impact of LLMs and AI on programming

I think I like his take on the topic.

January 21, 2024

Some hints about what the next year of AI looks like

Professor Ethan Mollick’s Signs and Portents analyzes what AI has achieved, what the effects have been so far, and what we might expect in 2024. To ground ourselves, we can start with two quotes that should inform any estimates about the future. The first is Amara’s Law: “We tend to overestimate the effect of a technology in the short run and underestimate the effect in the long run.” Social change is slower than technological change....

January 7, 2024

Stuff we figured out about AI in 2023

Simon Wilson, who’s recently been my go-to person for all AI-related stuff, has an excellent 2023 AI round-up on his website. 2023 was the breakthrough year for Large Language Models (LLMs). I think it’s OK to call these AI—they’re the latest and (currently) most “interesting development in the academic field of Artificial Intelligence that dates back to the 1950s. Here’s my attempt to round up the highlights in one place!...

January 1, 2024

Quoting Andrej Karpathy

I always struggle a bit with I’m asked about the “hallucination problem” in LLMs. Because, in some sense, hallucination is all LLMs do. They are dream machines. We direct their dreams with prompts. The prompts start the dream, and based on the LLM’s hazy recollection of its training documents, most of the time the result goes someplace useful. It’s only when the dreams go into deemed factually incorrect territory that we label it a “hallucination”....

December 9, 2023

Intro to Large Language Models (video)

Andrej Karpathy has a very well-done Intro to Large Language Models video on YouTube. As a founding member and research scientist at OpenAI and with a two-year hiatus working on Tesla Autopilot, Karpathy is an authority in the field. He is also good at explaining hard things. As a Kahneman reader, I appreciated the Thinking Fast and Slow analogy proposed at about half-length in the video: “System 1” (fast automatic thinking, rapid decisions) is where we’re now; “System 2” (rational, slow thinking, complex decisions) is LLMs next goal....

November 24, 2023

AI-curated minimalist news

Minimalist News is the first LLM project that excites me but in a nervous way. Quoting the About page: We only publish significant news. To find them we use AI (ChatGPT-4) to read and analyze 1000 top news every day. For each article it estimates magnitude, scale, potential and credibility. Then we combine these estimates to get the final Significance score from 0 to 10. And now the best part: We’ll only send you the news scored 6....

May 3, 2023

Noam Chomsky on ChatGPT

Noam Chomsky’s essays are always worth reading, no matter the topic he decides to address, because, well, frankly, he’s one of the brightest and most well-informed minds of our time. His criticism of OpenAI’s ChatGPT makes no exception. It does an excellent job of explaining how LLMs work, the differences with human reasoning, and why, in his opinion, the advent of artificial general intelligence is a long way to go, if ever....

April 9, 2023

ChatGPT is making up fake Guardian articles

Chris Moran, the Guardian’s head of editorial innovation: Last month one of our journalists received an interesting email. A researcher had come across mention of a Guardian article, written by the journalist on a specific subject from a few years before. But the piece was proving elusive on our website and in search. Had the headline perhaps been changed since it was launched? Had it been removed intentionally from the website because of a problem we’d identified?...

April 6, 2023