ai

Molly White’s experience with LLMs corresponds more or less with my own, but she is much better at recounting, critiquing, and drawing conclusions than I am. I find my feelings about AI are actually pretty similar to my feelings about blockchains: they do a poor job of much of what people try to do with them, they can’t do the things their creators claim they one day might, and many of the things they are well suited to do may not be altogether that beneficial....

I spent the day doing remote maintenance on multiple Linux machines via ssh. The revelation is that ChatGPT is the bomb for these tasks: What does that command option do? I am trying to remember. What syntax is to install that peculiar and rarely used package on Debian? I am getting this locale configuration error; what was the fix again? All this stuff is answered much sooner than searching online, no matter the search engine....

“Coding” was never the source of value, and people shouldn’t get overly attached to it. Problem solving is the core skill. The discipline and precision demanded by traditional programming will remain valuable transferable attributes, but they won’t be a barrier to entry. – John Carmack I’d be tempted to call bullshit on this one, but it’s coming from Carmack, so hey, let me think about it for a minute (it’s not the first time I’ve caught him endorsing AI)....

Yesterday’s OpenAI launch of Sora is, as is always the case with OpenAI, mind-boggling. Marquees Browniee’s comment is spot-on, so much so as he’s obviously involved in the video-making scene. I don’t think content creators are at risk with Sora, not anytime soon, but, as Marquees repeatedly notes in the video above, just one year ago we thought AI-generated video was a joke.

Ethan Mollick, one of my few LLM/AI sources, just dropped his first impressions on Gemini Advanced, released today, but which he’s been testing for a month in early access. Let me start with the headline: Gemini Advanced is clearly a GPT-4 class model. The statistics show this, but so does a month of our informal testing. And this is a big deal because OpenAI’s GPT-4 (the paid version of ChatGPT/Microsoft Copilot) has been the dominant AI for well over a year, and no other model has come particularly close....

Just Tell Me cleverly leverages ChatGPT to provide short, insightful summaries of YouTube videos. Have you ever wasted some time watching a youtube video, that got you kind of interested because of the click-baity topic, but in the end turned out to be nothing more BUT click-bait? Or have you ever wanted to just quickly recall what a video that you’ve watched some time ago was about? Just Tell Me has you covered!...

I think I like his take on the topic.

Professor Ethan Mollick’s Signs and Portents analyzes what AI has achieved, what the effects have been so far, and what we might expect in 2024. To ground ourselves, we can start with two quotes that should inform any estimates about the future. The first is Amara’s Law: “We tend to overestimate the effect of a technology in the short run and underestimate the effect in the long run.” Social change is slower than technological change....

Simon Wilson, who’s recently been my go-to person for all AI-related stuff, has an excellent 2023 AI round-up on his website. 2023 was the breakthrough year for Large Language Models (LLMs). I think it’s OK to call these AI—they’re the latest and (currently) most “interesting development in the academic field of Artificial Intelligence that dates back to the 1950s. Here’s my attempt to round up the highlights in one place!...

I always struggle a bit with I’m asked about the “hallucination problem” in LLMs. Because, in some sense, hallucination is all LLMs do. They are dream machines. We direct their dreams with prompts. The prompts start the dream, and based on the LLM’s hazy recollection of its training documents, most of the time the result goes someplace useful. It’s only when the dreams go into deemed factually incorrect territory that we label it a “hallucination”....