All articles
Saturday Links: AI self-reflection, compilers and critics
Here are this week's AI links: * The AI developer... A great step-by-step analysis post by Marie Brayer of Fly Ventures on the progress towards Code writing AI in its many forms. AI and code generation go hand in hand because you have a perfect execution environment against which to check outputs. There's still a long way to go before we have true, reliable, autonomous code generation, though. * Meta's Compiler LLM: Meta has released two open-source LLMs trained on compiler and assembly code
Saturday Links: Consultancy revenue, minimal code and Go
Here are this week's links. A bit less Apple, a bit more machine learning. * Accenture says strong AI demand to power 2024 revenue growth. AI consulting is definitely paying off right now, with Accenture projecting over $2B of generative AI-related revenue in 2024 and making a hiring push. How much of this will be "replace spreadsheets with AI" and how much will be "replace AI with spreadsheets"? * These 94 lines of code are everything that is needed to train a neural network. Everything else
Sunday Links: Parrot, Apple AI AI, and building LLMs
A little later again due to travel during the week, but here are this week's links: * CodeParrot: An AI-powered tool that Transforms Figma Files into Production Ready Code. One of the more widely talked about this week is Parrot, which takes Figma (interface code design) files and turns them into code. The Y-Combinator company has some interactive code development features like Github Co-Pilot, but it is novel since it can use your carefully crafted Figma project as a guide. These types of too
Sunday Links: AI Trillions, Ontologies and Weather Balloons
A little late again this week after a lot of travel. Here are the most interesting links I came across: * NVIDIA's Market cap. In other news, NVIDIA's market cap rose to over $3Trillion this week, briefly overtaking Apple. NVIDIA crossed the $1T mark in May 2023 and the $2T mark in February of this year (4 months ago). Luckily, Jensen's Hwangs, now iconic leather jackets, have survived all the transitions so far. Perhaps rivals need to figure out how to shut down his supply! * AI Antitrust. A
Sunday Links: $6B for another foundation model, bots, and more publisher licensing
It's a little late this weekend, but maybe this will help you kick off your Monday. Here are this week's links: * Perplexity is rolling out report creation. Perplexity is still my go-to web search tool despite Google bringing Gemini into play for search summaries (see below on how that is going!). The company is now releasing a special mode to create a research report on any topic guided by the audience's expertise (anyone, beginner, expert, etc.). This is a logical product extension that take
Saturday Links: AlphaFold3, The SEO Storm and Mapping LLM Concepts
Here are this week's links: * AlphaFold 3 now predicts how proteins interact. Google's AlphaFold project is already one of the best examples of using AI to understand the biological world. Versions 1 and 2 were able to predict possible protein folding configurations, which was a major breakthrough. AlphaFold 3 takes these capabilities even further and can often also project how molecules will interact with each other. This represents another huge leap forward in our understanding of biological
Saturday Links: Two Keynotes and Sarcasm Detection for AI
There was two dueling AI keynotes this week, with OpenAI's unveiling of GPT4"oh" and Google's myriad of announcements at Google I/O. Those and other links this week: * Introducing ChatGPT 40. OpenAI's launch keynote, which was released on Monday, was an impressive sequence of demos ranging from real-time translation and much faster voice interaction to truly impressive multi-modal interaction. While many of the response capabilities remain close to GPT, the new range of snappy interactions is
Sunday Links: Training Data, AI Dating and Crushed Dreams
Here are this weeks links, just sneaking into the week: * Stack Overflow and OpenAI partner to enhance OpenAI models and share them right back. In the deal, OpenAI will benefit from StackOverflow's deep reservoir of coding knowledge for training. StackOverflow will have access to build its own AI experience. This is a logical move for both parties, but StackOverflow will still need to solve existential problems down the line, and some of its users are reacting by deleting their content. While
Sunday Links: Xaira, Data Centre Geopolitics and Search
Even later this week, but here are the most interesting links I came across this week: * Xaira, an AI drug discovery startup, launches with a massive $1B. The AI+Science trend continues with another massive investment. The company raised initial funds from well-known Silicon Valley funds, then operated in stealth, and is now launching publically with another large funding round. The size of the fundraising is somewhat understandable, given that getting drugs to market takes time and money, and
Saturday Links: The R1 arrives, LLM Shrinkage and AI+String Theory
Hello to everyone. Here are the links for the week: * A morning with the Rabbit R1: a fun, funky, unfinished AI gadget. The Rabbit R1 device has arrived. It's a device 1/2 the size of the phone that operates apps on your behalf, and I've written about it before. I'm selfishly interested since I also pre-ordered one. The reviews are pretty much as I expected: interesting, funky, but still flawed. I'm still excited to get the device: no doubt it will improve, and it opens up a lot of potential f
Saturday Links: Notion, One-click divorce, and RIP Daniel Dennett
Here are this week's links: * Notion and AI on Forbes. Overview article of Notion's plans for AI and continued rapid growth in the business productivity space. If you don't know what Notion is, think of it as a more programmable Google Docs. Monday.com has some similarities (though less powerful). The big difference to existing office suites (even online ones) is that the core of Notion is a effectively a database that captures your info in snippets you can slice and dice + layers and layers o
Saturday Links: Google Enterprise AI, Training Data, and Robot Rescue
Here are this week's links: * The "Everything AI" Google Next Keynote. Google went all in on AI in its showpiece keynote this week. Its core pitch was that it has the deepest infrastructure base to deliver AI both to the consumer and to the enterprise. There were some impressive product notes. I'm still wondering how Android and search will ultimately be affected by AI (and the options it opens for competitors), but on the Enterprise side, Google is pulling out all the stops. From the demos, i
Saturday Links: Stargate, Jobs and Lavender
Here are this week's links, including one truly awful story: * The open source Devin's multiply. Last week, we covered an open-source project (Devina) that is following in the footsteps of Magic.Dev, Devin, and other projects that aim to use LLMs to create fully functional "developer colleagues." This week there have been at least two more. It seems these days, you only need an LLM with a large context window, and you can reach human-level AI. * ‘The machine did it coldly’. This week, there w
Easter Links: Extending transformers, Devika and Databricks flexes
Here are this week's standout AI links: * AI21 Labs juices up gen AI transformers with Jamba. Another little step in tweaking the power of transformers. The new model from AI21 labs focused on integrating Mamba (originally developed by CMU and Princeton) with Transformers to manage context more efficiently. In a nutshell, transformers (the current leading approach for building LLMs) need to keep the whole prompt history in memory to keep functioning. Mamba and approaches like it are trying to
Saturday Links: High pay in the AI Era, Inflection.AI and Brain Interfaces
The astute among you will have spotted that last week's post didn't happen. My apologies for the gap in service! Some travel off-grid meant that the post didn't make it but normal service is restored. I also have a couple of longer posts in the pipe to make up for it. Links from this week: * AI Model training without copyrighted content. Fairly trained is a non-profit that certifies AI models to validate they do not use copyrighted material. The organization announced this week that it has ce
Saturday Links: Singing Pictures, Trashy CNET and AI Firewall CDNs
One day late again this week: apologies. Here are the highlight links of the week, though: * “Building An Answer Engine” Aravind Srinivas interview on Invest Like the Best. Really good interview with the founder of Perplexity (which I'm a fan of). Aravind gives a really good state of the union on where we are with LLM investments, costs, and the app business. TL;DR - there likely won't be that many "massive" models, but it's also not clear you want to "pack the whole Internet" into an AI; mayb
Friday Links: Brain Eats Phone, Lip Syncing, and Don't Learn to Code
Here are this week's standout links: * Hugging Face will undoubtedlyMalicious code in some Hugging Face AI models. As with any large content community, there will be abuse. Software supply chain vendor JFrog identified a number of models that could hijack user machines. Hugging Face will undoubtedly step up policing this, but it's a reminder that when something is as new as AI, it's a great attack vector since users will be doing unfamiliar things as they try to get set up. * Brain.AI becomes
Saturday Links: AI Soap Operas, Faster Chips and Generous Chat Bots
One day late, my apologies, but here are the links for the week: * TV soaps could be made by AI within three years. News from a parliamentary committee on art and culture around the accelerating speed of content creation in all industries. My guess is that this timeline is both right and wrong. Will it be possible to create a consistent, multi-part, ongoing entertainment as rich as (say) East Enders with AI in 3 years? It's very unlikely. Will significant parts of the process, from ideation to
Friday Links: AI reads the Internet, multi-language data sets, and highly realistic generated video
Here are this week's links. * Cohere releases Aya: a model and dataset focused on support for 101 languages. Getting native language support in AI is a really important goal for equal access (and ultimately also for cultural preservation). Cohere's project crowdsourced and processed expert-level language data sets and translations. It's great to see that all the datasets are open source for others to build on top of. * Who makes money when AI reads the Internet for us? What happens if browser
Saturday Links: Agent Wars, Copyright Fightbacks, and Abstract Reasoning for LLMs
One day late again, apologies! Travel has been heavy these past couple of weeks, so it's been tough to get ahead of the curve enough to post on time. It's been an interesting week with big shifts that could have long-term implications but muted commentary. A few things that stood out: * ChatGPT accelerates toward task automation. OpenAI is apparently working on a layer within ChatGPT that will allow the automation of complex tasks over backend services. I already commented on this task-centri