{"id":8086,"date":"2025-05-31T13:31:32","date_gmt":"2025-05-31T13:31:32","guid":{"rendered":"https:\/\/nationalgunowner.org\/index.php\/2025\/05\/31\/gary-marcus-says-llms-are-leading-a-i-in-the-wrong-direction\/"},"modified":"2025-05-31T13:31:32","modified_gmt":"2025-05-31T13:31:32","slug":"gary-marcus-says-llms-are-leading-a-i-in-the-wrong-direction","status":"publish","type":"post","link":"https:\/\/nationalgunowner.org\/index.php\/2025\/05\/31\/gary-marcus-says-llms-are-leading-a-i-in-the-wrong-direction\/","title":{"rendered":"Gary Marcus Says LLMs Are Leading A.I. in the Wrong Direction"},"content":{"rendered":"
\n
\"Man
Gary Marcus speaking at Web Summit Vancouver 2025 on May 27. Don Mackinnon\/AFP via Getty Images<\/span><\/figcaption><\/figure>\n

For someone who\u2019s spent nearly his entire life working in artificial intelligence, Gary Marcus<\/a>\u2014researcher, author and cognitive scientist\u2014isn\u2019t exactly a cheerleader for the technology. In fact, he\u2019s one of generative A.I.\u2019s most outspoken skeptics, frequently questioning both its current capabilities and its potential to cause harm. \u201cAfter 40 years of doing this, I\u2019ve never gotten over the sense that we\u2019re not really doing it right,\u201d Marcus told Observer.<\/p>\n

\n<\/section>\n

That hasn\u2019t stopped him from engaging deeply with the field. Marcus studied under psychologist Steven Pinker<\/a>, founded two machine learning startups and briefly led A.I. initiatives at Uber<\/a>. A professor emeritus at New York University, he even graduated high school early after building a Latin-to-English translator.<\/p>\n

At the crux of his disillusionment is the field\u2019s current obsession with large language models (LLMs) and the neural networks that power them. Marcus argues these systems are fundamentally limited and should be supplemented with symbolic A.I.\u2014a more traditional, logic-based approach rooted in rules and reasoning. \u201cI think we\u2019re very early in the history of A.I.,\u201d said Marcus, who has also called for regulation to address the technology\u2019s emerging risks.<\/p>\n

Observer caught up with the prominent skeptic at Web Summit Vancouver this week to discuss all things A.I. The following conversation has been edited for length and clarity.<\/p>\n

Observer: How did you first become aware of and interested in A.I.?\u00a0<\/strong><\/p>\n

Gary Marcus: I was ten. It\u2019s a very specific moment. I learned how to program on basically a simulation of a computer that was on paper. It was part of my after-school program for gifted kids, and that night I explained to the media how it worked. So, my media career and my A.I. career began that day.<\/p>\n

How did you tell the media?<\/strong><\/p>\n

It was a show called Ray\u2019s Way<\/em>, which I didn\u2019t know too much about, but they thought it\u2019d be fun to have a human interest story. They nominated me to do the explanation, you know, cute kid explaining what a computer is. And I saw it on TV that night. There\u2019s no archival footage that we can find, but I did actually see it on my father\u2019s little black and white TV later that night.<\/p>\n

When did you feel the most optimistic about A.I.?\u00a0<\/strong><\/p>\n

I\u2019ve never been fully optimistic about it. I don\u2019t think we\u2019ve made as much progress as I\u2019d hoped that we would. I would have guessed that 40 years after I was looking at this, that a lot of A.I. would have been solved problems. We have a lot of tools now that are very useful. But I think the bigger questions of, like, how do you represent and acquire knowledge? You still don\u2019t have really good answers to those. So I\u2019ve never reached a point of being really satisfied. I always want it to go better.<\/p>\n

After working in a field for so long that didn\u2019t receive recognition for years and years, how did you perceive the ChatGPT moment with A.I. breaking into the mainstream?\u00a0<\/strong><\/p>\n

I started writing about it right away in my Substack and I said immediately that it\u2019s going to excite people but it has limits. I wrote an essay in December of 2022, right after ChatGPT came out, on Christmas Day called What to Expect When You\u2019re Expecting\u2026 GPT-4,<\/a> <\/em>and I made a series of predictions based on my understanding of how these things work and all the work I\u2019ve done before. I said everybody\u2019s going to be really excited at first, but they\u2019re going to become disillusioned. It\u2019s going to hallucinate, it\u2019s going to make dumb errors.<\/p>\n

You go back, and everything that I said was true\u2014not only of GPT-4, but of every model that\u2019s come since. They all still hallucinate. They all still make stupid errors. You still can\u2019t trust them. They\u2019re all kind of useful for misinformation, which is something I said.<\/p>\n

You\u2019ve suggested that large language models (LLMs) aren\u2019t the right way to pursue A.I. What would be the ideal form of pursuing it, and is anyone doing that?<\/strong><\/p>\n

I wrote a paper in 2020 called The Next Decade in A.I.<\/em><\/a> that described what I thought we should do, what I still think we should do. It starts with neuro-symbolic A.I., which combines neural networks with classical A.I. approaches. There\u2019s been a kind of historical division between the field, we need a reconciliation.<\/p>\n

AlphaFold is actually an example of neuro-symbolic A.I. We still don\u2019t have a systematic way to do it, that\u2019s just a start\u2014that\u2019s a stepping stone that we need to do first. We also need to have ways for systems to build cognitive models of the world as they see things happen.<\/p>\n

When do you think artificial general intelligence (A.G.I.) will be achieved?\u00a0<\/strong><\/p>\n

I would say definitely not this decade. Maybe the next decade and maybe longer. Science is hard. We don\u2019t know the answers that long before we get there. You can think of a historical analogy: in the early 20th century, everybody wanted to figure out the molecular basis of genes and they all pursued the wrong hypothesis. They all thought the genes were some kind of protein, and they looked at lots of proteins and they were all wrong. And then it was only in the late \u201940s, when Oswald Avery<\/a> did the right experiment to rule out proteins, that things moved.<\/p>\n

It was only a few years later that [James] Watson and [Francis] Crick, with Rosalind Franklin<\/a>\u2019s data, figured out structured DNA. Then we really were off to the races. It was like 30 years wandering the desert. When people have a bad idea, It\u2019s hard to predict when they will move past that bad idea.<\/p>\n

As someone who\u2019s spoken to the U.S. Senate on A.I. oversight and recently wrote about the budget bill\u2019s proposed 10-year moratorium on state A.I. regulation,<\/a> what are you thinking about the state of A.I. regulation right now in the U.S.?\u00a0<\/strong><\/p>\n

It\u2019s completely fallen apart. It\u2019s totally depressing. I spoke to the Senate in May of 2023 and we had strong bipartisan support and the support of Sam Altman<\/a> to have serious A.I. regulation, and nothing happened. Altman has changed his position. The Senate has become much less friendly. It is a huge step back and things don\u2019t look good right now. I think bad things will happen as a function of A.I.\u2014cybercrime, discrimination in employment, etc. etc. There\u2019s very little protection for U.S. citizens right now.<\/p>\n

You\u2019ve previously proposed a regulatory process for A.I. that would operate similarly to how the U.S. Food and Drug Administration (FDA) approves drugs. Is that still a solution you support?<\/strong><\/p>\n

I still absolutely think we should have it. And I think that even more so because we\u2019ve seen things like some of the most recent models maybe can help people make biological weapons. Is that okay, is it worth the gain? Society should have a vote, the government should have a vote, on whether you release something that is going to materially increase the chance of some serious harm in society. It\u2019s insane that the companies can do what they want without any any checks and balances.<\/p>\n

Lastly, as a long-time academic, how do you feel about federal funding cuts to science in the U.S. potentially impacting the country\u2019s innovation in A.I. going forward<\/a>?<\/strong><\/p>\n

Best thing that ever happened to China. I mean, it\u2019s really bad for the United States. We have\u00a0 historically, for many years, been basically the leader in science, and we\u2019re just destroying that for no good reason.<\/p>\n

\t\t\t\t\"Interview:<\/p><\/div>\n