fbpx

Yann LeCun’s big bet on building smart machines


Melanie Mitchell, an artificial intelligence researcher at the Santa Fe Institute, is also excited to see a whole new approach. “We haven’t really seen much of this coming out of the deep learning community,” she says. He also agrees with LeCun that major language models can’t be the whole story. “They lack the memory and internal models of the world that really matters,” she says.

Natasha Jaques, a researcher at Google Brain, thinks that language models should play a role, though. It’s strange that LeCun’s offerings are completely lacking in language, he says: “We know that large language models are super effective and are baked into a lot of human knowledge.”

Working on ways to enable artificial intelligence to share their knowledge and abilities with each other, Jaques points out that people do not need to have direct experience to learn something. We can change our behavior by being told something like not touching the hot pan. “How can I update this world model Yann suggested if I don’t have a language?” she asks.

There is another issue. If they were to work, LeCun’s ideas would create a powerful technology that could be as transformative as the internet.

Still, his proposal does not discuss how his model’s behaviors and motivations will be controlled, or who will control them. This is a strange omission, says Abhishek Gupta, founder of the Montreal AI Ethics Institute and a responsible AI expert at Boston Consulting Group.

“We need to think more about what it takes for AI to work well in a society, and that requires thinking about ethical behavior, among other things,” Gupta says.

Still, Jaques notes that LeCun’s suggestions are still ideas rather than practical applications. Mitchell says the same thing: “There is absolutely little risk that it will become a human-level intelligence any time soon.”

LeCun would agree. Its purpose is to sow the seeds of a new approach in the hope that others will build on it. “This is something that will require a lot of effort from a lot of people,” he says. “I’m putting that out there because I think that’s the way to go after all.” If nothing else, he wants to convince people that big language models and reinforcement learning aren’t the only way forward.

“I hate seeing people waste their time,” she says.



Source link

Leave a Reply

Your email address will not be published. Required fields are marked *

(0)