Geoffrey Hinton

It was a whirlwind week for the 91�Թ�’s Geoffrey Hinton, who travelled to Sweden to officially accept the 2024 Nobel Prize in Physics alongside a jam-packed schedule of receptions, lectures, talks, ceremonies, banquets and media engagements.

The 91�Թ� University Professor emeritus of computer science known as the “godfather of AI” received the prestigious award during a formal ceremony at Stockholm Concert Hall — the main event during Nobel Week, held from Dec. 6 to 12 in Stockholm and Oslo.

He shared the honour with John J. Hopfield of Princeton University for foundational work that paved the way for today's rapid advances in artificial intelligence, which some have called “the next industrial revolution.”

From the days leading up to the ceremony to the celebrations overseas and back home in Toronto, here are a few highlights and behind-the-scenes glimpses of a historic moment for Hinton and the rest of the 91�Թ� community.

(Photo by Jennifer Cressman)

After arriving in Stockholm on Dec. 5, Hinton takes part in a panel discussion at the Royal Swedish Academy of Engineering Sciences (IVA) on AI development, humanity and the future. He is joined by IVA fellows Kristina Höök, Anders Sandberg and Staffan Truvé, and moderator Anette Novak.

(© Nobel Prize Outreach / Nanaka Adachi)

On Dec. 6, Hinton signs the guest book at the Nobel Prize Museum, where he donated an early Boltzmann machine – a chip about the size of a postage stamp that can be used to recognize elements in data.

(Photos by © Nobel Prize Outreach / Clément Morin, left, and at right, 91�Թ� staff)

Continuing a Nobel tradition dating back to the event’s 100th anniversary in 2001, Hinton signs the underside of a chair at the Nobel Prize Museum’s restaurant, joining the names of fellow laureates etched into history.

(Photos by Jennifer Cressman)

During a news conference at the Royal Swedish Academy of Sciences on Dec. 7, Hinton pauses to snap a personal photo, capturing a moment of his historic week.

(Photo by 91�Թ� staff)

In his Nobel Prize lecture in physics on Dec. 8, Hinton talks about how decades of his fundamental research, and that of his co-laureate, paved the way for the development of artificial neural networks and machine learning.

Hinton explains the significance of the Boltzmann machine, which he based on an invention of his co-laureate that was known as the Hopfield network.

(Photo by Pontus Lundahl/TT News Agency/AFP via Getty Images)

Hinton and John J. Hopfield shake hands after delivering their Nobel Prize lectures.

(© Nobel Prize Outreach / Clément Morin)

Since the 1960s, the laureates have participated in a roundtable discussion for television’s Nobel Minds. At the taping on Dec. 9, Hinton was joined by David Baker, Demis Hassabis, Gary Ruvkun, Daron Acemoglu and James A. Robinson.

The following day, Hinton officially accepted his Nobel Prize in Physics.

(Photo by Jonas Borg)

Hinton poses with Ulrika Gustafsson, his Nobel attaché, prior to the formal ceremony on Dec. 10.

The event, which was livestreamed from Stockholm Concert Hall, was watched around the world.

Congratulations to Canada’s own Geoffrey Hinton — “Godfather of AI”, Professor Emeritus, and now, Nobel laureate. pic.twitter.com/CON0AtXokq
— Justin Trudeau (@JustinTrudeau) December 10, 2024

(Photos by Diana Tyszko, Matt Hintsa, Sobica Vinayagamoorthy and Shauna Rempel)

On Dec. 10 in Toronto, 91�Թ� community members shared in the moment via Nobel ceremony watch parties that were held across 91�Թ�’s three campuses.

(© Nobel Prize Outreach / Nanaka Adachi)

Hinton receives his Nobel Prize from King Carl XVI Gustaf of Sweden during the ceremony.

(Photo by Jonathan Nackstrand/AFP via Getty Images)

Hinton sits next to Anna Sjöström Douagi, acting CEO of the Nobel Foundation, during the Nobel Prize banquet on Dec. 10.

“If the benefits of the increased productivity can be shared equally, it will be a wonderful advance for all of humanity,” Hinton told the audience, before repeating his warnings about the near- and longer-term dangers posed by rapid, unfettered progress of the technology. See the complete text of Hinton's acceptance speech.

91�Թ�’s Geoffrey Hinton receives Nobel medal, diploma at Stockholm ceremony

Christopher.Sorensen — Tue, 10 Dec 2024 20:05:05 +0000

91�Թ�’s Geoffrey Hinton receives Nobel medal, diploma at Stockholm ceremony

Christopher.Sorensen Tue, 12/10/2024 - 15:05

Cutline

91�Թ� University Professor Emeritus Geoffrey Hinton receives his Nobel Prize in Physics from King Carl XVI Gustaf of Sweden during the Nobel Prize award ceremony in Stockholm (photo by Henrik Montgomery/TT News Agency/AFP/Getty Images)

Topic

Subheadline

“I think we all feel an enormous amount of pride in the fact that [91�Թ�] is one of the places where modern machine learning was really born - in large part due to Geoff Hinton”

The 91�Թ�’s Geoffrey Hinton officially accepted his Nobel Prize in Physics during a formal ceremony at Stockholm Concert Hall that included orchestra music, an opera singer and a stage lined with bouquets of flowers.

Wearing white tie and tails, Hinton strode across the dark blue stage emblazoned with the words “The Nobel Prize” to receive his Nobel medal and diploma from King Carl XVI Gustaf of Sweden. Then, as the Royal Stockholm Philharmonic Orchestra sounded a few triumphant notes, he bowed to the Swedish royal family, the audience and returned to his seat at the side of the stage.

Geoffrey Hinton looks out over the audience after King Carl XVI Gustaf of Sweden presented him with his award (photo by Henrik Montgomery/TT News Agency/AFP/Getty Images)

And just like that, decades of scholarly endeavour in artificial intelligence (AI) – which began on the fringe of the AI research community and is now poised to forever change modern life – culminated in the 91�Թ� University Professor emeritus of computer science known as the “godfather of AI” receiving humanity’s most prestigious award for scientific achievement.

Hinton shared the 2024 Nobel Prize in Physics with John J. Hopfield of Princeton University, who made a similar journey inside the concert hall a few moments earlier. The pair were awarded the prize for discoveries and inventions that enabled machine learning with artificial neural networks, laying the groundwork for today’s AI boom.

“[Geoffrey Hinton] pioneered the efforts to establish deep and dense neural networks,” said Ellen Moons, the chair of the Nobel physics committee, during her introductory remarks. “Such networks are effective in sorting and interpreting large amounts of data and self-improve based on the accuracy of the result.

“Today, artificial neural networks are powerful tools in research fields spanning physics, chemistry and medicine, as well as in daily life.”

In fact, the three winners of the 2024 Nobel Prize in Chemistry – who were seated to Hinton’s left – drew heavily on AI for their work in predicting protein structures and computational design of proteins.

91�Թ� President Meric Gertler snapped this photo of the Nobel laureates from his seat in the concert hall (photo by Meric Gertler)

Back in Toronto, members of the 91�Թ� community gathered at watch parties on all three campuses to take in the livestream of the awards ceremony – a historic moment for the university.

On the St. George campus, more than one hundred gathered to watch and cheer in the main lobby of the Schwartz Reisman Innovation Campus – home to 91�Թ�’s Schwartz Reisman Institute for Technology and Society and the Vector Institute for Artificial Intelligence, where Hinton serves as an advisory board member and chief scientific adviser, respectively.

Among the gathered audience was Michael Guerzhoy, an assistant professor, teaching stream, of engineering science and mechanical and industrial engineering in the Faculty of Applied Science & Engineering who took Hinton’s course on neural networks and machine learning in 2005 – before going on to teach the same course himself several years later.

“I think we all feel an enormous amount of pride in the fact that this is one of the places where modern machine learning was really born, in large part due to Geoff Hinton,” Guerzhoy said. “I think a lot of us owe a personal debt of gratitude to him.”

91�Թ� community members gather in the lobby of the Schwartz Reisman Innovation Campus to watch the ceremony (photo by Matt Hintsa)

Fourth-year undergraduate student James Wang said he was “in awe” as he watched Hinton receive his Nobel Prize.

“It makes you feel inspired. You want to be like him, you want to attain the highest level of achievement that anybody can achieve – and not just to do it for your sake, but also for the academic community at large,” Wang said.

There were similar expressions of pride and jubilation at 91�Թ� Mississauga, where community members congregated to watch the livestream in the atrium of the Communication Culture & Technology Building, and at 91�Թ� Scarborough, where a watch party was organized in the Meeting Place.

As per tradition, the awarding of the Nobel Prize medal and diploma took place on Dec. 10, the anniversary of the death of Alfred Nobel who, in his 1885 will, bequeathed his fortune to create the award.

Attendees at 91�Թ� Scarborough's Nobel watch party hold up signs (photo by Sobica Vinayagamoorthy)

The gold medal for the Nobel Prize in Physics depicts nature in the form of a goddess resembling Isis, her face covered by a veil held up by the Genius of Science. Inscribed are the Latin words, “Inventas vitam iuvat excoluisse per artes,”which are translated to: “It is beneficial to have improved (human) life through discovered arts.”

The Nobel diploma is crafted on handmade paper and bound in a dark blue leather cover.

The Nobel Prize diploma features a unique work of art, with the design decided by the prize-awarding bodies (© Nobel Prize Outreach. Photo: Dan Lepp Artist: Lars Eje Larsson Calligrapher: Marie A. Györi Book binder: Leonard Gustafssons Bokbinderi AB )

Later in the evening, Hinton joined his fellow Nobel laureates, their families, friends and dignitaries for a banquet at Stockholm City Hall.

In an interview with Swedish national broadcaster SVT on the sidelines of the event, Hinton said it was “very exciting but also very exhausting” to take part in the day’s Nobel events.

Reflecting on his upbringing and career, Hinton said his school years – raised as an atheist who went to a Christian school – helped prepare him for his early years as a cognitive scientist working in the then-peripheral area of artificial intelligence.

“From a young age, I was surrounded at school, everybody else had a different opinion and I thought they were wrong – that was very useful when I was studying neural nets,” Hinton said.

“For many, many years, there were only a few of us who believed in neural nets. Everybody else said this was a ridiculous thing to study. And it turned out we were right.”

– with files from Adam Elliot Segal

President Meric Gertler highlights 91�Թ� community's achievements in holiday message

Christopher.Sorensen — Tue, 10 Dec 2024 14:35:13 +0000

President Meric Gertler highlights 91�Թ� community's achievements in holiday message Christopher.Sorensen Tue, 12/10/2024 - 09:35

Topic

Subheadline

“To all our students, faculty, librarians, staff, alumni, volunteers, supporters and partners: Thank you for your contributions to our success”

The 91�Թ� community had a lot to celebrate over the past year, 91�Թ� President Meric Gertler says.

In his annual holiday message, President Gertler highlighted 91�Թ�’s top spot in the QS sustainability rankings, University Professor Emeritus Geoffrey Hinton’s Nobel Prize in Physics and two students who were recognized with prestigious Rhodes Scholarships.

And that was just the beginning.

“We completed state-of-the-art landscapes and buildings on each of our three campuses,” he says in a video. “We broke new ground for several more. We made progress in the ongoing work of reconciliation. And we opened a new chapter in our history with the installation of our 35th chancellor.”

Most importantly, he adds, more than 20,000 students graduated with 91�Թ� degrees, joining a global community of more than 700,000 alumni.

“To all our students, faculty, librarians, staff, alumni, volunteers, supporters and partners: Thank you for your contributions to our success.”

91�Թ�’s Geoffrey Hinton delivers Nobel lecture alongside co-laureate

Christopher.Sorensen — Mon, 09 Dec 2024 20:48:27 +0000

91�Թ�’s Geoffrey Hinton delivers Nobel lecture alongside co-laureate

Christopher.Sorensen Mon, 12/09/2024 - 15:48

Cutline

91�Թ�'s Geoffrey Hinton, left, and John J. Hopfield of Princeton University, right, who share the 2024 Nobel Prize in Physics, shake hands after their Nobel lectures in Stockholm (photo by Pontus Lundahl/TT News Agency/AFP via Getty Images)

Topic

Schwartz Reisman Institute for Technology and Society

Leah Cowen

Faculty of Applied Science & Engineering

Subheadline

In Stockholm for a series of Nobel Week events, the “godfather of AI” will officially accept his Nobel Prize in Physics at a ceremony on Dec. 10

The 91�Թ�’s Geoffrey Hinton took to the stage at the Swedish Academy in Stockholm this weekend – two days before he officially accepts his Nobel Prize in Physics for fundamental work in AI – to deliver a lecture on the inventions and discoveries that led to him being given the prestigious award.

“Today, I’m going to do something very foolish – I’m going to try and describe a complicated technical idea for a general audience, without using any equations,” said Hinton, a 91�Թ� University Professor emeritus of computer science, prompting laughter from the audience.

The “godfather of AI” then proceeded to outline how decades of his fundamental research, and that of his co-laureate John J. Hopfield of Princeton University, enabled the development of artificial neural networks and machine learning – technologies that underpin today’s AI revolution.

The Nobel lectures are among the highlights of Nobel Week, which runs from Dec. 6-12 in Stockholm and Oslo and includes award ceremonies, banquets, media engagements and commemorations at the Nobel Museum. There is also a series of Nobel Week events taking place at 91�Թ�, including watch parties on all three campuses for the livestream of the Dec. 10 award ceremony.

Sunday’s first Nobel Prize lecture in physics was delivered by Hopfield, who shared how his fascination with the workings of the human brain inspired his development of the Hopfield network – an associative memory that can store and reconstruct patterns in data.

“How mind emerges from brain is, to me, the deepest question posed by our humanity,” Hopfield said.

When it was Hinton’s turn to take the stage, he described how he and Terry Sejnowski – one of Hopfield’s students – came upon a novel use of Hopfield nets: “Instead of using them to store memories, we could use them to construct interpretations of sensory input,” Hinton said.

He then went on to discuss the resulting Boltzmann machine, a type of neural network that is capable of recognizing elements within data.

Hinton discusses the significance of the Boltzmann machine (photo by 91�Թ� staff)

Yet, despite its promise, the original Boltzmann machine was too slow, Hinton said, and it wasn’t until several years later that he came up with “restricted Boltzmann machines,” which impose limitations on connections between neurons in order to increase system efficiency – a development that would prove pivotal in training deep neural networks (Hinton donated an early Boltzmann chip, about the size of a postage stamp, to the Nobel Prize Museum).

Following the lecture, Hinton was joined on stage by Hopfield, with the pair sharing a vigorous handshake and posing for photos.

91�Թ� brought together a panel of experts in Stockholm to discuss AI research and development (photo by Jonas Borg)

Separately, 91�Թ� convened an expert panel in Stockholm on Monday about the direction of AI research and development.

Moderated by Leah Cowen, 91�Թ�’s vice-president, research and innovation, and strategic initiatives, the panel included: Eyal de Lara, a professor and chair of the department of computer science in 91�Թ�’s Faculty of Arts & Science; David Lie, director of the Schwartz Reisman Institute for Technology and Society and a professor in the Edward S. Rogers Sr. department of electrical and computer engineering in the Faculty of Applied Science & Engineering; Tony Gaffney, president and CEO of the Vector Institute for Artificial Intelligence; and Amy Loutfi, professor of computer science and pro-vice-chancellor for AI at Örebro University in Sweden.

The conversation touched on areas including the promising applications of AI, how responsible deployment of AI can mitigate the technology’s potential pitfalls and implications of AI’s rise on education.

91�Թ� President Meric Gertler said that the AI breakthroughs fostered by Hinton’s research were made possible by Canada’s longstanding support of basic research.

“Geoff was interested in the novel but unproven concept of artificial neural networks, an area that was sometimes described as the ‘unpromising backwater’ of AI research,” President Gertler said in his remarks introducing the panel, noting that Hinton joined 91�Թ� in 1987 and was one of the first scholars to receive support from the Canadian Institute for Advanced Research (CIFAR).

“Canada was investing in brilliant people, their ideas and their students – and those investments have paid off many years later.”

Canada was also the first country to launch a national AI roadmap, President Gertler said, in the form of the Pan-Canadian Artificial Intelligence Strategy – which funds three national AI institutes including the Vector Institute for Artificial Intelligence, which is now housed in 91�Թ�’s new Schwartz Reisman Innovation Campus. The state-of-the-art building also hosts the Schwartz Reisman Institute for Technology and Society, which is at the forefront of research and thought leadership on AI safety and responsible development, with Hinton one of its advisory board members.

“In short, Canada has played a key role in launching and driving the AI revolution and we’re a world leader in understanding and promoting safe, human-centred AI,” President Gertler said.

The theme of responsible AI was also brought up during a Q-and-A with Hinton, who revealed that the remarkable information-sharing abilities of large language models played a big role in sparking his now oft-repeated concerns around the current pace of the technology’s development.

“That’s when I came to realize that the fact that they’re so much better at sharing probably means that digital intelligence is just a better form of intelligence than us – and that’s what got me so worried,” he said.

Asked what responsible AI regulation looks like, Hinton said there must first be a consensus around solving the problem from a scientific standpoint – not unlike the scientific consensus that has emerged around climate change.

“Like the early days of climate change, the first thing to do is figure out what’s causing it and get scientific agreement on how you can fix it. Then, the second thing to do is get the politicians to do something about it … but here, we haven’t finished the first thing yet.”

Geoffrey Hinton shares 2024 VinFuture Grand Prize for work on deep learning

Christopher.Sorensen — Fri, 06 Dec 2024 19:32:41 +0000

Geoffrey Hinton shares 2024 VinFuture Grand Prize for work on deep learning

Christopher.Sorensen Fri, 12/06/2024 - 14:32

Cutline

(photo by Johnny Guatto)

Topic

Schwartz Reisman Institute for Technology and Society

Leah Cowen

Awards

Vector Institute

Subheadline

Known as the "godfather of AI," Hinton was one of five people honoured with the US$3-million prize awarded by Vietnam's VinFuture Foundation

Geoffrey Hinton, University Professor emeritus of computer science at the 91�Թ� and winner of the 2024 Nobel Prize in Physics, has added another prestigious award to his collection: the 2024 VinFuture Grand Prize.

The US$3-million prize, awarded by the not-for-profit VinFuture Foundation in Vietnam, recognizes seminal scientific advancements that are improving the quality of human life and forging a more equitable and sustainable world.

Hinton, known as the “godfather of AI,” shares the prize with Yoshua Bengio, Jen-Hsun (Jensen) Huang, Yann LeCun and Fei-Fei Li. The five are honoured for their contributions to the development and adoption of deep learning, which is revolutionizing fields ranging from biomedical research and transportation to manufacturing, clean energy and agriculture.

“The 91�Թ� couldn’t be more proud of University Professor Emeritus Geoff Hinton,” said Leah Cowen, 91�Թ�’s vice-president, research and innovation, and strategic initiatives. “When Geoff arrived at 91�Թ� nearly 40 years ago, his research into neural networks – influenced by his ideas about how the brain learns – was considered an AI backwater, if it was considered at all.

“Fast-forward to today, and his seminal work is transforming our world in ways that we’ve only begun to grasp. This award is a testament to the power of curiosity-driven research – and the impact of investing in brilliant, curious researchers.”

The VinFuture Foundation noted that Hinton and Bengio – a professor at the Université de Montréal – were awarded the prize for their research on neural networks and deep learning algorithms. LeCun, the chief AI scientist for Facebook AI Research who was one of Hinton’s post-doctoral students at 91�Թ� in the1980s, was recognized for helping develop convolutional neural networks for computer vision. Huang, the co-founder and CEO of NVIDIA, was recognized for his work on computational architectures for deep learning and accelerated computing, while Li, a professor at Stanford University, was celebrated for contributions to computer vision and large-scale image recognition.

In a video message, Hinton, an adviser at 91�Թ�’s Schwartz Reisman Institute for Technology and Society who is also co-founder and chief scientific adviser at the Vector Institute for Artificial Intelligence in Toronto, said he was honoured to share the award with such an esteemed group of researchers – including his fellow A.M Turing Award-winners Bengio and LeCun.

“The three of us spent our whole lives developing the technology of neural networks,” Hinton said in remarks that noted the collective nature of the achievement.

“I’m very happy to see that the VinFuture Prize recognizes the contributions of Jensen Huang in developing the kind of compute and software required for artificial intelligence, and Fei-Fei Li in providing the big data that was needed to prove that it worked.”

Now in its fourth year, the VinFuture Prize was created with the goal of celebrating scientific and technological innovations that are aligned with the United Nations’ 17 Sustainable Development Goals, which include poverty alleviation, renewable energy, ending hunger and improving health.

Friday’s award ceremony was attended by Vietnam’s Prime Minister Pham Minh Chinh and distinguished leaders, scientists and diplomats from around the world. It was broadcast live on Vietnamese television and streamed online.

“It’s terrific to see this recognition of Geoff’s extraordinary work and its potential to help address some of the world’s greatest challenges,” said Cowen. “Researchers around the globe – including a number of his former students – are using AI to help solve some of the most pressing challenges of our time in areas such as health care, sustainability and climate change.”

The prize comes as Hinton prepares to officially accept his Nobel Prize in Physics in Sweden on Dec. 10. He shared the Nobel with John J. Hopfield of Princeton University for foundational discoveries and inventions that enable machine learning with artificial neural networks.

Hinton, who joined 91�Թ� in 1987 after working in universities in the U.K. and U.S., has said that he plans to leverage his growing fame to spread awareness of the dangers of unchecked AI development – a warning he first shared after leaving a research position at Google in early 2023.

As his public stature grows, ‘Godfather of AI’ Geoffrey Hinton heads to Stockholm to accept his Nobel Prize

lanthierj — Wed, 04 Dec 2024 17:56:55 +0000

As his public stature grows, ‘Godfather of AI’ Geoffrey Hinton heads to Stockholm to accept his Nobel Prize

lanthierj Wed, 12/04/2024 - 12:56

Cutline

University Professor Emeritus Geoffrey Hinton will receive the 2024 Nobel Prize in Physics on Dec. 10 (photo by Johnny Guatto)

Chris Sorensen

Topic

“Godfather of AI” Geoffrey Hinton was already on his way to becoming a household name when he won the 2024 Nobel Prize in Physics for foundational work leading to today’s artificial intelligence boom.

Two months later, his celebrity has hit a whole new level.

The University Professor emeritus at the 91�Թ� says he now gets recognized on the street and that strangers regularly ask him for selfies. On a recent flight to Toronto, one flight attendant even grabbed the intercom to announce his presence on the plane. That’s in addition to a torrent of requests to speak to media, appear on podcasts and read academic papers.

As he prepares to travel to Stockholm on Dec. 10 to officially accept the honour alongside co-winner John J. Hopfield of Princeton University – which will be celebrated via watch parties and other “Nobel Week” events at 91�Թ� – Hinton says he plans to put his growing fame to good use.

“It will be useful when I talk about AI risks,” he says, referring to the warning bell he began sounding in 2023 about the potential existential threat posed by rapid and unchecked AI development.

“It will make people take me more seriously.”

For example, he was recently invited to be part of a webinar with Nobel Peace Prize laureates on whether AI should be used to decide if and when to launch nuclear weapons – a foreboding new twist on a Cold War-era threat that has preoccupied fellow 91�Թ� Nobel laureate John Polanyi, a University Professor emeritus of chemistry.

“I think it’s a bad idea,” Hinton says for the record.

Yet, as scary as such a scenario is to contemplate, Hinton has focused on what he considers an equally grave threat to humanity: the moment when machine intelligence surpasses that of our own.

That’s why he’s called on governments to develop regulations to guide AI development and deployment. It’s also why he’s urging companies to devote more funding to AI safety research as they rush to explore the myriad ways the technology can be used to make our lives better – from finding cures for deadly diseases to discovering new materials to help combat climate change.

At 91�Թ�, Hinton has also taken on an advisory role at the Schwartz Reisman Institute of Technology and Society, where researchers are at the forefront of exploring AI safety and other issues around the adoption of new technologies. In particular, he highlights the work of Roger Grosse and David Duvenaud – both AI safety experts who are associate professors in the department of computer science in the Faculty of Arts & Science and Schwartz Reisman Chairs in Technology and Society (he says Grosse convinced him to go public with his concerns last year after he left a senior research position at Google).

The institute and 91�Թ� more broadly have an opportunity to become a world leader in figuring out how to guard against AI threats, he says. “I think that can be a world-class centre for figuring out whether there’s a way to make a superintelligence – which we all think is coming – not want to take control.”

Hinton’s moment in the spotlight has been a long time coming – and is testament to his curious mind, persistent nature and willingness to go against the grain.

As a child attending a “mildly Christian school” in England, he says he often felt like an outsider because he refused to accept the idea of a god without evidence (he remains an atheist). Decades later, Hinton again found himself on the fringe as he and a handful of researchers, including the Salk Institute for Biological Science’s Terry Sejnowsky, who did his PhD research under Hopfield, explored the idea that the human brain was essentially a bunch of connection strengths between neurons – not a series of logical expressions, as many in the field then believed.

That key insight now forms the basis of today neural nets.

“There were many times when I could easily have given up and sort of joined the mainstream,” Hinton says. “But I think my experience as a child made me far more resistant to that.”

A self-described cognitive scientist who works in the field of computer science, Hinton says he was surprised to win a Nobel Prize in Physics. But the Nobel committee noted he used ideas from physics to create the Boltzmann machine, which can be used to recognize elements in data. The Boltzmann machine, in turn, was based on the Hopfield network, which was invented by his co-laureate.

(photo by Johnny Guatto)

Hinton is donating an early Boltzmann chip, about the size of a postage stamp, to the Nobel Prize Museum – and has decided to use the money from his win to set up a prize for young researchers at the annual Conference on Neural Information Processing Systems. He has also donated to a Canadian charity that supports works with Indigenous communities to address water challenges, and has plans to give to another that supports neurodiverse young adults.

For young researchers hoping to follow in his footsteps? Hinton advises: focus on a problem that really excites you, don’t become swayed by conventional thinking, persevere until you know you’re wrong – and feel free to wander between different research disciplines.

“If you're really interested in chasing a criminal, you don't stop at a state border,” he says. “That's a stupid thing to do – so, the boundaries of fields, you just ignore them.”

From AI to Atari: What it's like to work with Nobel Prize-winner Geoffrey Hinton

mattimar — Fri, 25 Oct 2024 14:13:56 +0000

From AI to Atari: What it's like to work with Nobel Prize-winner Geoffrey Hinton

mattimar Fri, 10/25/2024 - 10:13

Cutline

From left: Chris Maddison, Nick Frosst and Kevin Swersky at a recent event celebrating 91�Թ� University Professor Emeritus Geoffrey Hinton's 2024 Nobel Prize in Physics (photo by Johnny Guatto)

Mariam Matti

Topic

Alumni

Statistical Sciences

Subheadline

Three former students who worked with the "godfather of AI" recall his passionate and playful approach to research

In the wake of Geoffrey Hinton’s 2024 Nobel Prize in Physics, former students and colleagues from the 91�Թ� are sharing their favourite anecdotes about the “godfather of AI” – including one involving the classic Atari video game Asteroids.

Nick Frosst (photo by Nina Haikara)

Nick Frosst, a 91�Թ� alumnus and co-founder of generative AI startup Cohere, said Hinton, University Professor Emeritus of computer science, once spoke of an intense, button-mashing session that left him with nerve damage.

“This kind of explains, perhaps, the way in which he types, which is still two fingers at a time,” said Frosst, who began working with Hinton as a 91�Թ� undergraduate student and was his first employee at Google Brain.

He shared the story at a recent event hosted by the department of computer science in the Faculty of Arts & Science, saying it offered a telling glimpse into Hinton’s character.

“It’s that fever-pitched intensity, passion and playfulness that he brings to everything … He found something that was fun and engaging and he played it until it damaged a finger and then he continued to push for it.”

Frosst said he also appreciates Hinton’s thoughtful consideration about the potential negative consequences of the revolutionary technology he helped create and praised him for looking past formal qualifications to spot potential and creativity.

“I don't have a master's degree or a PhD, but he was willing to work with me and I saw that in the types of people he brought into Google Brain to work with him,” Frosst said.

“He took lots of chances on people and gave them the time of day once they were there. And for that, I'll always be thankful and deeply privileged, and honoured, to have him in my life.”

Other former students at 91�Թ� tell similar stories.

Chris Maddison (supplied image)

Chris Maddison, now an assistant professor in 91�Թ�’s departments of computer science and statistical sciences in the Faculty of Arts & Science, was also an undergraduate student when he started working with Hinton in 2011.

He also painted a picture of Hinton’s vibrant office – where everyone knew when he had a new idea.

“The excitement, the joy radiated out of his office down the hall. The air was buzzing with possibility,” said Maddison. “He was famous for bursting into a room and pronouncing that, he now finally, after all these years, understood how the brain worked.”

Kevin Swersky (photo by Johnny Guatto)

Kevin Swersky, a research scientist at Google DeepMind, worked with Hinton as a graduate student at 91�Թ� and similarly described visiting Hinton as a memorable academic experience.

“Normally when you go to a supervisor's office, you give them a progress update. You go through what your latest results are, you talk about a couple of your ideas and you get some feedback,” he said.

“Going to Geoff’s office was a completely different story. He would be telling you what his latest idea was. He would show you his latest results. And his whole thing was just that he was really excited about it, and his hope was to inspire you enough to start running with it.”

He added that he was particularly inspired by Hinton’s focus on small, solvable puzzles that would ultimately lead to significant breakthroughs over time.

“Geoff would think completely intuitively – like the universe was a puzzle and he was just kind of figuring out where all the pieces went, and the math would always follow whatever he was talking about,” he said.

He also remarked on Hinton’s kindness.

“He offered to put me up for a few weeks,” he said of a time when he found himself looking for a place to stay in Toronto. “He offered to go and get dishes. I was thinking to myself, ‘Wow, Geoff Hinton wants to go out shopping for dishes for me so that I can be comfortable for a few weeks.’”

Geoffrey Hinton shakes hand at a recent 91�Թ� event celebrating his Nobel Prize (photo by Mac Pattanasuttinont)

Frosst, too, has a Hinton home-making story: the AI luminary built him a desk from scratch.

“He's a carpenter,” Frosst said. “It’s a small wooden desk that fits in the corner of my room at home.

“That's where I keep my computer and work from.”

‘One of the great minds of the 21st century’: 91�Թ� celebrates Geoffrey Hinton’s Nobel Prize

rahul.kalvapalle — Thu, 17 Oct 2024 17:24:21 +0000

‘One of the great minds of the 21st century’: 91�Թ� celebrates Geoffrey Hinton’s Nobel Prize

rahul.kalvapalle Thu, 10/17/2024 - 13:24

Cutline

University Professor Emeritus Geoffrey Hinton, who won the 2024 Nobel Prize in Physics, attends a celebration event held at the Schwartz Reisman Innovation Campus (photo by Mac Pattanasuttinont)

Topic

Schwartz Reisman Innovation Campus

Leah Cowen

Wesley Hall

Schwartz Reisman Institute for Technology and Society

CIFAR

Faculty of Applied Science & Engineering

Subheadline

The 2024 co-winner of the Nobel Prize in Physics - known to many as the "godfather of AI" - was honoured at an event attended by a who's who of the Toronto research community

There were standing ovations, peals of laughter and even a few tears as the 91�Թ� welcomed Geoffrey Hinton back to campus after he won the 2024 Nobel Prize in Physics.

A University Professor Emeritus of computer science, Hinton traded the “cheap hotel room in California,” where he received the life-changing news, for an emotional reception in the Schwartz Reisman Innovation Campus’s airy event hall.

The Oct. 10 event drew 91�Թ� leaders, supporters, dignitaries and other luminaries. They included Deputy Prime Minister Chrystia Freeland, University Professor Emeritus John Polanyi, who won the Nobel Prize in Chemistry in 1986, and Massey College Principal James Orbinski, who accepted the Nobel Peace Prize on behalf of Doctors Without Borders in 1999.

Several of Hinton’s many collaborators and proteges also attended the event – not to mention students who were simply eager to catch a glimpse of the “godfather of AI.”

Hinton chats with 91�Թ� Scarborough Professor David Fleet and Google Research Scientists Sara Sabour and Daniel Watson (photo by Johnny Guatto)

Though sleep deprived, Hinton regaled the audience with fond recollections of his early years as an AI researcher, snapshots of his trademark dry humour and warm expressions of gratitude for mentors, collaborators and, of course, his many students.

“I’ve been blessed to have brilliant graduate students and post-docs,” Hinton said.

“I had a principle when selecting graduate students: ‘If they’re not smarter than me, what’s the point?’ And I’ve had quite a number of graduate students who were smarter than me.

“They did things I wouldn’t have been able to do, so I’d like to thank them.”

He said two figures in particular played a huge role in the work that led to his Nobel Prize, which he shared with Princeton University’s John J. Hopfield. The first was Terry Sejnowsky, a computational neuroscientist and former student of Hopfield’s, who worked with Hinton on Boltzmann machines – a period Hinton described as “the most happy research time of my life.”

He also praised the contributions of the late David Rumelhart, a psychologist at Stanford University, who worked with him to develop backpropagation algorithms, a key breakthrough.

“[He] should have won the Nobel Prize,” Hinton said. “But unfortunately, Dave got a horrible brain disease and he died quite young.” (The Nobel organization doesn’t award the honour posthumously).

Hinton poses for a picture with Assistant Professor Chris Maddison, who was one of the last graduate students Hinton supervised (photo by Mac Pattanasuttinont)

Chris Maddison joined Hinton’s research group as an undergraduate and was one of the last students he supervised. Now an assistant professor in 91�Թ�’s departments of computer science and statistical sciences in the Faculty of Arts & Science, Maddison lauded Hinton as “a steadfast mentor and supporter who saw strength in me that I didn’t see” and said one of his greatest attributes was his sheer enthusiasm.

“No matter what’s going on, you can find him in the lab on Sundays at 8 p.m. playing with his MATLAB scripts like a child playing with Legos,” Maddison said. “He never lost that child-like sense of wonder that buoyed him and the group.”

91�Թ� President Meric Gertler said, via video message from Indonesia, where he was on university business, that Hinton is “one of the great minds of the 21st century” (photo by Johnny Guatto)

91�Թ� President Meric Gertler, who was in Indonesia on university business when the prize was announced, hailed Hinton in a video message as “one of the great minds of the 21st century” and someone who “literally created new ways of thinking about thinking and learning.”

He noted that Hinton’s AI leadership extends to the pressing question of responsible and safe development of the technology.

“With his Nobel win, he’s now perfectly positioned to amplify this concern on a world stage.” President Gertler said.

Hinton shares a laugh with University Professor Molly Shoichet of the Faculty of Applied Science & Engineering (photo by Johnny Guatto)

The event’s guest list served as a reminder of Hinton’s outsized influence on the research community in Toronto and beyond, drawing key figures from: the Vector Institute, where Hinton is co-founder and chief scientific adviser; the Schwartz Reisman Institute of Technology and Society, where he sits on the advisory board; and CIFAR (Canadian Institute for Advanced Research), where Hinton is an adviser and longtime fellow.

Hinton poses for a photo with Leah Cowen, 91�Թ�’s vice-president, research and innovation, and strategic initiatives (photo by Johnny Guatto)

Leah Cowen, 91�Թ�’s vice-president, research and innovation, and strategic initiatives, reminded the accomplished audience that Hinton’s historic achievement – both the Nobel Prize and the AI revolution he helped spark – was the result of years toiling in an “unpromising backwater” of AI research.

“It is tempting to think that it happened almost overnight, but it didn’t,” Cowen said.

University Professors Emeriti – and fellow Nobel Prize-winners – Geoffrey Hinton and John Polanyi have their photo taken together (photo by Johnny Guatto)

Hinton took time to reflect on periods of personal struggle and tragedy – and thank those who helped him in his hour of need.

When his wife had an incurable form of cancer, he recalled how 91�Թ� President Emeritus David Naylor, a physician, medical researcher and former dean of the Temerty Faculty of Medicine, carried out research on a possible alternative treatment that was being explored – incorporating input from top medical experts – and presented him with a report of his findings.

“He’s a tremendous human being,” Hinton said of Naylor, who was in the audience.

Hinton shares a moment with 91�Թ� President Emeritus David Naylor (photo by Johnny Guatto)

Hinton also recalled how, when his first wife became ill in 1993 – also with cancer – his post-doctoral trainee Peter Dayan, now a director at the Max Planck Institute for Biological Cybernetics, stepped in to advise Hinton’s graduate students, giving him time to care for his ailing spouse.

“At times like this, you remember the people who helped you most when things were very difficult,” Hinton said.

He later pointed out that Dayan went on to supervise one of this year’s winners of the Nobel Prize in Chemistry, Demis Hassabis, joking that this made Dayan “the meat in a Nobel sandwich.”

Deputy Prime Minister Chrystia Freeland said Canada was lucky to have Hinton, who was born in the U.K., and thanked his daughter for sharing her father with the country, with science and the world (photo by Johnny Guatto)

For Minister Freeland, Hinton’s award showcased the value of ideas and of fundamental research. She said Hinton’s Nobel Prize sent waves of pride across Canada, which she said was “lucky as a country” that Hinton arrived on its shores back in 1987.

“Geoff shows that you can be a really brilliant intellectual and also a really great human being who cares about his community and his country,” Freeland said. “I am constantly struck by how Geoff thinks about the bigger implications of his ideas and how Geoff thinks about really wanting to make Canada and the world a better place.”

Hinton chats with Melanie Woodin, dean of the Faculty of Arts & Science, who thanked him for his friendship and mentorship – and his dedication to science and scholarship (photo by Johnny Guatto)

Following the program – which also featured remarks by 91�Թ� Chancellor Wes Hall, Faculty of Arts & Science Dean Melanie Woodin and Christine Szustaczek, 91�Թ�’s vice-president, communications – Hinton mingled with members of the audience, shook hands with students and caught up with former colleagues and trainees.

Clockwise from top left: Christine Szustaczek, Wes Hall, Chris Maddison, Leah Cowen, Geoffrey Hinton and Melanie Woodin (photo by Johnny Guatto)

Brendan Frey, professor in the Faculty of Applied Science & Engineering and CEO of AI-powered therapeutics startup Deep Genomics, said he was one of many who earned his PhD under Hinton’s supervision.

“I think of Geoff as the father of a community that includes myself, other graduate students and all the people who didn’t believe but then came to believe – and he inspired all of us,” said Frey, who shared a hug with his former supervisor following the event.

“I’m really happy for him.”

In his words: Geoffrey Hinton reflects on his Nobel Prize win

rahul.kalvapalle — Thu, 10 Oct 2024 16:26:59 +0000

In his words: Geoffrey Hinton reflects on his Nobel Prize win

rahul.kalvapalle Thu, 10/10/2024 - 12:26

Cutline

Geoffrey Hinton, University Professor Emeritus of computer science at the 91�Թ� and winner of the 2024 Nobel Prize in Physics, takes questions during a virtual press conference hosted by 91�Թ� (image via YouTube)

Topic

Global

President Meric Gertler

Subheadline

"If you believe in something, don’t give up on it until you understand why that belief is wrong"

Empower curiosity-driven research. Follow your convictions. Think not just about how to advance technology, but how to direct its use for good.

These were among the key messages delivered by Geoffrey Hinton, University Professor Emeritus of computer science at the 91�Թ� and winner of the 2024 Nobel Prize in Physics, during an Oct. 8 press conference held by the university to mark his historic award.

Widely regarded as “the godfather of AI,” Hinton was named a co-winner of the prize – alongside John J. Hopfield of Princeton University – for his work on Boltzmann machines and artificial neural networks, which laid the groundwork for advancements in AI and stimulated new research directions in physics.

91�Թ� President Meric Gertler hailed Hinton for having “a profound impact on multiple fields and disciplines,” crediting “his leadership and exemplary mentorship of young scholars” with helping 91�Թ� become a global leader in AI and machine learning.

“I think one cannot overstate the impact of a win like this on the ability of Canada, Toronto and the 91�Թ� to be able to welcome talented newcomers, great students and wonderful faculty from across the country and around the world because of the recognition that arises with Geoff’s win,” President Gertler said.

For his part, Hinton echoed his remarks from earlier in the day that he was “flabbergasted” to receive the prize and pleased that the Nobel committee recognized the advancements in artificial neural networks.

He also answered questions about his influences, legacy and how it feels to go from being an obscure researcher who toiled in a largely forsaken field to a Nobel Laureate – and his advice for researchers who hope to one day follow in his footsteps.

Here are five key themes that emerged from Hinton's news conference:

His legacy

“I’m hoping AI will lead to tremendous benefits, to tremendous increases in productivity and to a better life for everybody. I’m convinced that it will do that in health care.

“My worry is that it may also lead to bad things, and in particular, when we get things more intelligent than ourselves, no one really knows whether we’re going to be able to control them.

“We don’t know how to avoid [catastrophic AI scenarios] at present. That’s why we urgently need more research. So I’m advocating that our best young researchers, or many of them, should work on AI safety and governments should force large companies to provide the computational facilities they need to do that.”

A collaborative effort

“I think of the prize as a recognition of a large community of people who worked on artificial neural networks for many years.

“I’d particularly like to acknowledge my two main mentors: David Rumelhart, with whom I worked on the backpropagation algorithm … and my colleague Terry Sejnowsky, who I worked with a lot in the 1980s on Boltzmann machines and who taught me a lot about the brain.

“I’d also like to acknowledge my students. I was particularly fortunate to have many clever students, much cleverer than me, who actually made things work. They’ve gone on to do great things.

“I should also acknowledge Yoshua Bengio and Yann LeCun who were close colleagues and very instrumental in developing this whole field.”

Canada’s research strengths

“I think the main thing about Canada as a place to do research is there isn’t as much money as there is in the U.S., but it uses its money quite wisely.

“In particular, the main funding council for this type of research, called NSERC, uses money for basic curiosity-driven research, and all of these advances in neural networks came out of basic curiosity-driven research – not out of throwing money at applied problems, but out of letting scientists follow their curiosity to try and understand things. And Canada’s quite good at that.”

Many thought he was wasting his time

“It was a lot of fun doing the research, but it was slightly annoying that many people – in fact, most people in the field of AI – said that neural networks would never work.

"They were very confident these things were a waste of time and we would never be able to learn complicated things – for example, understanding natural language – using neural networks. And they were wrong."

Believe in your ideas

"My message is this: if you believe in something, don’t give up on it until you understand why that belief is wrong.

"Often, you believe in things and you eventually figure out why that’s a wrong thing to believe in. But so long as you believe in something and you can’t see why that’s wrong – like, ‘the brain has to work somehow so we have to figure out how it learns the connection strengths to make it work’ – keep working on it and don’t let people tell you it’s nonsense if you can’t see why it’s nonsense."

‘Godfather of AI' Geoffrey Hinton’s Nobel Prize makes headlines around the world

Christopher.Sorensen — Wed, 09 Oct 2024 19:24:35 +0000

‘Godfather of AI' Geoffrey Hinton’s Nobel Prize makes headlines around the world

Christopher.Sorensen Wed, 10/09/2024 - 15:24

Cutline

(photo by Polina Teif)

Topic