News

The research puzzle of when humans and AI don’t see eye to eye

Francesco Croce will be working on robustness in multi-modal foundation models at ELLIS Institute Finland and Aalto University.

A sticker on a traffic sign can cause a self-driving car to crash. A few pixels of noise can make a neural network decide that an image of a dog actually shows a bird. These are just some examples of how AI systems can behave unreliably, displaying an inconsistency that is a bit hard for people to understand. “Why this happens is a mystery,” says Francesco Croce. “Features that are very important for humans are not important for models and vice versa, and why models solve tasks in odd ways is also a safety and a legal concern.”

A person wearing a light grey hoodie stands indoors with a brick wall and green plants in the background.
Francesco Croce. Photo by Matti Ahlgren/Aalto University

Croce has just joined and Aalto University to work on these problems of adversarial robustness: making machine learning outcomes stable in the face of strange inputs or even malicious attacks. He is also interested in how AI systems do or don’t align with human perception, for example, do they caption or classify images correctly. Croce was previously a postdoctoral fellow at the Swiss Federal Institute of Technology Lausanne (EPFL) and he is now a PS Fellow and assistant professor at Aalto.

Croce’s career so far has taken him from his native Italy, where he studied mathematics, to Germany for a PhD in machine learning and to London for an internship with Google DeepMind. “It’s lucky that I've been to several places where there were great researchers,” he says. Though ending up in Finland was a bit random, Croce admits, the establishment of the ELLIS Institute was a motivator to apply. “There’s a solid plan for working with AI research in Europe, the computing power of course, and they are building something that will hopefully last long and have an impact.”

At the ELLIS Institute, Croce is now set to recruit PhD students and postdocs who are interested in applying adversarial robustness to multi-modal models. He previously developed , and is now keen to extend the work to other domains like generative AI.

Students should actually enjoy the research process, says Croce—“not just writing papers and getting lines on your CV”. Creativity is also an important trait for researchers: “To imagine something that doesn’t exist yet and find the good questions, to understand what’s currently missing and what’s relevant to push things forward.”

Contact:

Read more:

Logo of ELLIS Institute Finland with a striped map of Europe above and multicoloured letters 'ellis'.

ELLIS Institute Finland welcomes 9 new professors as principal investigators and PS Fellows

Institute's first recruitment brings nine leading researchers to Finland

News
Group of people standing in a room holding a ribbon, with presentation screen and institute banner in the background.

New Fundamentals: ELLIS Institute Finland launches with bold scientific ambitions

AI and ML for transforming R&D, enhancing human-AI teamwork, and creating exciting new science

News
Logo of ELLIS Institute Finland with a striped map of Europe above and multicoloured letters 'ellis'.

ELLIS Institute Finland is a world-class research hub in AI and machine learning and part of the European Laboratory for Learning and Intelligent Systems (ELLIS).

  • Updated:
  • Published:
Share
URL copied!

Read more news

Person in dark hoodie using a lit photo booth at a busy indoor event with people and stands in background
University Published:

Aalto University ranks 126th in the world in QS World University Rankings

Aalto performs best in the employment outcomes and sustainability indicators.
People with blurred faces sit at a table with cups, talking and clapping in a bright indoor event.
Studies, University Published:

Greater choice of language studies for students – four universities in the Helsinki Metropolitan Area open up language provision

Aalto University, The University of Helsinki, the University of the Arts Helsinki and Hanken School of Economics have launched a new network to promote language learning.
Group in black and gold costumes tosses silver balls in bright dance studio
Research & Art Published:

When atoms begin to dance – At Aalto University, metallurgy became choreography

On the Dance Metallurgy pilot course, copper ions were given movement and a face. When a metal essential to the green transition stepped onto the dance floor, chemical phenomena that often seem intimidating opened up in an entirely new way.
Man giving lecture on textile chemistry in tiered auditorium, students seated with laptops and notes
University Published:

Textile Chemistry Group Highlights advances in sustainable textile research at Summer Meeting

The Textile Chemistry Group at Aalto University held its annual Summer Meeting on Friday, June 12.