News

The research puzzle of when humans and AI don’t see eye to eye

Francesco Croce will be working on robustness in multi-modal foundation models at ELLIS Institute Finland and Aalto University.

A sticker on a traffic sign can cause a self-driving car to crash. A few pixels of noise can make a neural network decide that an image of a dog actually shows a bird. These are just some examples of how AI systems can behave unreliably, displaying an inconsistency that is a bit hard for people to understand. “Why this happens is a mystery,” says Francesco Croce. “Features that are very important for humans are not important for models and vice versa, and why models solve tasks in odd ways is also a safety and a legal concern.”

A person wearing a light grey hoodie stands indoors with a brick wall and green plants in the background.
Francesco Croce. Photo by Matti Ahlgren/Aalto University

Croce has just joined and Aalto University to work on these problems of adversarial robustness: making machine learning outcomes stable in the face of strange inputs or even malicious attacks. He is also interested in how AI systems do or don’t align with human perception, for example, do they caption or classify images correctly. Croce was previously a postdoctoral fellow at the Swiss Federal Institute of Technology Lausanne (EPFL) and he is now a PS Fellow and assistant professor at Aalto.

Croce’s career so far has taken him from his native Italy, where he studied mathematics, to Germany for a PhD in machine learning and to London for an internship with Google DeepMind. “It’s lucky that I've been to several places where there were great researchers,” he says. Though ending up in Finland was a bit random, Croce admits, the establishment of the ELLIS Institute was a motivator to apply. “There’s a solid plan for working with AI research in Europe, the computing power of course, and they are building something that will hopefully last long and have an impact.”

At the ELLIS Institute, Croce is now set to recruit PhD students and postdocs who are interested in applying adversarial robustness to multi-modal models. He previously developed , and is now keen to extend the work to other domains like generative AI.

Students should actually enjoy the research process, says Croce—“not just writing papers and getting lines on your CV”. Creativity is also an important trait for researchers: “To imagine something that doesn’t exist yet and find the good questions, to understand what’s currently missing and what’s relevant to push things forward.”

Contact:

Read more:

Logo of ELLIS Institute Finland with a striped map of Europe above and multicoloured letters 'ellis'.

ELLIS Institute Finland welcomes 9 new professors as principal investigators and PS Fellows

Institute's first recruitment brings nine leading researchers to Finland

News
Group of people standing in a room holding a ribbon, with presentation screen and institute banner in the background.

New Fundamentals: ELLIS Institute Finland launches with bold scientific ambitions

AI and ML for transforming R&D, enhancing human-AI teamwork, and creating exciting new science

News
Logo of ELLIS Institute Finland with a striped map of Europe above and multicoloured letters 'ellis'.

ELLIS Institute Finland is a world-class research hub in AI and machine learning and part of the European Laboratory for Learning and Intelligent Systems (ELLIS).

  • Updated:
  • Published:
Share
URL copied!

Read more news

A person wearing a black long-sleeved shirt sits in a modern office space, with blurred office background.
Appointments Published:

Assistant Professor Jiancheng Yang improves healthcare with AI

Yang is one of the nine newly recruited professors joining the ELLIS Institute Finland as principal investigators. 
Left: Daniela da Silva Fernandes, right: Robin Welsch.
Press releases Published:

AI use makes us overestimate our cognitive performance

New research warns we shouldn’t blindly trust Large Language Models with logical reasoning –– stopping at one prompt limits ChatGPT’s usefulness more than users realise.
Hitesh Monga wearing Tutor in Aalto University shirt and overalls, standing in front of a brick wall with metal artwork
Studies Published:

Hitesh Monga shaped his path in Aalto from a summer intern to a master’s graduate

Hitesh Monga, graduate from Communication Engineering master's major, shares the path that lead him and beyond
A crowded lecture hall with people sitting on dark grey seats, some wearing lanyards.
University Published:

XII Unite! Dialogue at Aalto University: A Week of Collaboration and Connection

Across meetings, social activities, and ceremonies, Uniters continued to strengthen the shared vision of Unite! and build sustainable collaborations.