News

The research puzzle of when humans and AI don’t see eye to eye

Francesco Croce will be working on robustness in multi-modal foundation models at ELLIS Institute Finland and Aalto University.

A sticker on a traffic sign can cause a self-driving car to crash. A few pixels of noise can make a neural network decide that an image of a dog actually shows a bird. These are just some examples of how AI systems can behave unreliably, displaying an inconsistency that is a bit hard for people to understand. “Why this happens is a mystery,” says Francesco Croce. “Features that are very important for humans are not important for models and vice versa, and why models solve tasks in odd ways is also a safety and a legal concern.”

A person wearing a light grey hoodie stands indoors with a brick wall and green plants in the background.
Francesco Croce. Photo by Matti Ahlgren/Aalto University

Croce has just joined and Aalto University to work on these problems of adversarial robustness: making machine learning outcomes stable in the face of strange inputs or even malicious attacks. He is also interested in how AI systems do or don’t align with human perception, for example, do they caption or classify images correctly. Croce was previously a postdoctoral fellow at the Swiss Federal Institute of Technology Lausanne (EPFL) and he is now a PS Fellow and assistant professor at Aalto.

Croce’s career so far has taken him from his native Italy, where he studied mathematics, to Germany for a PhD in machine learning and to London for an internship with Google DeepMind. “It’s lucky that I've been to several places where there were great researchers,” he says. Though ending up in Finland was a bit random, Croce admits, the establishment of the ELLIS Institute was a motivator to apply. “There’s a solid plan for working with AI research in Europe, the computing power of course, and they are building something that will hopefully last long and have an impact.”

At the ELLIS Institute, Croce is now set to recruit PhD students and postdocs who are interested in applying adversarial robustness to multi-modal models. He previously developed , and is now keen to extend the work to other domains like generative AI.

Students should actually enjoy the research process, says Croce—“not just writing papers and getting lines on your CV”. Creativity is also an important trait for researchers: “To imagine something that doesn’t exist yet and find the good questions, to understand what’s currently missing and what’s relevant to push things forward.”

Contact:

Read more:

Logo of ELLIS Institute Finland with a striped map of Europe above and multicoloured letters 'ellis'.

ELLIS Institute Finland welcomes 9 new professors as principal investigators and PS Fellows

Institute's first recruitment brings nine leading researchers to Finland

News
Group of people standing in a room holding a ribbon, with presentation screen and institute banner in the background.

New Fundamentals: ELLIS Institute Finland launches with bold scientific ambitions

AI and ML for transforming R&D, enhancing human-AI teamwork, and creating exciting new science

News
Logo of ELLIS Institute Finland with a striped map of Europe above and multicoloured letters 'ellis'.

ELLIS Institute Finland is a world-class research hub in AI and machine learning and part of the European Laboratory for Learning and Intelligent Systems (ELLIS).

  • Updated:
  • Published:
Share
URL copied!

Read more news

Assistant Professor Shaya Vosough
Appointments Published:

Meet Shaya Vosough, assistant professor of transportation engineering

Shaya Vosough seeks to understand our travel choices and how they are influenced.
Assistant Professor Sampsa Laakso
Appointments Published:

Meet Sampsa Laakso, assistant professor of manufacturing processes and systems

Assistant Professor Sampsa Laakso is an expert of virtual manufacturing.
A person wearing a white turtleneck top and dark trousers stands indoors with a blurred background.
Studies Published:

Turning bold digital ideas into real transformation with change management

Adapt or lose. The new Aalto University Summer School course Change Management for Digital Transformation equips you with all the tools for leading strategic digital change in organisations.
""
Studies, University Published:

Many new things at UniSport this spring - see what’s coming!

The new year at UniSport starts energetically and brings plenty of new offerings for Aalto University staff and students – including new group exercise classes on campuses, plans for the Viikki sports centre, a free challenge, and much more.