ºÚÁÏÍø

News

Where art meets math

Antti Oulasvirta’s work at Aalto University combines art, design, psychology and artificial intelligence—for entirely new ways of studying human-machine interaction.
Smart Art - Where art meets math
Photo: Aleksi Poutanen/Aalto University

‘Computers are capable of generating billions of pieces of art on their own, but it's humans who decide which ones stand out,’ says Antti Oulasvirta. ‘Without the social and cultural context to understand the semantics behind the art, the computer cannot decide which pixel or sound combinations are most relevant or interesting.’ 

‘But an essential aspect of art is the creative exploration of space and of possibilities,’ he continues. ‘And this is an area where AI can indeed help designers, because AI can propose ideas for us without overriding our thinking and our styles.’  
 
Oulasvirta is referring to a research project where his team looked at how machine-learning methods can support computer-aided creative design. The team developed a method for computers to learn an individual designer's preferences, and then make suggestions through an interactive gallery concept. â€˜When you're doing any creative activity, you have this issue of near and far ideation. Sometimes you want to drill deep, and sometimes you want to take a step back,’ he says. ‘So we've developed a machine learning algorithm—incidentally called a bandit system—that first recognizes your style as a designer, and then tries to detect if you're exploring or drilling in.’

Antti Oulasvirta
Photo: Jussi Särkilahti

Oulasvirta's team tested the concept on 16 professional designers who were all given the task of creating a realistic mood board. After completing the task, 14 of the 16 said they would choose to implement the software in their everyday work. 

‘One of the great features of the system is that it explains to the designer why it made a certain suggestion. You can ask the AI why it chose a specific colour, for instance, and it will explain its rationale,’ he says. ‘The system never overrides the designer though—it just makes suggestions to guide and steer in a way that makes the task easier."

Oulasvirta also works on keyboard design, and is currently finalising a project commissioned by the government of France to create a new standard for the French keyboard layout. With six types of quotation marks and approximately 190 special characters to consider, Oulasvirta approached the task as an optimization problem.

‘There were basically four things to consider: performance (the speed it takes to reach a specific character), ergonomics (how natural and easy it is for the hand), learnability (which means grouping characters that belong together), and familiarity (how similar it should be to the old keyboard),’ he says. 

His work covers behavioural analytics too, analysing browsing and clickstream data so that companies can optimize the web experience for their customers.

‘Here we use models that come from psychology and human-computer interaction, and use machine learning methods to fit them to data in the best possible way,’ he says. ‘We can use models of perception instead of an eye tracker to predict where eyes move on a site, and we can define places where visitors get lost without needing to ask them.’

More from this series

Smart Art - Machine learning imperfections in materials
Research & Art Published:

Making computer-generated images look just right

Machine learning imperfections in materials
Smart Art - Finland's Art and Craft School Robotti
Research & Art Published:

Rewiring art education

Käsityökoulu Robotti is an extra-curricular school for kids that is as much about having fun bending circuits as about learning by breaking boundaries.
Smart Art - Quantum Garden
Research & Art Published:

Quantum Garden uses sculpture to get the public to train AI

The sculpture gathers data sequences to help solve a quantum computing problem.
Smart Art - AI needs art
Research & Art Published:

AI’s story won’t be complete without art

Aalto’s Kasperi Mäki-Reinikka wants art and technology to collide and make something new
  • Updated:
  • Published:
Share
URL copied!

Read more news

Abstract structure of pale rods and rough wooden planks against a light blue background
Research & Art Published:

Pressed by the devil , shaped by the future

Curly birch shines in Aalto University’s Wood Studio’s fresh perspectives at the Craft Museum of Finland’s summer exhibition.
Group in black and gold costumes tosses silver balls in bright dance studio
Research & Art Published:

When atoms begin to dance – At Aalto University, metallurgy became choreography

On the Dance Metallurgy pilot course, copper ions were given movement and a face. When a metal essential to the green transition stepped onto the dance floor, chemical phenomena that often seem intimidating opened up in an entirely new way.
Three people hold yarn spools in front of large green textile machinery in a factory setting.
Cooperation, Research & Art, University Published:

Design at the start of the supply chain – Aalto University leads a major EU project to transform textile colouration practices

The EU Horizon-funded MELANGE project brings together design, technology and business to rethink colouration practices in the textile industry and accelerate the transition towards circular and sustainable textile systems.
Blue outlines of phones and tablets over black, white and pink marbled abstract background
Aalto Magazine, Research & Art Published:

Arsi Ikäheimonen’s doctoral research: Smartphone data could reveal early signs of depression

A phone in your pocket, a smart ring on your finger, and an activity tracker on your wrist: everyday devices collect information about their users almost continuously. This data can help monitor and predict symptoms of depression.