New app to identify plants, animals and fungi

Hongyu Wang and Paul Schlumbom from University of Waikato developed the models and the software for the Aotearoa Species Classifier app.

Imagine being able to readily identify every plant, animal and bird in your garden, on a hike or when showing off our beautiful country to visiting family and friends.

A new app, developed by a group of New Zealand researchers can let you do just that.

Members of the TAIAO project at Waikato and Canterbury universities have used a data set of more than 1 million identified images to train Artificial Intelligence (AI) to identify Aotearoa's plants, animals and fungi. It's the first tool tailor-made for NZ wildlife and plant species.

The programme recognises unique features in photos of species large and small, from Hector's dolphins to striated ants, and returns the scientific name, common names, and other related classifications, including Māori names where available.

The Aotearoa Species Classifier app, available in the App store now and Google Play later this year, can identify wildlife wherever the user is, even without an internet connection. An additional web classifier has more powerful models and tools for those who wish to delve deeper at home.

PhD student Hongyu Wang and research programmer Paul Schlumbom developed the models and software and are continuing to work on the project. Paul says they have discovered some unexpected benefits.

'Because we have drawn data from a range of sources, the app is also able to identify pests, which means action can be taken to remove or destroy dangerous pests straight away,” Paul says.

A probability prediction is included in the identification with alternatives if there is any doubt about the likelihood of the species identified.

Hongyu says this ensures the integrity of the data.

'We can say that normally the confidence is quite high, but with rare species the model might have more trouble. So you can check the top five possibilities if the confidence is not super high.”

He says when the model is highly confident, i.e., with a confidence score of more than 95 per cent, results show that we can expect high accuracy.

The online version also provides the ability to see the interpretation image which analyses which parts of the image the model is using for the prediction.

The impetus for the project came from Dr Varvara Vetrova, a Senior Lecturer in Statistics at the University of Canterbury and Professor Eibe Frank, Co-Director of the AI Institute based at the University of Waikato. The team also included Associate Professor Michael Cree at Waikato, Landcare experts in systematics, Canterbury Masters student Sheldon Coup, and Waikato Honours student Jeff Mo.

You may also like....

2 comments

NZ Species

Posted on 19-01-2023 10:24 | By an_alias

How about that for a name, oh no we have to be woke to the end of NZ existance.


This App Is A Game Changer

Posted on 22-08-2023 21:48 | By Matt Smith

This app is a game-changer for all nature enthusiasts out there! It's fantastic to see technology being used to bring us closer to the incredible biodiversity of New Zealand. What a handy tool for hikers, gardeners, and anyone curious about their surroundings.

I'm thrilled that this app not only identifies native species but also can help spot and manage pests. It's a powerful tool for conservation efforts. Kudos to the researchers for their hard work, and I can't wait to try it out. We will be sure to make use of it.

Thanks,
Matt


Leave a Comment


You must be logged in to make a comment.