AIMe – A standard for artificial intelligence in biomedicine

An international research team with participants from several universities including Maastricht University (UM) has proposed a standardized registry for artificial intelligence (AI) work in biomedicine to improve the reproducibility of results and create trust in the use of AI algorithms in biomedical research and, in the future, in everyday clinical practice. The scientists presented their proposal in the scientific journal “Nature Methods”.

In the last decades, new technologies have made it possible to develop a wide variety of systems that can generate huge amounts of biomedical data, for example in cancer research. At the same time, completely new possibilities have developed for examining and evaluating this data using artificial intelligence methods. AI algorithms in intensive care units, e.g., can predict circulatory failure at an early stage based on large amounts of data from several monitoring systems by processing a lot of complex information from different sources at the same time, which is far beyond human capabilities.

This great potential of AI systems leads to an unmanageable number of biomedical AI applications. Unfortunately, the corresponding reports and publications do not always adhere to best practices or provide only incomplete information about the algorithms used or the origin of the data. This makes assessment and comprehensive comparisons of AI models difficult. The decisions of AIs are not always comprehensible to humans and results are seldomly fully reproducible. This situation is untenable, especially in clinical research, where trust in AI models and transparent research reports are crucial to increase the acceptance of AI algorithms and to develop improved AI methods for basic biomedical research.

To address this problem, an international research team including the UM has proposed the AIMe registry for artificial intelligence in biomedical research, a community-driven registry that enables users of new biomedical AI to create easily accessible, searchable and citable reports that can be studied and reviewed by the scientific community.

The freely accessible registry is available at https://aime-registry.org and consists of a user-friendly web service that guides users through the AIMe standard and enables them to generate complete and standardised reports on the AI models used. A unique AIMe identifier is automatically created, which ensures that the report remains persistent and can be specified in publications. Hence, authors do not have to cope with the time-consuming description of all facets of the AI used in articles for scientific journals and simply refer to the report in the AIMe registry.

Since the registry is designed as a web platform maintained by the scientific community, every user can ask questions about existing reports, make comments or suggest improvements. This feedback from the community will also be included in the annual update of the AIMe standard, and interested researchers can join the AIMe Steering Committee to become more involved in the further standardisation of biomedical AI.

“The AIMe Registry, in addition to providing easy registration of AI methods in citable form, also provides the ability to search for existing AI systems relevant to the application area. This means that researchers do not have to reinvent the wheel every time and can be sure that the AI method used has been evaluated and adheres to the AIMe standards,” reports Prof. Jan Baumbach from the Centre for Bioinformatics at the University of Hamburg.

persberichtai2

Original publication

Authors: J. Matschinske, N. Alcaraz, A. Benis, M. Golebiewski, D. G. Grimm, L. Heumos, T. Kacprowski, O. Lazareva, M. List, Z. Louadi, J. K. Pauling, N. Pfeifer, R. Röttger, V. Schwämmle, G. Sturm, A. Traverso, K. van Steen, M. V. de Freitas, G. C. V. Silva, L. Wee, N. K. Wenke, M. Zanin, O. Zolotareva, J. Baumbach, and D. B. Blumenthal

Title: The AIMe registry for artificial intelligence in biomedical research

Nature Methods XXX (2021).

DOI: 10.1038/s41592-021-01241-0

Website: https://aime-registry.org

Also read

  • Nienke Verstegen, researcher at De Forensische Zorgspecialisten, has conducted research on aggression within forensic care and its impact on patients and staff. On July 6, 2023, she will receive her PhD from Maastricht University with her dissertation 'Hurt people hurt people. Characteristics and...

  • Patients admitted to hospital due to a severe COVID-19 infection exhibit no evidence of brain damage caused by the disease. This is the conclusion of an extensive study led by Maastricht University.

  • Sten van Beek

    Cold shivers?

    Due to the Western lifestyle with a high fat diet combined with little exercise, more and more people in the Netherlands are overweight or even obese. This causes an increased risk of type II diabetes. What can be done about this besides a healthier lifestyle? The answer comes from an unexpected...

More news