Study Reveals AI's Impact on Medical Imaging Efficiency is Inconclusive

AI in medical imaging does not guarantee increased efficiency

University Hospital BonnOct 12 2024 The use of artificial intelligence (AI) in hospitals and patient care is steadily increasing. Especially in specialist areas with a high proportion of imaging, such as radiology, AI has long been part of everyday clinical practice. However, the question of the extent to which AI actually influences workflows in a clinical setting remains largely unanswered. Researchers at the University Hospital Bonn (UKB) and the University of Bonn have therefore conducted a comprehensive analysis of existing studies on the effect of AI. They were able to show that AI does not automatically lead to an acceleration of work processes. Their results have now been published in the journal npj Digital Medicine. Although AI is often seen as a solution for handling routine tasks such as monitoring patients, documenting care tasks and supporting clinical decisions, the actual effects on work processes are unclear. Particularly in data-intensive specialties such as genomics, pathology and radiology, where AI is already being used to recognize patterns in large amounts of data and prioritize cases, there is a lack of reliable data on efficiency gains. We wanted to find out to what extent AI solutions actually improve efficiency in medical imaging. The widespread assumption that AI automatically speeds up work processes often falls short." Katharina Wenderott, lead author of the study and doctoral student at the University of Bonn at the UKB's Institute for Patient Safety (IfPS) Consistent evaluation of studies is difficult The research team conducted a systematic review of 48 studies that examined the use of AI tools in clinical settings, particularly in radiology and gastroenterology. Of the 33 studies that looked at the processing time of work processes, 67 percent reported a reduction in working hours, but the meta-analyses did not show any significant efficiency gains. 'Some studies showed statistically significant differences, but these were insufficient to draw general conclusions,' says Wenderott. In addition, the team analyzed how well AI is integrated into existing workflows. It was found that the success of implementation depends heavily on the specific conditions and processes on site. However, the heterogeneity of the study designs and the technologies used made it difficult to conduct a uniform evaluation. 'Our results make it clear that the use of AI in everyday clinical practice must be considered in a differentiated way,' emphasizes Prof. Matthias Weigl, Director of the IfPS at the UKB, who also conducts research at the University of Bonn. 'Local conditions and individual work processes have a major influence on the success of implementation.' The study provides important initial insights into how AI technologies can influence clinical work processes. 'A key finding is the need for clearly structured reporting in future studies in order to better evaluate the scientific and practical benefits of these technologies,' summarizes Prof. Weigl. University Hospital Bonn Journal reference: Wenderott, K., et al. (2024). Effects of artificial intelligence implementation on efficiency in medical imaging -- a systematic literature review and meta-analysis. npj Digital Medicine. doi.org/10.1038/s41746-024-01248-9.

Comprehensive review finds AI's influence on hospital efficiency lacks clarity

University Hospital of BonnOct 12 2024 The use of artificial intelligence (AI) in hospitals and patient care is steadily increasing. Especially in specialist areas with a high proportion of imaging, such as radiology, AI has long been part of everyday clinical practice. However, the question of the extent to which AI actually influences workflows in a clinical setting remains largely unanswered. Researchers at the University Hospital Bonn (UKB) and the University of Bonn have therefore conducted a comprehensive analysis of existing studies on the effect of AI. They were able to show that AI does not automatically lead to an acceleration of work processes. Their results have now been published in the journal npj Digital Medicine. Although AI is often seen as a solution for handling routine tasks such as monitoring patients, documenting care tasks and supporting clinical decisions, the actual effects on work processes are unclear. Particularly in data-intensive specialties such as genomics, pathology and radiology, where AI is already being used to recognize patterns in large amounts of data and prioritize cases, there is a lack of reliable data on efficiency gains. 'We wanted to find out to what extent AI solutions actually improve efficiency in medical imaging,' explains Katharina Wenderott, lead author of the study and a doctoral student at the University of Bonn at the UKB's Institute for Patient Safety (IfPS). The widespread assumption that AI automatically speeds up work processes often falls short." Katharina Wenderott, Doctoral Student, University of Bonn Consistent evaluation of studies is difficult The research team conducted a systematic review of 48 studies that examined the use of AI tools in clinical settings, particularly in radiology and gastroenterology. Of the 33 studies that looked at the processing time of work processes, 67 per cent reported a reduction in working hours, but the meta-analyses did not show any significant efficiency gains. 'Some studies showed statistically significant differences, but these were insufficient to draw general conclusions,' says Wenderott. In addition, the team analyzed how well AI is integrated into existing workflows. It was found that the success of implementation depends heavily on the specific conditions and processes on site. However, the heterogeneity of the study designs and the technologies used made it difficult to conduct a uniform evaluation. 'Our results make it clear that the use of AI in everyday clinical practice must be considered in a differentiated way,' emphasizes Prof. Matthias Weigl, Director of the IfPS at the UKB, who also conducts research at the University of Bonn. 'Local conditions and individual work processes have a major influence on the success of implementation.' The study provides important initial insights into how AI technologies can influence clinical work processes. 'A key finding is the need for clearly structured reporting in future studies in order to better evaluate the scientific and practical benefits of these technologies,' summarizes Prof. Weigl. University Hospital of Bonn Journal reference: Wenderott, K., et al. (2024) Effects of artificial intelligence implementation on efficiency in medical imaging -- a systematic literature review and meta-analysis. Npj Digital Medicine. doi.org/10.1038/s41746-024-01248-9.

AI does not necessarily lead to more efficiency in clinical practice, research shows

The use of artificial intelligence (AI) in hospitals and patient care is steadily increasing. Especially in specialist areas with a high proportion of imaging, such as radiology, AI has long been part of everyday clinical practice. However, the question of the extent to which AI actually influences workflows in a clinical setting remains largely unanswered. Researchers at the University Hospital Bonn (UKB) and the University of Bonn have therefore conducted a comprehensive analysis of existing studies on the effect of AI. They were able to show that AI does not automatically lead to an acceleration of work processes. Their results have been published in the journal npj Digital Medicine. Although AI is often seen as a solution for handling routine tasks such as monitoring patients, documenting care tasks and supporting clinical decisions, the actual effects on work processes are unclear. Particularly in data-intensive specialties such as genomics, pathology and radiology, where AI is already being used to recognize patterns in large amounts of data and prioritize cases, there is a lack of reliable data on efficiency gains. "We wanted to find out to what extent AI solutions actually improve efficiency in medical imaging," explains Katharina Wenderott, lead author of the study and a doctoral student at the University of Bonn at the UKB's Institute for Patient Safety (IfPS). "The widespread assumption that AI automatically speeds up work processes often falls short." Consistent evaluation of studies is difficult The research team conducted a systematic review of 48 studies that examined the use of AI tools in clinical settings, particularly in radiology and gastroenterology. Of the 33 studies that looked at the processing time of work processes, 67% reported a reduction in working hours, but the meta-analyses did not show any significant efficiency gains. "Some studies showed statistically significant differences, but these were insufficient to draw general conclusions," says Wenderott. In addition, the team analyzed how well AI is integrated into existing workflows. It was found that the success of implementation depends heavily on the specific conditions and processes on site. However, the heterogeneity of the study designs and the technologies used made it difficult to conduct a uniform evaluation. "Our results make it clear that the use of AI in everyday clinical practice must be considered in a differentiated way," emphasizes Prof. Matthias Weigl, Director of the IfPS at the UKB, who also conducts research at the University of Bonn. "Local conditions and individual work processes have a major influence on the success of implementation." The study provides important initial insights into how AI technologies can influence clinical work processes. "A key finding is the need for clearly structured reporting in future studies in order to better evaluate the scientific and practical benefits of these technologies," says Prof. Weigl.