Brain-Inspired AI Breakthrough: Lp-Convolution Enhances Machine Vision

Brain-inspired AI breakthrough: Making computers see more like humans

A team of researchers from the Institute for Basic Science (IBS), Yonsei University, and the Max Planck Institute have developed a new artificial intelligence (AI) technique that brings machine vision closer to how the human brain processes images. Called Lp-Convolution, this method improves the accuracy and efficiency of image recognition systems while reducing the computational burden of existing AI models. Bridging the Gap Between CNNs and the Human Brain The human brain is remarkably efficient at identifying key details in complex scenes, an ability that traditional AI systems have struggled to replicate. Convolutional Neural Networks (CNNs) -- the most widely used AI model for image recognition -- process images using small, square-shaped filters. While effective, this rigid approach limits their ability to capture broader patterns in fragmented data. More recently, Vision Transformers (ViTs) have shown superior performance by analyzing entire images at once, but they require massive computational power and large datasets, making them impractical for many real-world applications. Inspired by how the brain's visual cortex processes information selectively through circular, sparse connections, the research team sought a middle ground: Could a brain-like approach make CNNs both efficient and powerful? Introducing Lp-Convolution: A Smarter Way to See To answer this, the team developed Lp-Convolution, a novel method that uses a multivariate p-generalized normal distribution (MPND) to reshape CNN filters dynamically. Unlike traditional CNNs, which use fixed square filters, Lp-Convolution allows AI models to adapt their filter shapes -- stretching horizontally or vertically based on the task, much like how the human brain selectively focuses on relevant details. This breakthrough solves a long-standing challenge in AI research, known as the large kernel problem. Simply increasing filter sizes in CNNs (e.g., using 7×7 or larger kernels) usually does not improve performance, despite adding more parameters. Lp-Convolution overcomes this limitation by introducing flexible, biologically inspired connectivity patterns. Real-World Performance: Stronger, Smarter, and More Robust AI In tests on standard image classification datasets (CIFAR-100, TinyImageNet), Lp-Convolution significantly improved accuracy on both classic models like AlexNet and modern architectures like RepLKNet. The method also proved to be highly robust against corrupted data, a major challenge in real-world AI applications. Moreover, the researchers found that when the Lp-masks used in their method resembled a Gaussian distribution, the AI's internal processing patterns closely matched biological neural activity, as confirmed through comparisons with mouse brain data. "We humans quickly spot what matters in a crowded scene," said Dr. C. Justin LEE, Director of the Center for Cognition and Sociality within the Institute for Basic Science. "Our Lp-Convolution mimics this ability, allowing AI to flexibly focus on the most relevant parts of an image -- just like the brain does." Impact and Future Applications Unlike previous efforts that either relied on small, rigid filters or required resource-heavy transformers, Lp-Convolution offers a practical, efficient alternative. This innovation could revolutionize fields such as: - Autonomous driving, where AI must quickly detect obstacles in real time - Medical imaging, improving AI-based diagnoses by highlighting subtle details - Robotics, enabling smarter and more adaptable machine vision under changing conditions "This work is a powerful contribution to both AI and neuroscience," said Director C. Justin Lee. "By aligning AI more closely with the brain, we've unlocked new potential for CNNs, making them smarter, more adaptable, and more biologically realistic." Looking ahead, the team plans to refine this technology further, exploring its applications in complex reasoning tasks such as puzzle-solving (e.g., Sudoku) and real-time image processing. The study will be presented at the International Conference on Learning Representations (ICLR) 2025, and the research team has made their code and models publicly available:

Brain-inspired AI technique mimics human visual processing to enhance machine vision

A team of researchers from the Institute for Basic Science, Yonsei University, and the Max Planck Institute have developed a new artificial intelligence (AI) technique that brings machine vision closer to how the human brain processes images. Called Lp-Convolution, this method improves the accuracy and efficiency of image recognition systems while reducing the computational burden of existing AI models. The human brain is remarkably efficient at identifying key details in complex scenes, an ability that traditional AI systems have struggled to replicate. Convolutional Neural Networks (CNNs) -- the most widely used AI model for image recognition -- process images using small, square-shaped filters. While effective, this rigid approach limits their ability to capture broader patterns in fragmented data. More recently, vision transformers have shown superior performance by analyzing entire images at once, but they require massive computational power and large datasets, making them impractical for many real-world applications. Inspired by how the brain's visual cortex processes information selectively through circular, sparse connections, the research team sought a middle ground: Could a brain-like approach make CNNs both efficient and powerful? Introducing Lp-Convolution: A smarter way to see To answer this, the team developed Lp-Convolution, a novel method that uses a multivariate p-generalized normal distribution (MPND) to reshape CNN filters dynamically. Unlike traditional CNNs, which use fixed square filters, Lp-Convolution allows AI models to adapt their filter shapes -- stretching horizontally or vertically based on the task, much like how the human brain selectively focuses on relevant details. This breakthrough solves a long-standing challenge in AI research, known as the large kernel problem. Simply increasing filter sizes in CNNs (e.g., using 7×7 or larger kernels) usually does not improve performance, despite adding more parameters. Lp-Convolution overcomes this limitation by introducing flexible, biologically inspired connectivity patterns. Real-world performance: Stronger, smarter, and more robust AI In tests on standard image classification datasets (CIFAR-100, TinyImageNet), Lp-Convolution significantly improved accuracy on both classic models like AlexNet and modern architectures like RepLKNet. The method also proved to be highly robust against corrupted data, a major challenge in real-world AI applications. Moreover, the researchers found that when the Lp-masks used in their method resembled a Gaussian distribution, the AI's internal processing patterns closely matched biological neural activity, as confirmed through comparisons with mouse brain data. "We humans quickly spot what matters in a crowded scene," said Dr. C. Justin Lee, Director of the Center for Cognition and Sociality within the Institute for Basic Science. "Our Lp-Convolution mimics this ability, allowing AI to flexibly focus on the most relevant parts of an image -- just like the brain does." Impact and future applications Unlike previous efforts that either relied on small, rigid filters or required resource-heavy transformers, Lp-Convolution offers a practical, efficient alternative. This innovation could revolutionize fields such as: "This work is a powerful contribution to both AI and neuroscience," said Director Lee. "By aligning AI more closely with the brain, we've unlocked new potential for CNNs, making them smarter, more adaptable, and more biologically realistic." Looking ahead, the team plans to refine this technology further, exploring its applications in complex reasoning tasks such as puzzle-solving (e.g., Sudoku) and real-time image processing. The study will be presented at the International Conference on Learning Representations (ICLR 2025), and the research team has made their code and models publicly available on GitHub and OpenReview.net.