Pixi app launches on iOS, turning iMessage into interactive AR experiences with AI characters

Pixi's new iOS app turns text messages into interactive AR experiences

Forget stickers, GIFs, and emoji reactions. Pixi is betting that the next evolution of messaging is interactive augmented reality (AR). The startup launched its messaging-native app on the App Store on Wednesday, allowing users to send AI-powered AR characters through iMessage. Instead of appearing as static media, the characters come to life through the recipient's iPhone camera, where they can react to their surroundings, interact with people, and respond in real time. While AR isn't new and shiny anymore -- companies like Snap have created AR filters and lenses for years -- Pixi believes its approach is different. By combining AR with on-device AI, its characters can understand what's happening around them and behave accordingly. A virtual cat, for example, reacts when a real dog walks past. (According to the company, all visual and audio processing remains on the device to preserve user privacy.) Pixi founder Mark Drummond (ex-DreamWorks Animation and ex-Apple) says the app is designed to bring a greater sense of presence and spontaneity to digital conversations. Rather than sending a text to wish someone a Happy Birthday, users can send characters that create a shared experience, turning a simple message into something closer to a digital gift or playful interaction. "The consumer problem we're solving is thinking of a friend when they're not present," he told TechCrunch. "Sometimes the psychology is called pebbling or creative gifting. You're sharing tokens of affection, basically cards, e-cards, and gifts. That's your dad, or, in some cases, your granddad's media. We can do better. We can do something that's digitally native, and that uses everything we learned about AR on the iPhone." Earlier this week, Drummond demonstrated the app for us, selecting the cat character, which performed a series of stand-up jokes on his desk. Notably, the cat appeared to respond to Drummond's facial expressions. For instance, the experience concluded when he smiled, showcasing the character's ability to perceive emotional cues. At launch, users will have access to a robot, a cat, and an animated envelope character that can react to their voice and "attack" their friends in a playful way. If they move, the envelope will chase them. There are also games like tic-tac-toe and whack-a-mole. Pixi plans to expand beyond just a few characters. The goal is to create a marketplace where studios, brands, and independent creators can share their unique characters for users to choose from. The company envisions this being used for events like movie premieres or product launches, allowing characters to generate excitement, such as when M&Ms release a new flavor. Drummond also mentioned introducing Alice in Wonderland as a character option, as she is an open intellectual property. He pointed out that "our Alice character needs to react to objects that she sees on your desktop in an 'Alice-consistent' way," to demonstrate to partners how their creations will interact with the technology. In the future, Pixi hopes to allow users to create their own characters and personalities. "Part of our plan is to open up those generative AI capabilities to our [users], so they can prompt their way to say something, like, 'I want a blue blob that threatens my friend and growls at them and keeps chasing them on the phone,'" Drummond explained. To send a character to your friend, download the app on iOS and use iMessage by tapping the plus sign button in the lower left corner. No installation is required to receive a Pixi message. Initially, the app will be available only for iPhone models 11 and newer, but there are plans to expand to Android devices and messaging platforms like WhatsApp and Instagram in the future. Also, while the app is free for users, brands will have the option to charge for their characters if they choose. "We're going to encourage people to do it for free, because then people become your own brand ambassadors. You're putting them in charge of using your characters to tell their own stories," Drummond said.

Pixi wants to replace your boring text messages with AR characters that react to you

iMessage users can now send fun AI characters like a cat or robot to their friends. Forget stickers and GIFs, a new app called Pixi Garden wants you to send interactive augmented reality characters through iMessage instead. Pixi Platforms launched the messaging native app today, letting you create and send a "pixi" -- an intelligent AR character that comes alive through your friend's phone camera and reacts to whatever is actually happening around them. What makes a Pixi different from a sticker or filter? A pixi is not a static sticker or filter. It runs on an onboard AI brain that lets it behave, react, and stay aware of context. Machine learning sensors watch the environment and listen to what is happening around the recipient. Recommended Videos According to TechCrunch, a virtual cat sent through Pixi might react when a real dog walks by, or respond to your facial expressions in real time. The outlet noted that in a company demo, a stand-up comedy routine ended specifically when the viewer smiled. At launch, you get 3D characters to play with such as a robot, a cat, and an animated envelope that chases you around the screen, plus simple games like tic-tac-toe and whack-a-mole. The best part is that every bit of processing happens directly on your iPhone, so no data leaves your device. CEO Mark Drummond, a Siri co-founder, says the idea is to replace what used to be e-cards and physical greeting cards with something built for how people actually communicate now. Pixi has bigger plans for its fun characters The company wants to build a marketplace where studios, brands, and independent creators can distribute their own characters, similar to how Roblox built a marketplace for games. Drummond has even floated bringing in Alice in Wonderland, which is an open IP character. The app is free and currently available for iPhone 11 and newer through the App Store, with Android and other messaging platforms like WhatsApp planned for later. If this catches on, the humble text bubble might finally get the upgrade it has been missing for decades.