Meta AI Introduces Advanced Photo Editing and Understanding Features for WhatsApp, Facebook, and Instagram

Meta AI on WhatsApp gets voice and photo editing tools

At Meta Connect 2024 on Wednesday, Meta introduced new updates to WhatsApp that enable users to interact with Meta AI using their voices and photos. According to Meta, these updates aim to "make it easier for more people" to share their ideas, enhance their conversations, and explore new experiences. Talk to Me: Users can now speak directly to Meta AI, which will respond verbally. By pressing the waveform button, you can ask questions, and the AI will provide explanations. This feature will gradually introduce different voice options, including voices of various celebrities. Look at This: Users can send photos to Meta AI for information. For instance, if you photograph a menu in another language, you can ask the AI to translate it. Additionally, you can take a picture of a plant and inquire about its care. Edit My Photo: Meta AI now offers photo editing capabilities, allowing users to add, remove, or modify elements in their pictures. You can eliminate unwanted people from a background or change the color of an object to visualize it differently. Furthermore, Meta is expanding its business AIs, aiming to improve customer service for users interacting with businesses. They confirmed that they are starting with thousands of businesses using the WhatsApp Business app, with plans to broaden these services over the next year. Announcing the updates, Meta posted:

Meta AI can now understand and edit your photos | TechCrunch

Meta AI is starting to catch up with Google when it comes to AI-powered photo editing. On Wednesday, at Meta Connect 2024 conference, the tech giant announced that Meta AI will now be able to help you edit photos using AI technology as well as answer questions about the photos you share. The additional features are made possible because Meta AI is gaining multimodal capabilities, powered by its Llama 3.2 models. This means you can now share photos in your chats, not just text, similar to Google Gemini and OpenAI's ChatGBT. When sharing a photo, Meta AI can understand what the image contains and answer questions about the image. For example, Meta suggests you could share a photo of a flower and then ask the AI what type of flower it is. Or you could share a photo of a delicious dish and ask Meta AI how to make it. Of course, how accurately Meta AI responds to these and other questions still needs to be tested and reviewed. Another key feature with the added photo support is the ability to edit images using AI. After sending Meta AI the photo, you can ask it to make some sort of change -- like adding or removing an object in the foreground, changing your outfit, or updating the background of the photo in some way, like adding a rainbow to the sky, for instance. Meta AI can also be used on Instagram when you reshare a photo from your feed to your Instagram Stories. Here, the AI technology can look at the photo, understand the images, then generate an accompanying background for your Story. Beyond photo edits, Meta is also testing translation tools for Facebook and Instagram Reels that include automatic dubbing and lip-syncing. These tests will initially be run in small groups in the U.S. and Latin America in both English and Spanish. Other Meta AI photo features include the expansion of Meta AI's generative AI features and the rollout of tests of Meta AI images shared to your Facebook and Instagram feeds, to prompt users to try the feature.

Facebook and Instagram can now use AI to answer questions about your photos and edit them too

Mark Zuckerberg has announced a ton of cool AI features at Meta Connect 2024 which apply to Meta AI, the chatbot found inside its popular social media apps like Facebook, Instagram DM, WhatsApp, and Messenger. One of the coolest new features he revealed is the ability to ask questions about photos and edit them in Meta AI. Meta AI is now multimodal, which means it can 'see' photos in your chats and answer questions about them. So, you can simply post an image of a bird in your chat with Meta AI and ask it what kind of bird you're looking at and you'll get the right answer. But it goes beyond simply identifying animals and plants. Show it a photo of a meal and ask it how you'd make it and you'll get a list of instructions as well as ingredients. One of the most fun things you can do with AI is to manipulate your photos. This doesn't just involve adding an Instagram filter or changing brightness levels. With AI you can do things with your photos that wouldn't otherwise be possible, like add or remove elements or change the background. Even more impressively, Meta AI can now edit your photos, too. That means that if you want to remove somebody from a photo you can get Meta AI to do it for you. Or maybe you just want to change the background to something else? No problem, Meta AI can do that too. It can even add things to your photos, so if you want to be standing next to a lion, you can make it happen without risking your life. If you want to see what you'd look like in a different outfit then Meta AI is your new fashion consultant. Plus, if you want to reshare a photo from your Instagram feed to your Instagram Story, Meta AI's new backgrounds feature is on hand to intelligently pick a background that will go with the image for your story. We expect the ability to see and edit photos to roll out to Meta AI users in the US, Canada, Australia, and New Zealand over the next month.