Elon Musk’s Grok can now analyze images and it does a pretty good job, until you reach your usage limit

Grok on a smartphone
(Image credit: Shutterstock)

Grok, the AI chatbot that’s built into X.com, has quietly added the ability to analyze images. I’ve been testing it, and it does seem to do a pretty good job, until you reach the usage limit on a free account, which is set to a pretty low three uploads at the time of writing.

To use Grok’s new image analysis features on mobile just load up the X app, then tap on the Grok tab at the bottom of the screen (a square with a line through it) then the + button to upload an image. In a browser, go to X.com and click on Grok in the left-hand menu, then use the paperclip button to attach an image to upload. Once it's uploaded you can then ask Grok some questions about it

Analysing images

To start things off I uploaded a cartoon drawing of Odysseus, a king from Greek mythology who featured in Homer’s Odyssey (I’d just watched The Return, so bear with me) to see if Grok could recognize him. Grok did a very good job of recognizing that it was an historical figure from the style of the cartoon, and I could even get it to generate more images of a similar nature by just typing prompts like “redo the image but make it of a cartoon woman instead”.

Being able to analyze the content of an image so that it can reproduce it with changes is a useful ability, but not something that its rivals like ChatGPT can’t do equally as well. But what about understanding text in images?

Grok running on a Mac.

Grok can generate images as well as analyzing them (Image credit: X)

Analyzing text in images

I uploaded the image of a flyer for a local fitness class, and asked Grok to tell me what text it had found in the image. It extracted all the text perfectly, and even provided clickable links to the web addresses it found. It didn’t seem to provide a link to an Instagram account name though; however ChatGPT didn’t do that either when I tested it.

Being able to extract text from an image is one thing, but Grok needs to be able to analyze that text too. To test out Grok I uploaded a timetable for my local martial arts gym and asked it if there was a BJJ class on Thursdays I could go to. It replied with the perfect answer: “Yes, there is a BJJ class on Thursday at 7:00 AM (BJJ Gi for Adults & Teens) and at 8:00 PM (BJJ No Gi for Adults & Teens).” A feature like that could be genuinely useful for people who have trouble processing visual information.

To take Grok's image analysis even further I tried to upload an academic text as a PDF to see what it made of that, but it turns out that PDF upload isn’t available on Grok unless you upgrade to Premium. Unperturbed, I took a screenshot of the first page of the document, and asked Grok to summarize the text. Again it did an exemplary job, breaking its answer down into sub headings like “Research findings”, "Scholarly contribution” and “Historical context”, whereas ChatGPT simply produced a couple of paragraphs of summary. It seems that Grok has the edge over ChatGPT here.

Grok vs ChatGPT

The biggest issue with Grok currently is that you very quickly hit the free usage limit for uploading images – and again to be fair, you also hit it fairly quickly on the free tier of ChatGPT too. Three uploads isn’t much to go on a day. Aside from that, Grok is impressively good at analyzing images, even beating ChatGPT in some areas, and well worth investigating if the feature sounds like it would be useful to you.

You might also like...

TOPICS
Graham Barlow
Senior Editor, AI

Graham is the Senior Editor for AI at TechRadar. With over 25 years of experience in both online and print journalism, Graham has worked for various market-leading tech brands including Computeractive, PC Pro, iMore, MacFormat, Mac|Life, Maximum PC, and more. He specializes in reporting on everything to do with AI and has appeared on BBC TV shows like BBC One Breakfast and on Radio 4 commenting on the latest trends in tech. Graham has an honors degree in Computer Science and spends his spare time podcasting and blogging.