'Today’s computers are horribly inefficient': How a US startup is going Apple's way — combining hardware and software to crack AI's big 99% power consumption problem

Efficient Computer
(Image credit: Efficient Computer)

Efficient Computer is living up to its name by creating what it describes as the most energy efficient programmable processor. 

The startup emerged from stealth in March 2024 with $16m in seed financing led by Eclipse VC, and the claim to have built a completely new technology stack, from compiler to silicon, in a year.

The company’s approach is to create what it describes as a “general-purpose, post-von Neumann processor design that is easy to program and also extremely energy-efficient.” 

Efficient structuring of memory

Brandon Lucia, Founder and CEO of Efficient Computer said, “Today’s computers are horribly inefficient. The dominant “von Neumann” processor design wastes 99% of energy. This inefficiency is, unfortunately, baked deeply into their design. In von Neumann processors, programs are expressed as a sequence of simple instructions, but running programs in a simple sequence is unacceptably slow. Improving performance requires complex hardware to find instructions that can safely run in parallel. Improving efficiency requires a fundamental rethinking of how we design computers.”

What that means in practice is instead of executing a series of instructions like von Neumann designs, its architecture “expresses programs as a 'circuit' of instructions that shows which instructions talk to each other.” This design, called Fabric processor architecture, has been implemented in the Monza test SoC.

Lucia was recently interviewed by eeNews Europe and explained in more detail what the company's approach involves. “What’s fundamentally different is the architecture was developed with compiler and software stack at the same time from research in Carnegie Mellon and we designed it with generality in mind,” he said. “We don’t need a register flow and we don’t need to instruction fetch every cycle. A subset of the tiles are also memory access tiles – that’s an efficient way of structuring the memory.”

The initial performance is 1.3 to 1.5TOPS/W, 500mW to 600mW for the chip, but that’s really just the beginning. “Looking to the future we have a roadmap to scale up the architecture as we are doing design space exploration. Early in 2025 we can hit 100GOPS at 200MHz and we think we can scale that 10 to 100x in performance with the same efficiency,” he said in the interview.

More from TechRadar Pro

Wayne Williams
Editor

Wayne Williams is a freelancer writing news for TechRadar Pro. He has been writing about computers, technology, and the web for 30 years. In that time he wrote for most of the UK’s PC magazines, and launched, edited and published a number of them too.

Read more
RISC-V
Startup formed by former Intel engineers and backed by AMD legendary chip designer wants to become the Arm of RISC-V
CPU with the contacts facing up lying on the motherboard of the PC. the chip is highlighted with blue light
This universal processor combines CPU, GPU, DSP and FPGA in one chip
A hand reaching out to touch a futuristic rendering of an AI processor.
Researchers want to embrace Arm's celebrated paradigm for a universal generative AI processor; a puzzling MEGA.mini core architecture
Half man, half AI.
Yet another tech startup wants to topple Nvidia with 'orders of magnitude' better energy efficiency; Sagence AI bets on analog in-memory compute to deliver 666K tokens/s on Llama2-70B
A mockup of the possible Apple M3 Ultra logo
Performance isn't the only reason you should buy Apple's M3 Ultra Mac Studio - it's reportedly one of the most power-efficient processors too
A Corsair One i500 on a desk
Microsoft backed a tiny hardware startup that just launched its first AI processor that does inference without GPU or expensive HBM memory and a key Nvidia partner is collaborating with it
Latest in Pro
cybersecurity
What's the right type of web hosting for me?
Security padlock and circuit board to protect data
Trust in digital services around the world sees a massive drop as security worries continue
Hacker silhouette working on a laptop with North Korean flag on the background
North Korea unveils new military unit targeting AI attacks
An image of network security icons for a network encircling a digital blue earth.
US government warns agencies to make sure their backups are safe from NAKIVO security issue
Laptop computer displaying logo of WordPress, a free and open-source content management system (CMS)
This top WordPress plugin could be hiding a worrying security flaw, so be on your guard
construction
Building in the digital age: why construction’s future depends on scaling jobsite intelligence
Latest in News
Quordle on a smartphone held in a hand
Quordle hints and answers for Sunday, March 23 (game #1154)
NYT Strands homescreen on a mobile phone screen, on a light blue background
NYT Strands hints and answers for Sunday, March 23 (game #385)
NYT Connections homescreen on a phone, on a purple background
NYT Connections hints and answers for Sunday, March 23 (game #651)
Google Pixel 9 Pro Fold main display opened
Apple is rumored to be prioritizing battery life on the foldable iPhone – which could also feature a liquid metal hinge for added durability
Google Pixel 9
The Google Pixel 10 just showed up in Android code – and may come with a useful speed boost
L-mount alliance
Sirui joins L-Mount Alliance to deliver its superb budget lenses for Leica, DJI, Sigma and Panasonic cameras