Uptime Industries wants to boost localized AI usage with an 'AI-in-a-box' called Lemony AI

Uptime Industries has introduced Lemony AI, a compact, handheld device designed to provide on-premise AI infrastructure. The device, roughly the size of a sandwich, can run large language models (LLMs), AI agents, and workflows on a single node, consuming only 65 watts of power. Lemony AI supports models up to 75 billion parameters and can host both open-source and retrofitted closed models. Multiple Lemony devices can be connected to form larger AI clusters, with each device capable of running different models. Uptime has partnered with IBM and JetBrains to offer easier access to AI models, including IBM’s closed models. The concept for Lemony AI originated from Uptime's co-founders experimenting with distributing language models on Raspberry Pi microcomputers, leading to the development of a device focused on data privacy and on-premise AI solutions.

The startup has raised $2 million in seed funding led by True Ventures, with contributions from Alumni Ventures, JetBrains, and angel investors. The funds will be used to further develop Lemony AI devices and expand the software, Lemony OS, to work on other hardware like Nvidia DGX Spark. Uptime aims to transition from a single-user focus to team-based usage. Lemony AI is priced at $499 per month for up to five users. The company has seen strong demand from industries such as finance, healthcare, and law, where data privacy is crucial.

Key takeaways

Uptime Industries has developed a handheld device called Lemony AI, which can run large language models, AI agents, and workflows on-premise, using only 65 watts of power.
Lemony AI can sustain models up to 75 billion parameters and can be stacked to form larger AI clusters, with each device capable of running different models.
The company has partnerships with IBM and JetBrains to provide access to AI models and has seen strong demand from regulated industries like finance, healthcare, and law.
Uptime has raised $2 million in seed funding and plans to expand its software, Lemony OS, to work on other hardware and support team usage, with Lemony AI priced at $499 a month for up to five users.

Uptime Industries wants to boost localized AI usage with an 'AI-in-a-box' called Lemony AI | TechCrunch

Key takeaways

Discussion (0)