1-Bit Bonsai Image 4B Image Generation for Local Devices (prismml.com)

87 points by modinfo 2 hours ago

20 comments:

by sudb 3 minutes ago

Very interested to see where this kind of work goes for on-device video generation!

by lumost 41 minutes ago

I actually can’t wait for the future where I upgrade hardware in order to upgrade my ai as an alternative to an expensive subscription.

There are many problems I want to work on which require billions of tokens. These are completely inaccessible without corporate project sponsorship at the moment. An asic generation machine which can pump out a few 10s of thousands of tokens per second at opus4.6 quality is more than sufficient.

by bigmadshoe 12 minutes ago

Can you give an example of such a problem?

by a1o 30 minutes ago

Anyone could pickup the minimal hardware requirements for this? Like both RAM and Storage?

by sorenjan 2 hours ago

They call it a diffusion model, but it's based on Flux.2 which is a rectified flow model.

by potatoman22 10 minutes ago

I wonder why they didn't use a Bonsai model as the text encoder

by wiradikusuma 28 minutes ago

Is there a benchmark of local image generation models? Local = can run on a 16 GB MacBook or 8 GB+ NVIDIA card.

by janniks 13 minutes ago

I was expecting to see images of Bonsai trees when I clicked this

by tobr 11 minutes ago

I expected a small tree in black and white pixel art.

by MitPitt an hour ago

Lately I've noticed posts with barely 10 points getting to HN frontpage. Was it always like this?

by blurbleblurble 5 minutes ago

Maybe the algorithm has some kind of "momentum" to it, taking into consideration the velocity of upvotes.

by robbomacrae an hour ago

I believe it's the way the HN algorithm works. In order to give new and obscure posts a shot, it will add them to peoples feeds in their front page and see how they measure. Otherwise new posts wouldn't get seen and the flywheel would never get started.

So everyone acts as a sort of beta tester for obscure posts.

by s-macke an hour ago

On weekends, yes. During the week, that’s also true if they arrive within a short time frame, e.g., three minutes. Almost no one looks at “New”. That is the real issue.

by nickvec 12 minutes ago

If you are looking to see the "true" HN frontpage (i.e. most upvoted posts), I'd recommend using https://hckrnews.com

by DannyPage an hour ago

Not as much competition on the weekend?

by Aboutplants an hour ago

I just assume bots

by iamjackg an hour ago

Bots doing what? How would the poster being a bot influence why the post itself makes it to the front page with just 10 points?

by speedgoose 18 minutes ago

It’s about how quickly they get those points. It doesn’t have to be bots. Sending a post to friends with reputable human profiles, and asking for a vote kinda works of most social networks. Some social networks claim they have protection against this but I wouldn’t bet they catch everything.

by SilentM68 30 minutes ago

Question,

Is it compatible with Ollama, ComfyUI or are those providers unneeded, compatible with low-end hardware?

Also, where does "./setup.sh/ drop the components in Linux?

Thank you, Sol

by yieldcrv an hour ago

impressive, combines a couple techniques that I always wanted the frontier models to have

having trouble loading the webgl browser demo on my phone but no biggy

Data from: Hacker News, provided by Hacker News (unofficial) API