By using this site, you agree to our Privacy Policy and our Terms of Use. Close
ConciousMan said:
CaptainExplosion said:

You can have AI on your local device without data centers?

And aren't some companies working on improving energy efficiency and decreasing water consumption by AI data centers?

Yes, you can run local LLMs model on your PC or something like Spark DGX. But, in the future I believe a smartphone might be able to run a local AI software. They can improve data center efficiency, the problem is that the users are at the mercy of AI solutions providers for output quality. With potential future local based models the user can fine tune and train AI on their own and optimize it for their work.

Of course all this is probably going to require either major processing power improvements or major optimizations to AI models. It's probably going to take some years until local LLMs become a widely practical solution. I'm guessing it won't be until the 30s that local LLMs are going to be more than an enthusiast thing and maybe a fun but ultimately particularly unreliable toy.

Last edited by Zkuq - 12 hours ago