Discussion
Loading...

Post

Log in
  • About
  • Code of conduct
  • Privacy
  • About Bonfire
Kaybee's toots
Kaybee's toots
@kb01@chaos.social  ·  activity timestamp 5 days ago

Just a NixOS Phone running a reasoning LLM locally...

#nixos #llm #llamacpp

In the Picture is a Phone.
The top half is covered by a console running llama-cpp, and the bottom half is covered by an chat window. 
I asked "Do you get this message" in German.
The AI is thinking "The user is asking if I can receive this message. I ...". The AI Is still thinking, though 7 min have already passed.
In the Picture is a Phone. The top half is covered by a console running llama-cpp, and the bottom half is covered by an chat window. I asked "Do you get this message" in German. The AI is thinking "The user is asking if I can receive this message. I ...". The AI Is still thinking, though 7 min have already passed.
In the Picture is a Phone. The top half is covered by a console running llama-cpp, and the bottom half is covered by an chat window. I asked "Do you get this message" in German. The AI is thinking "The user is asking if I can receive this message. I ...". The AI Is still thinking, though 7 min have already passed.
  • Copy link
  • Flag this post
  • Block

A small Bonfire corner on the internet

This is a small personal instance of Bonfire in the Fediverse.

A small Bonfire corner on the internet: About · Code of conduct · Privacy ·
Bonfire social · 1.0.1 no JS en
Automatic federation enabled
Log in
  • Explore
  • About
  • Code of Conduct