70b on my M1 max 64gb

How much did tha thing cost?

I run a second Mac for local llm use and access it remotely using ssh from the first mac

Omlx needs to incorporate macos native shortcuts use - macos can almost instantly extract text from pdfs and a bunch of other things using it's ane neural engine keeping unified ram for llm use. The two together would be awesome

why combine audio & image analysis into an llm though, why not allow the user to choose their own audio & image analysis alongside their own llm choice?

I run gemma-4-26b-bf16 in mtp mode and it runs very smooth, spitting out answers in seconds and outputting text 30x faster than i can read.

Gemma4 because presumably it does image analysis right?

-31b It's a dense model

-how many tokens/s is it running at

-What temps are the M1 max GPU/CPU running at

-Is it mlx or gguf

-Why 31b and not 26b which is moe and much more efficient on the m1 max at 50tokens/s & low temps.

I personally use (MLX) qwen3.6-35b-8bit mostly, but use Gemma-4-26b-4bit for image analysis, its mind blowing how fast it is at identifying the scene in a photograph.

Didn't China steal the F-22/F35/B2/C17 blueprints, and also stole COVID?

The former, yes. The latter, no, that one was partly paid for by Fauci & co. who also did their best (but failed, [1, page 9 and onwards]) to keep this fact out of the news.

[1] https://www.hsgac.senate.gov/wp-content/uploads/letter-and-t...

Not sure why you got down voted, I thought it was common knowledge the US funded the Wuhan lab doing gain-of-function research?

Restoring, updating, upgrading and compiling on a 2014 Jetson TK1 - Running: ai agent cli, ai agent assistant, local llm models.

“What I’m doing is real coding. What you’re doing is a mess full of vibe coding.”

I do enjoy these gatekeepers getting sideswept, their comments being little raindrops in a hurricane. It's a vile mindset.

Yes I noticed too that several ai agents will tell you directly the code is correct and it is 100 percent fixed but I know it is not true, when I explain to the AI agent that I know they are wrong and serve the solution the ai agent will just act as though what they said never happened and then use my solution to reaffirm they have provided a solution. It's frustrating, laughable, and painful to watch all at once. Makes me realise these companies hired some evil philosophy graduates to build AI soul.md