Avalon local LLM

[Pocster]

6 minutes ago, Pocster said:

(expletive deleted)s me off when I see youtube chatgpv vs opus vs fable all given the same prompot to "write a flappy birds 3d game" and thats a test!. Amazing any of them produce anything at all but (expletive deleted) me - it's not a TOY!. It's super powerful.

or (expletive deleted)ing token speed "test". mac Mx vs rtxY . Mac loses of course. Thats what stopped me getting the m3 at first always slower than rtx BUT when you need a larger model or multiple models Mac wins. For me flexibility over speed is the winner easily. (expletive deleted)ing 10k for an rtx6000 with 96Gb.... Nvidia make macs look cheap!

Edited 4 hours ago by Pocster

[Pocster]

I often say to chat "Are you a BBC Model B?, you are supposedly frontier cutting edge AI. So stop being a prick". Surprisingly it does frquently man up and produce something nearer what I requested. SO the answer is insult it for better results. Like humans I guess!

Edited 4 hours ago by Pocster

[SimonD]

2 hours ago, Pocster said:

I often say to chat "Are you a BBC Model B?, you are supposedly frontier cutting edge AI. So stop being a prick". Surprisingly it does frquently man up and produce something nearer what I requested. SO the answer is insult it for better results. Like humans I guess!

I'm still being nice! And new workflow in place. Discuss with Claude, produces prompt for Claude Code, check output using Claude, approve/disapprove, back to Claude Code to Implement and commit or re-prompt. Scary thing is that Claude Code shows the token burn count as it's chugging away.

[Pocster]

Just now, SimonD said:

I'm still being nice! And new workflow in place. Discuss with Claude, produces prompt for Claude Code, check output using Claude, approve/disapprove, back to Claude Code to Implement and commit or re-prompt. Scary thing is that Claude Code shows the token burn count as it's chugging away.

Erm, watching your ££££ go. This is what I hate with cloud models. Not just the cost. But that they can change costs at any time, it's clear that what cloud model you run now may not be the cloud model you run in 1 mnute i.e. backend changes. I hate it. You become dependent on it like a drug dealer and then they move the goal posts. This is my main reason for enjoying the 20 quid 'near' claude experience with chat. It requires more work to setup, but i cant bitch (though I do!) for £20. But of ourse a local llm will be consistent .... models just aint quite there yet. But you know even though not out an M5 with 512gb still tempting. Really need models to catch up rather than hardware.