Pocster

SWMBO made me do some outdoor work! . Anyway welcome back to my youtube channel. Chat not very good at optimising drawcalls. We started with 50k!!!!!. Now down to 1. It needed a word. Struggling with the river at the moment. Hit that subscribe button NOW!

Welcome to my BS YouTube channel. Today we are going to create a minecraft inspired game in 10 seconds!. Hit subscribe!, it's you viewers I need! - thanks to our sponsor buildhub.org.uk.

But I expect I'll go Minecraft style!

All of 2 minutes work! 😀

v1

Though cloud tokens arent an issue for me now I use ministral mlx for fast language parse. If its a knowledge question it passes it to qwen. I suspect I'll be passing other stuff around to various models depending on the requirement. I'm having a break from that part and looking at realtime 3d scenery for the backdrop - I like my eye candy!

Oh yes!. Well as you know you get good days and bad days! Mines been epic. Massive speed increases. Local llm "whats the capital of france?" working. Current affairs " whats the news?" gives headlines and options verbally if you want more detail. Will add history so you can have a conversation. Gained a further 82ms saving on STT (I know, I know !). Honestly now its so fast to respond to even complex stuff I'm well impressed. Started on timers like Alexa (a SWMBO requirement!). TBH if I coded this by hand that's weeks of work for sure. But of course I never look at the code! G n T time now!

Chat has been SO good today I might give it a promotion - nothing to do with me spending 90 quid......

Saved another 250ms ... yeah I know. I'll stop now! sad.

WOW oh wow! Never really looked into how a LLM generates its output i.e. the cost. Assumed its just generated at the end but it isn't. It's generated as it goes ! So each token passes through the model. Never thought of that! SO! 5 seconds with a moderately complex phrase after json compaction is now 1.3 seconds! BOOM! WHO"S THE MOFO!

Really awful bug. Chat 5.5 thinking kept patching and we kept rolling back. I kept trying to think of other ways to deal with it so we can try different approaches. Been at it for 45 minutes. Rolled it back. clicked "pro" gave it all the info I could. Pro then thinking for 14 minutes!. Found a really obscure issue - MAGIC! FIXED!

Dont trust any of the AI firms.... Apparently GLM5.2 local is really good - of course hardly anyone can run it ....

After paying 90 quid even 5.5 thinking seems considerably better then before - funny that.....

I now asked it if it was legal to offer a service where I have no idea what I am getting nor for how long and yet offer of upgrade for 5x or 20x of an unknown. Its been thinking the longest I've ever seen it think!. It agrees openai could be breaching UK consumer law.

not in chat. Just asked it. You just get warnings of "near limit". So you "do something" and hope you have credit left. Anyway Pro gives me "thinking" back and of course everything is so much easier now!