Avalon local llm

[Pocster]

My other thread “ voice control “ is bollocks 

 

Anyone looked at how these work ? (expletive deleted)ing amazing ! . I mean what a LLM does engineering wise !

Been reading non stop all weekend!

The possibilities are mind boggling .

Local llm is going to be insane ….

 

I’m so excited ! (expletive deleted) me ! Couple this with multiple microphone arrays . Jesus !

 

Stay tuned for insanity and “ Wow (expletive deleted) me “ moments . Nerds only need respond to this thread others can (expletive deleted) about with dpc and which happy meal to order .

 

Edited February 15 by Pocster

[SteamyTea]

15 minutes ago, Pocster said:

Been reading non stop all weekend

Is your finger sore from tracing the words and your lips still moving.

 

Will this latest LLM make you a better girlfriend that will indulge all your pervy fantasies.

[Pocster]

4 hours ago, SteamyTea said:

Is your finger sore from tracing the words and your lips still moving.

 

Will this latest LLM make you a better girlfriend that will indulge all your pervy fantasies.

Yes and yes 

[Pocster]

M5 soonish . But marginal gain ? Price hikes because of inflated ram costs ?

2nd or “ opened but never used “ m3 ultra on ebay .

What do we prioritise ?

 

ram , gpu , cpu 

 

64gb good - but more is better for larger models 

 

newer architecture ( m4 latest ) give a performance boost at a cost 

 

gpu more cores 

 

oh ! Apple have finance options …. That’s trouble . I won’t look …. 0% finance upto 12 months , or 4.9% for longer . That’s pretty low interest . I won’t look 

 

I’m not looking 

 

Could order . Then if m5 “ better “ relative to cost could cancel 

 

I won’t look

 

looked , ordered !

[Pocster]

Tested uma8 . Really good . Sensitive enough and direction of speech can be retrieved .

[Pocster]

Global ram shortages biting badly due to AI server rush .

Decided go big or go home ( a man behind back of a pub said that to me once ) .

512gb got to be! ; if available . Roll on April 1st ( Apple 50th ) or wwdc ( early June ) 

[-rick-]

Just now, Pocster said:

Global ram shortages biting badly due to AI server rush .

Decided go big or go home ( a man behind back of a pub said that to me once ) .

512gb got to be! ; if available . Roll on April 1st ( Apple 50th ) or wwdc ( early June ) 

 

Mac Studio M5 Ultra 512G when it's announced? That's a mighty big hole in your pocket!

[Pocster]

1 minute ago, -rick- said:

 

Mac Studio M5 Ultra 512G when it's announced? That's a mighty big hole in your pocket!

I know ! I know !

But I’m planning a 5 yr project .

The thing is I could go less say 128gb or 256gb but …. If that becomes a limitation I’m going to be real pissed . So I decided get something that in theory can’t be limited except by my ability rather than hardware .

 

[-rick-]

1 minute ago, Pocster said:

I know ! I know !

But I’m planning a 5 yr project .

The thing is I could go less say 128gb or 256gb but …. If that becomes a limitation I’m going to be real pissed . So I decided get something that in theory can’t be limited except by my ability rather than hardware .

 

 

Cost of that Mac will pay for 5 years of Codex pro which I'm hearing is much much more efficient than Claude Opus 4.6 so could get an awful lot done with it plus can always move subscription if something better comes along.

 

As someone who has traditionally loved playing with hardware seeing what Alex Zsikind* and others are doing is making me envious. But then I think 'What would I actually do with any of this stuff?' and the answer is just play around and not much more.

 

 

[Pocster]

1 minute ago, -rick- said:

 

Cost of that Mac will pay for 5 years of Codex pro which I'm hearing is much much more efficient than Claude Opus 4.6 so could get an awful lot done with it plus can always move subscription if something better comes along.

 

As someone who has traditionally loved playing with hardware seeing what Alex Zsikind* and others are doing is making me envious. But then I think 'What would I actually do with any of this stuff?' and the answer is just play around and not much more.

 

 

lol yeah I’ve watch his videos .

But ! I’m not just using local llm to write code ; the house will be controlled via realtime local llm ! . Ever watched the film with Julie Andrews ? Not the sound of (expletive deleted)ing music !! Demon Seed …

[-rick-]

4 minutes ago, Pocster said:

But ! I’m not just using local llm to write code ; the house will be controlled via realtime local llm ! . Ever watched the film with Julie Andrews ? Not the sound of (expletive deleted)ing music !! Demon Seed …

 

Not watched it, but just skimmed the wiki page.

 

Backing away now ............ 🫥

[SteamyTea]

12 minutes ago, Pocster said:

Julie Andrews

Or Christie.

 

Read the book decades ago.

[Pocster]

1 minute ago, SteamyTea said:

Or Christie.

 

Read the book decades ago.

Oops yes ! . wtf was I on . Anyway if anyone wants to build a machine to impregnate with an AI hybrid life form I’m more than up for that .

[SteamyTea]

9 minutes ago, Pocster said:

Oops yes

Both very (expletive deleted)able back in the day.

[Pocster]

49 minutes ago, SteamyTea said:

Both very (expletive deleted)able back in the day.

Datable ?

[SteamyTea]

18 minutes ago, Pocster said:

Datable ?

Wine, dine and 69

[Pocster]

Gave up . M5 ultra who knows when ! Probably wwdc . But try ordering a 256gb m3 ultra now … delivery august!

Ram delays crippling everything .

So decided to buy a stop gap after a few failed attempts on eBay I.e paid ; then eBay refund as scam / issue . Found stock at believe it or not curry’s - but only the m3 ultra 96gb - so that arrives tomorrow.

[-rick-]

18 minutes ago, Pocster said:

Gave up . M5 ultra who knows when ! Probably wwdc . But try ordering a 256gb m3 ultra now … delivery august!

Ram delays crippling everything .

 

Not entirely sure this particular thing is ram delays. Huge amount of media coverage of using high ram m3 ultras for AI recently and I'm sure there were a flood of people buying them. With Apples soldered on RAM it's not trivial to make more systems when you get a sudden surge (even if you have the chips), especially if the production line is currently focussed on churning out m5 ultras ready for launch.

[Pocster]

5 hours ago, -rick- said:

 

Not entirely sure this particular thing is ram delays. Huge amount of media coverage of using high ram m3 ultras for AI recently and I'm sure there were a flood of people buying them. With Apples soldered on RAM it's not trivial to make more systems when you get a sudden surge (even if you have the chips), especially if the production line is currently focussed on churning out m5 ultras ready for launch.

Global ram demand for hi bins ; nvidia etc . Not easy for Apple that’s sure . 96gb I’ll be ok with . Ram shortage set to continue until 2027 maybe 2028 until new production comes online . Can you all stop using chat and Claude please !

[-rick-]

19 minutes ago, Pocster said:

Global ram demand for hi bins ; nvidia etc . Not easy for Apple that’s sure . 96gb I’ll be ok with . Ram shortage set to continue until 2027 maybe 2028 until new production comes online . Can you all stop using chat and Claude please !

 

News over the last few days has been that OpenAI (and others) have been pulling back their Ram orders (they signed letters of intent not actual orders). They always ordered too much to be able to use (can't build datacentres fast enough).

 

Apple signs very long term contracts for memory and has been able to avoid a lot of problems hitting others. Apples prices may go up but I doubt they will experience a significant shortage (no manufacturer wants to piss off one of the largest single buyers out there who is willing to sign longer term deals). All the memory manufacturers have been through plenty of boom-bust cycles and are trying hard to avoid the same this time (and thus aren't building much new capacity).

[Pocster]

3 minutes ago, -rick- said:

 

News over the last few days has been that OpenAI (and others) have been pulling back their Ram orders (they signed letters of intent not actual orders). They always ordered too much to be able to use (can't build datacentres fast enough).

 

Apple signs very long term contracts for memory and has been able to avoid a lot of problems hitting others. Apples prices may go up but I doubt they will experience a significant shortage (no manufacturer wants to piss off one of the largest single buyers out there who is willing to sign longer term deals). All the memory manufacturers have been through plenty of boom-bust cycles and are trying hard to avoid the same this time (and thus aren't building much new capacity).

Current delivery on high ram bins is 5 months + 

The ram shortage is effecting Apple now let alone before new hardware appears .

Edited 1 hour ago by Pocster

[-rick-]

2 minutes ago, Pocster said:

Current delivery on high ram bins is 5 months + 

The ram shortage is effecting Apple now let alone before new hardware appears .

 

Source please?

 

I've seen the 9to5mac story which doesn't really say anything.

 

Remember Mac Studio uses different RAM from any typical AI server (or desktop PC). Completely different silicon die. Apple is likely the only company ordering high capacity ICs of the type used in the Mac Studio. I think in this specific case they have sold out of their pre-manufacturered supply of these skus and have redirected manufacture to the m5 rather than the RAM shortage overall.

 

Assuming they are going to announce a M5 Ultra at WWDC, pushing the orders out 5 months gives them room to announce the M5 Ultra (with delivery in August/Sept) and then go to all the people who ordered the M3 Ultra 'Oh, we have a new model now, do you want that instead?'