Avalon local llm

[Pocster]

My other thread “ voice control “ is bollocks 

 

Anyone looked at how these work ? (expletive deleted)ing amazing ! . I mean what a LLM does engineering wise !

Been reading non stop all weekend!

The possibilities are mind boggling .

Local llm is going to be insane ….

 

I’m so excited ! (expletive deleted) me ! Couple this with multiple microphone arrays . Jesus !

 

Stay tuned for insanity and “ Wow (expletive deleted) me “ moments . Nerds only need respond to this thread others can (expletive deleted) about with dpc and which happy meal to order .

 

Edited February 15 by Pocster

[SteamyTea]

15 minutes ago, Pocster said:

Been reading non stop all weekend

Is your finger sore from tracing the words and your lips still moving.

 

Will this latest LLM make you a better girlfriend that will indulge all your pervy fantasies.

[Pocster]

4 hours ago, SteamyTea said:

Is your finger sore from tracing the words and your lips still moving.

 

Will this latest LLM make you a better girlfriend that will indulge all your pervy fantasies.

Yes and yes 

[Pocster]

M5 soonish . But marginal gain ? Price hikes because of inflated ram costs ?

2nd or “ opened but never used “ m3 ultra on ebay .

What do we prioritise ?

 

ram , gpu , cpu 

 

64gb good - but more is better for larger models 

 

newer architecture ( m4 latest ) give a performance boost at a cost 

 

gpu more cores 

 

oh ! Apple have finance options …. That’s trouble . I won’t look …. 0% finance upto 12 months , or 4.9% for longer . That’s pretty low interest . I won’t look 

 

I’m not looking 

 

Could order . Then if m5 “ better “ relative to cost could cancel 

 

I won’t look

 

looked , ordered !

[Pocster]

Tested uma8 . Really good . Sensitive enough and direction of speech can be retrieved .

[Pocster]

Global ram shortages biting badly due to AI server rush .

Decided go big or go home ( a man behind back of a pub said that to me once ) .

512gb got to be! ; if available . Roll on April 1st ( Apple 50th ) or wwdc ( early June ) 

[-rick-]

Just now, Pocster said:

Global ram shortages biting badly due to AI server rush .

Decided go big or go home ( a man behind back of a pub said that to me once ) .

512gb got to be! ; if available . Roll on April 1st ( Apple 50th ) or wwdc ( early June ) 

 

Mac Studio M5 Ultra 512G when it's announced? That's a mighty big hole in your pocket!

[Pocster]

1 minute ago, -rick- said:

 

Mac Studio M5 Ultra 512G when it's announced? That's a mighty big hole in your pocket!

I know ! I know !

But I’m planning a 5 yr project .

The thing is I could go less say 128gb or 256gb but …. If that becomes a limitation I’m going to be real pissed . So I decided get something that in theory can’t be limited except by my ability rather than hardware .

 

[-rick-]

1 minute ago, Pocster said:

I know ! I know !

But I’m planning a 5 yr project .

The thing is I could go less say 128gb or 256gb but …. If that becomes a limitation I’m going to be real pissed . So I decided get something that in theory can’t be limited except by my ability rather than hardware .

 

 

Cost of that Mac will pay for 5 years of Codex pro which I'm hearing is much much more efficient than Claude Opus 4.6 so could get an awful lot done with it plus can always move subscription if something better comes along.

 

As someone who has traditionally loved playing with hardware seeing what Alex Zsikind* and others are doing is making me envious. But then I think 'What would I actually do with any of this stuff?' and the answer is just play around and not much more.

 

 

[Pocster]

1 minute ago, -rick- said:

 

Cost of that Mac will pay for 5 years of Codex pro which I'm hearing is much much more efficient than Claude Opus 4.6 so could get an awful lot done with it plus can always move subscription if something better comes along.

 

As someone who has traditionally loved playing with hardware seeing what Alex Zsikind* and others are doing is making me envious. But then I think 'What would I actually do with any of this stuff?' and the answer is just play around and not much more.

 

 

lol yeah I’ve watch his videos .

But ! I’m not just using local llm to write code ; the house will be controlled via realtime local llm ! . Ever watched the film with Julie Andrews ? Not the sound of (expletive deleted)ing music !! Demon Seed …

[-rick-]

4 minutes ago, Pocster said:

But ! I’m not just using local llm to write code ; the house will be controlled via realtime local llm ! . Ever watched the film with Julie Andrews ? Not the sound of (expletive deleted)ing music !! Demon Seed …

 

Not watched it, but just skimmed the wiki page.

 

Backing away now ............ 🫥

[SteamyTea]

12 minutes ago, Pocster said:

Julie Andrews

Or Christie.

 

Read the book decades ago.

[Pocster]

1 minute ago, SteamyTea said:

Or Christie.

 

Read the book decades ago.

Oops yes ! . wtf was I on . Anyway if anyone wants to build a machine to impregnate with an AI hybrid life form I’m more than up for that .

[SteamyTea]

9 minutes ago, Pocster said:

Oops yes

Both very (expletive deleted)able back in the day.

[Pocster]

49 minutes ago, SteamyTea said:

Both very (expletive deleted)able back in the day.

Datable ?

[SteamyTea]

18 minutes ago, Pocster said:

Datable ?

Wine, dine and 69