Avalon local llm

[Pocster]

10 hours ago, -rick- said:

guess with the $20 gpt sub you can't access the better OpenAI models?

Yes . But also I want local for stt real time . Can’t exactly do that cloud based and integrating into a local home assistant. Or at least not in any sane way and speed .

Also lots of other things I wish to do that can only be done locally .

[Pocster]

Apple have now removed the option for buying 256gb option !

Clearly they have significant constraints on ram higher bins .

Previously it was a 6month wait until delivery , now no option .

Saving ram for m5 

[Pocster]

M4 options also reduced !

Sure new models are coming but ram shortages clearly becoming a massive issue 

[SteamyTea]

13 hours ago, Pocster said:

M4 options also reduced

The car, or the motorway?

Best to avoid.

Edited yesterday at 07:33 by SteamyTea

[Pocster]

I reckon even if I’m first off the block with an m5 ultra order of say 256gb it will still be a 10 week wait for delivery . High memory bins are a massive problem so anyone wishing more ( 512gb if they even offer it ) will be waiting months or indeed Apple jump back to “ currently unavailable “ rather than show delivery dates in excess of 6 months .

They are clearing old stock ready for new but ram shortage is going to cause a launch where essentially it becomes unavailable very quickly .

Edited 8 hours ago by Pocster

[-rick-]

You are just guessing.

 

Remember all the M5 Ultras with 256GB for the next year were likely ordered last year. The lead time for this stuff is huge. It's not made on demand like Dell putting DIMMS in your custom PC order.

[Pocster]

1 hour ago, -rick- said:

You are just guessing.

 

Remember all the M5 Ultras with 256GB for the next year were likely ordered last year. The lead time for this stuff is huge. It's not made on demand like Dell putting DIMMS in your custom PC order.

We’re all guessing ; but there are indicators .

You guess that m5 256gb were ordered last year - no evidence of that .

 

There is a ram shortage .

 

m3 ultra/ m4 mini at end of manufacture 

 

unified memory is to some extent is built to order 

 

wwdc when ultra m5 supposedly released we will see . No ram shortage effecting apple then no issues with delays . 
Limited large memory bins and delivery slips to months and then “ not available “ - clearly ram shortage having an impact .

 

My guess is that will happen . So I’ll play pessimistic rather than ram shortage doesn’t really affect Apple . 

[SteamyTea]

4 hours ago, Pocster said:

We’re all guessing

https://en.wikipedia.org/wiki/2024–present_global_memory_supply_shortage