Avalon local llm

[Pocster]

10 hours ago, -rick- said:

guess with the $20 gpt sub you can't access the better OpenAI models?

Yes . But also I want local for stt real time . Can’t exactly do that cloud based and integrating into a local home assistant. Or at least not in any sane way and speed .

Also lots of other things I wish to do that can only be done locally .

[Pocster]

Apple have now removed the option for buying 256gb option !

Clearly they have significant constraints on ram higher bins .

Previously it was a 6month wait until delivery , now no option .

Saving ram for m5 

[Pocster]

M4 options also reduced !

Sure new models are coming but ram shortages clearly becoming a massive issue 

[SteamyTea]

13 hours ago, Pocster said:

M4 options also reduced

The car, or the motorway?

Best to avoid.

Edited Monday at 07:33 by SteamyTea

[Pocster]

I reckon even if I’m first off the block with an m5 ultra order of say 256gb it will still be a 10 week wait for delivery . High memory bins are a massive problem so anyone wishing more ( 512gb if they even offer it ) will be waiting months or indeed Apple jump back to “ currently unavailable “ rather than show delivery dates in excess of 6 months .

They are clearing old stock ready for new but ram shortage is going to cause a launch where essentially it becomes unavailable very quickly .

Edited yesterday at 11:57 by Pocster

[-rick-]

You are just guessing.

 

Remember all the M5 Ultras with 256GB for the next year were likely ordered last year. The lead time for this stuff is huge. It's not made on demand like Dell putting DIMMS in your custom PC order.

[Pocster]

1 hour ago, -rick- said:

You are just guessing.

 

Remember all the M5 Ultras with 256GB for the next year were likely ordered last year. The lead time for this stuff is huge. It's not made on demand like Dell putting DIMMS in your custom PC order.

We’re all guessing ; but there are indicators .

You guess that m5 256gb were ordered last year - no evidence of that .

 

There is a ram shortage .

 

m3 ultra/ m4 mini at end of manufacture 

 

unified memory is to some extent is built to order 

 

wwdc when ultra m5 supposedly released we will see . No ram shortage effecting apple then no issues with delays . 
Limited large memory bins and delivery slips to months and then “ not available “ - clearly ram shortage having an impact .

 

My guess is that will happen . So I’ll play pessimistic rather than ram shortage doesn’t really affect Apple . 

[SteamyTea]

4 hours ago, Pocster said:

We’re all guessing

https://en.wikipedia.org/wiki/2024–present_global_memory_supply_shortage

[Pocster]

14 hours ago, SteamyTea said:

https://en.wikipedia.org/wiki/2024–present_global_memory_supply_shortage

Ram shortage is real . Every single report suggests it of course does affect Apple . The question is how much …. I think as you can tell it’s going to be bad 

[SteamyTea]

1 hour ago, Pocster said:

affect Apple

Crapple pride themselves on the quality of their software, so they need to develop less memory hungry applications.

If the can't, it just confirms what we all knew, all along.

[Pocster]

5 hours ago, SteamyTea said:

Crapple pride themselves on the quality of their software, so they need to develop less memory hungry applications.

If the can't, it just confirms what we all knew, all along.

Windows slut !

[-rick-]

5 hours ago, SteamyTea said:

Crapple pride themselves on the quality of their software, so they need to develop less memory hungry applications.

If the can't, it just confirms what we all knew, all along.

 

Thought Apple tended to be quite efficient memory wise. The Macbook Neo with only 8GB is getting rave reviews and appears perfectly capable of average user usage (not specialised apps though).

[SteamyTea]

22 minutes ago, Pocster said:

Windows slut

I keep the curtains open.

 

2 minutes ago, -rick- said:

Macbook Neo with only 8GB

Is that all it has, my phone has that much.

[-rick-]

1 minute ago, SteamyTea said:

Is that all it has, my phone has that much.

 

It's basically an iPhone 16 in a laptop case. Apart from the limited USB ports it appears to be a significantly better buy than similar priced windows laptops.