Avalon local LLM

[SimonD]

13 hours ago, Pocster said:

Tried some different local models not good enough still. So got chat to optimise its prompt for codex . Also harness has a marker that chat must fill in such as simple repo scout , deep repo scout , patch failure etc . So that influences the codex prompt . Hopefully to reduce token burn  especially on the scout repo , patch , patch fails , repeat loop.

 

Where do you find the time to squeeze all this in?

[Pocster]

Just now, SimonD said:

 

Where do you find the time to squeeze all this in?

By not finishing the house 👍

[SimonD]

2 hours ago, Pocster said:

By not finishing the house 👍

Tell me about it. Downstairs I've got a partially finished bathroom and every time I walk in there, I'm thinking (expletive deleted) this is boring, I'll go and do something else instead. Having not been in tech developing systems for over 20 years, I'm really enjoying getting back into it, so yet another more fun distraction.

[Pocster]

2 minutes ago, SimonD said:

Tell me about it. Downstairs I've got a partially finished bathroom and every time I walk in there, I'm thinking (expletive deleted) this is boring, I'll go and do something else instead. Having not been in tech developing systems for over 20 years, I'm really enjoying getting back into it, so yet another more fun distraction.

Man after my own heart!. All this is MUCH more fun!

[Pocster]

It's on one today. Ignoring pratically everything. I did read that maybe they 'cripple' current version before next release so we all think it's better!

[SimonD]

42 minutes ago, Pocster said:

It's on one today. Ignoring pratically everything. I did read that maybe they 'cripple' current version before next release so we all think it's better!

I think it's hilarious. They must be doing something like that to get us to upgrade. I had an argument the other day. 3 times I had to tell it to listen to me, still ignored me. Then full caps exclamation mark - STOP!!!! you are not listening to me! You have completely ignored my instruction to........ Now listen and do what I say...... 

 

This was all because it got an equation the wrong way round and carried on trying to write it into the code base!

But then this morning I notice a bug - and it produces the diff perfectly and within 5 min I'm back to normal. It was a bit lazy mind as it didn't redraft the whole script instead giving me line number reference so I could stitch it in.

Do you often get a response that what you've asked for isn't urgent and can wait? I then say no, it needs to be done and why and then it goes, oh yes, great rationale, now is absolutely the right time for this change before development goes too far as it'll take more effort later and be very complex to resolve the issue!

It's like dealing with a toddler!

[Pocster]

Oh yes. Today it cant do a simple patch. 8th attempt now! I swear at it and it does say "Yes I am a xxxxx". But like you sometimes it's like a dream and everything goes through. Bearing in mind I look at zero code so I have a very tight framework. Luckily this is all on local llm repo with chat doing (or not) the patches. So very little codex token burn today!