Bay 12 Games Forum

Please login or register.

Login with username, password and session length
Advanced search  
Pages: 1 [2]

Author Topic: Why the invasion of the internet by GPT-4 bots could actually be COOL  (Read 1216 times)

jipehog

  • Bay Watcher
    • View Profile
Re: Why the invasion of the internet by GPT-4 bots could actually be COOL
« Reply #15 on: March 30, 2023, 01:41:08 am »

All of us can afford to run one consumer LLM (look at this sub and find people squeezing GPT-4 level performance out of casualer LLM's)
I'm just confused at this statement.
What?
LLM = language model neural network
I get that.
I’m just baffled by the assertion that GPT-4 quality can be ‘squeezed out’ by a consumer LLM (??? Kobold? Pygmalion?)
Like what?

Have a look at r/singularity. There's apparently a whole lot of tricks being used now.

What sort of new tricks?

Also what is Kobold and Pygmalion ?
Logged

TamerVirus

  • Bay Watcher
  • Who cares
    • View Profile
Re: Why the invasion of the internet by GPT-4 bots could actually be COOL
« Reply #16 on: March 30, 2023, 07:36:09 am »

Kobold and Pygmalion both refer to a series of open source LLM of various size.

Kobold: github (Many different models for different uses)
Pygmalion: Huggingface (New on the scene. Their 6B model is chat focused, but janky.)

Developments in the AI world are fast and furious, so discussion of consumer level LLM has shifted in finding ways to fine tune Meta’s llama model. (Stanford’s fine tune called Alpaca has gotten a lot of interest)
Logged
What can mysteriously disappear can mysteriously reappear
*Shakes fist at TamerVirus*
Pages: 1 [2]