• 🍔🍔🍔@toast.ooo
    link
    fedilink
    English
    arrow-up
    0
    ·
    3 months ago

    i am not familiar with gab, but is this prompt the entirety of what differentiates it from other GPT-4 LLMs? you can really have a product that’s just someone else’s extremely complicated product but you staple some shit to the front of every prompt?

    • elvith@feddit.de
      link
      fedilink
      English
      arrow-up
      0
      ·
      edit-2
      3 months ago

      Yeah, basically you have three options:

      1. Create and train your own LLM. This is hard and needs a huge amount of training data, hardware,…
      2. Use one of the available models, e.g. GPT-4. Give it a special prompt with instructions and a pile of data to get fine tuned with. That’s way easier, but you need good training data and it’s still a medium to hard task.
      3. Do variant 2, but don’t fine-tune the model and just provide a system prompt.
    • sushibowl@feddit.nl
      link
      fedilink
      English
      arrow-up
      0
      ·
      3 months ago

      but is this prompt the entirety of what differentiates it from other GPT-4 LLMs?

      Yes. Probably 90% of AI implementations based on GPT use this technique.

      you can really have a product that’s just someone else’s extremely complicated product but you staple some shit to the front of every prompt?

      Oh yeah. In fact that is what OpenAI wants, it’s their whole business model: they get paid by gab for every conversation people have with this thing.

      • elrik@lemmy.world
        link
        fedilink
        English
        arrow-up
        0
        ·
        3 months ago

        Not only that but the API cost is per token, so every message exchange in every conversation costs more because of the length of the system prompt.

    • Hotzilla@sopuli.xyz
      link
      fedilink
      English
      arrow-up
      0
      ·
      edit-2
      3 months ago

      Based on the system prompt, I am 100% sure they are running GPT3.5 or GPT4 behind this. Anyone can go to Azure OpenAI services and create API on top of GPT (with money of course, Microsoft likes your $$$)

    • GenderNeutralBro@lemmy.sdf.org
      link
      fedilink
      English
      arrow-up
      0
      ·
      edit-2
      3 months ago

      I don’t know about Gab specifically, but yes, in general you can do that. OpenAI makes their base model available to developers via API. All of these chatbots, including the official ChatGPT instance you can use on OpenAI’s web site, have what’s called a “system prompt”. This includes directives and information that are not part of the foundational model. In most cases, the companies try to hide the system prompts from users, viewing it as a kind of “secret sauce”. In most cases, the chatbots can be made to reveal the system prompt anyway.

      Anyone can plug into OpenAI’s API and make their own chatbot. I’m not sure what kind of guardrails OpenAI puts on the API, but so far I don’t think there are any techniques that are very effective in preventing misuse.

      I can’t tell you if that’s the ONLY thing that differentiates ChatGPT from this. ChatGPT is closed-source so they could be doing using an entirely different model behind the scenes. But it’s similar, at least.

    • Captainvaqina@sh.itjust.works
      link
      fedilink
      English
      arrow-up
      0
      ·
      3 months ago

      Gab is an alt-right pro-fascist anti-american hate platform.

      They did exactly that, just slapped their shitbrained lipstick on someone else’s creation.

      • EatATaco@lemm.ee
        link
        fedilink
        English
        arrow-up
        0
        ·
        3 months ago

        I can’t remember why, but when it came out I signed up.

        It’s been kind of interesting watching it slowly understand it’s userbase and shift that way.

        While I don’t think you are wrong, per se, I think you are missing the most important thing that ties it all together:

        They are Christian nationalists.

        The emails I get from them started out as just the “we are pro free speech!” and slowly morphed over time in just slowly morphed into being just pure Christian nationalism. But now that we’ve said that, I can’t remember the last time I received one. Wonder what happened?