grahamsz

@deborahh@mstdn.ca @FeralRobots@mastodon.social @NewtonMark@eigenmagic.net very true, I can't imagine how they stop it from telling you what your boss thinks of you

@FeralRobots@mastodon.social @NewtonMark@eigenmagic.net I think you could reasonably fine tune an LLM on a per-customer basis. I'd personally like our slack search to work better and thing that could be a really compelling business tool. But I've already opted our company out from the general models, because I can't see how it won't share at least some data.

@FeralRobots@mastodon.social @NewtonMark@eigenmagic.net You can definitely fine-tune a pre-trained GPT model pretty cost-efficiently. Considering my mid-size company spends 5 figures a year on slack I expect they can afford it. Though I suspect if it's any good there will be a hefty upcharge for it.

@FeralRobots@mastodon.social @NewtonMark@eigenmagic.net Fine-tuning will definitely stop stuff coming up in other people's results, because you make an extra layer over the existing model with new weights. You also maybe wouldn't even need that, you could use an embedding model to place each conversation into a high dimensional space, then when you ask a question of the model it searches all relevant conversations to build a better prompt. For a lot of use cases i think that could work just fine.

@wikipedia@wikis.world My employer uses ONE to ship a bunch of stuff and they have a literal ship of Theseus https://www.vesselfinder.com/vessels/details/9356701