F
23

Trying to get a local AI model to stop saying 'as an AI language model' took me 3 days

I was fine-tuning a Llama 2 model on my own PC to help write product descriptions, but it kept starting every answer with that phrase. I tried adjusting the training data, the prompts, everything. It took me about 72 hours of messing with the parameters before I finally got it to act like a normal copywriter. Has anyone else had a model get stuck on a specific phrase like that?
4 comments

Log in to join the discussion

Log In
4 Comments
aaron_mitchell
Had a model stuck on "in conclusion" for days. Adding more varied examples in the training data and tweaking the repetition penalty finally broke the habit.
4
bennett.harper
Honestly "as an AI language model" sounds like its own personal brand at this point.
1
alicecraig
alicecraig13d ago
Can we get @bennett.harper a merch deal for that brand?
8
murray.cora
That phrase is a necessary legal disclaimer though.
5