Running LLMs at home, some Taylor Swift tests

On my Macbook, I installed Ollama (it’s very easy to do this, takes 5 minutes to set up) and tried a few Deepseek versions – 32b (20GB), 7b (5GB), 1.5b (1GB).

The query was just “taylor swift top literary works”

32GB — after about 17 hours, here’s what it mustered for the query —

7b did a lot better, or at least faster. It took 1 min. But the answer is horrible. Lots of nonsense in there. There is not a memoir, and there are no 1990s albums, or songs called “we R U overpriced” (literally a rare zero-results google search).

Of course, in only 2 seconds the 1.5b model spit this out, and it’s all made up – a great example of hallucinations. But it gets something subtly right. Some subject matters are the kinds of things her songs are about (though not race…):

Leave a Reply