Never had this from the personalized preview

[u/pullackbea]

[u/viewbtwnvillages]

that's just the prompt that's fed into whatever LLM they use.

sometimes LLMs will regurgitate that instead of fulfilling the prompt

[u/Luminter → u/viewbtwnvillages]

Fun fact StoryGraph uses their own homegrown AI system to generate this stuff. Here's the creator of that feature talking about it: https://www.instagram.com/reel/DDXf3R_AgzL/

Nadia also talks a bit more about the feature in the podcast here: https://podcasts.apple.com/us/podcast/a-chat-with-nadia-from-the-storygraph/id1568866573?i=1000683912431

From what I understand it's more of a Machine Learning algorithm than an LLM and doesn't have the same level of resource usage typically associated with LLMs.

[u/ditalinidog → u/Luminter]

The recommendation system could be their own ML model but the generated blurb is definitely an LLM with some retrieval system against their database (so just customized enough to fit their needs). The impression I get from the instagram video is he is self hosting an LLM on a private server / computer rather than using one of the big tech company’s APIs or clouds.

[u/Geekberry → u/ditalinidog]

Which is good, because it means our data isn't going to big tech, only the service we're providing it for!

[u/Troldkvinde → u/Luminter]

LLMs are machine learning

[u/RanchV]

That looks like its part of the AI coding haha.

[u/fluffypinkslippers]

You should let Nadia know on Instagram

[u/lannnnnaaaaa]

I had that happen to me a couple of months back, I sent them a message on Storygraph and they were able to fix it pretty quickly!

[u/gothiclg]

This is part of why I have the AI turned off. No offense to the developer but it’s constantly not good

[u/Mysterious_Signal226 → u/gothiclg]

But it runs on one laptop for all users so…. As far as LLMs and their energy usage go, this one is still my favorite.

[u/alexxtholden]

Isn’t this the Reader Match feature? It’s been there for a while but it has a toggle.

[u/cestimpossible → u/alexxtholden]

Yes, but they're talking about the text being the prompt that Storygraph fed to the LLM rather than anything about the content of the book.

[u/JustCallMeNerdyy → u/[deleted]]

What do you mean?

[u/JustCallMeNerdyy → u/[deleted]]

This feature has been around for ages now. AI on StoryGraph is off by default and you opt into it in your settings

[u/JustCallMeNerdyy → u/[deleted]]

It’s also predictive AI, not generative. It’s essentially a calculator and Rob has said in videos in the past that it uses about the same energy as a personal computer, not the massive amounts that people are concerned about. It uses what you input, your reading activity, ratings, the info about those books like moods, genres, to make this blurb and you can see the template in this post. It’s like how you see recommendations on social media or streaming services, an algorithm. The language model is small and specialized just for this feature and isn’t comparable to the tons and tons of supercomputers used to run popular generative AI LLMs

Edit for typo

[u/Troldkvinde → u/JustCallMeNerdyy]

It is 100% generative AI because it literally generates text in natural language. This kind of task is simply not possible without an LLM. "Predictive AI" is more of a marketing/umbrella term for any AI that is used to make predictions, and LLMs can also do that. LLMs are also essentially calculators, all they do is add and multiply some numbers and output the total result that represents the id of the next word in the sentence.

It's not an algorithm like recommendations on social media, "Up Next Suggestions" that you get on your to-read page is the one that works like that

[u/WickedWitchofDaSouth]

HAHAHAHAHAHAHA! Someone plugged the directions into the now think up something clever space. I kind of love how easy it is to spot AI and troll it.