ES version is available. Content is displayed in original English for accuracy.
Advertisement
Advertisement
⚡ Community Insights
Discussion Sentiment
68% Positive
Analyzed from 2530 words in the discussion.
Trending Topics
#generated#search#llm#own#perplexity#llms#claude#training#something#research
Discussion (73 Comments)Read Original on HackerNews
1. For a given company, analyze their target audiences and the questions they are likely to ask LLMs about.
2. For each such question, ask it to each of the major LLMs, and compute the KL divergence between the pages they want to rank for the question vs. the LLM's response.
3. Rewrite the article to minimize said KL divergence.
In effect, they're performing an iterative optimization of some sort that moves the embedding space of their article closer to the question asked to the LLM, and any embedding model or generated responses are going to prefer said responses over others.
I believe we will keep seeing more of this stuff.
Let's hope the LLM model continues to be paying for credits, because any that move to ad revenue will become useless for real work.
Not really. A while ago there was a news piece stating that Israel was behind a series of fake think-tanks with very accessible websites which were created with the express purpose of feeding AI agents with alternative facts aligned with their foreign policy.
If anyone has the link at hand, please post it.
0: https://en.wikipedia.org/wiki/Generative_engine_optimization
https://developers.openai.com/api/docs/guides/tools-web-sear...
In general I don’t find models to be good at evaluating the quality of a source :(
I am sure most humans would pick code written in their style, too.
Makes sense to me, in that its own output would align closer to its own training set
Interesting. For me I've noticed it tends to do the opposite.
If you hate AI writing enough, this turns AI filters into a kind of humiliation ritual. AI will derank normal business writing for human readers, and uprank inflated, verbose, tic-heavy slop. So you have to put the heavy slop out with your name on it. Really perverse moment.
...is not the same as claiming...
> LLMs favor LLM-generated passages over human written ones
Here, you're using the same LLM to both produce and judge the resulting work. If anything, I would expect an LLM to tend to prefer its own work given that the same training is producing and judging.
Perhaps something like: learning to identify what source files it has worked on by the code style alone, because tasks may give human code (public repos, etc) and ask to make changes.
I was traveling to an obscure small town, doing some "research" with LLMs beforehand. Every and each one told me enthusiastically to go to "Foobar square" (name changed) for the "best street food in XYZ town", some added a lot of colorful details.
There was no Foobar square in XYZ town. There was no Foobar square anywhere in the world. There was a SINGLE old Reddit comment, with no upvotes, to a unpopular post in an unpopular subreddit, where someone clearly badly misspelled the name of the square, and said something like "for street food go to Foobar square". Nothing about "the best" even.
It's all a lie.
It was all done as a joke to see if they could get Gemini or ChatGPT to start recommending it.
Then they started optimizing for speed of responses over quality of results. I can enter a query and see my results appear in a second, but they’re garbage. The links and references it gives frequently don’t match the text right next to them. It feels like someone had a KPI to make responses as fast as possible and they optimized for that above all else.
They added a “Computer” option that’s supposed to do research for you. Half the time I can’t get it to trigger through the UI. Pressing the submit button doesn’t work. When I can get it to trigger, most of those sessions will work for a while and then just stop before an answer comes back.
The only reason I keep using it is to keep observing a company that has been heavily marketed and hyped, which should have had a market leading position for something. Even non-technical people I know who listen to Joe Rogan (where Perlexity is advertising heavily, I’m told) are asking me about it.
Now there are reports of people being billed at the end of their trial period without warning, despite them saying that they will warn before this happens. There are some alarmingly bad customer support screenshots where the customer support agent (AI? Probably) acknowledges that they didn’t send the email they promised but refuse to help anyway. It takes escalating it on Twitter to get it corrected.
If I want to do actual research or AI assisted web searching I have Claude or ChatGPT do it. The results are so much higher quality and it does exactly what I ask. It may take 45 seconds instead of the instant response from Perplexity but I save time overall because the response and links are more likely to be correct
I think they probably damaged themselves by going for a land grab of user base through freebies. It meant the users weren’t ever going to convert to paid customers, so it was more to show investors that they had a user base. But, with an increased base of users who weren’t paying, it then meant they needed to find either new revenue streams or cheaper ways to provide the service. Unfortunately, it seems they went with the new revenue streams whilst also decreasing the functions paying members were able to access (something I find quite abhorrent- I paid a service level, but then they change what I receive mid-subscription). And then computer - rammed down my throat. One reason I pay for pro is to stop the nagging noise of paid tiers. And instead, they actually created a way of logging in and continually seeing gated functions.
So, after paying them upwards of $400-$500 and being a loyal customer, I walked.
I would draft a development plan with Claude on there, then feed it to Claude Code. This isn't sustainable, but given that I had x number of months pre-paid for, I just used it.
[1] https://www.newsbiscuit.com/post/ouroboros-unclear-if-it-s-e...
Why only test Perplexity...? Isn't it the least popular among these?
Is there nothing out there that does this? I'm paying for kagi and I can see that it has an api, is that maybe sufficient if configured properly?
Will we get to a point where AI-generated sites make up a majority of the internet, and LLMs are training upon their own regurgitations, with exponential amplification of all their lies and flaws?
Or will the pre-2022 corpus human knowledge be considered the low-background steel standard, and anything after that less and less reliable unless certified that it has been created by a human mind and untainted by hallucinations?
You're talking about a scenario that won't blow itself up in the next few quarters, so it's of no interest to them.
-when you read one statement that let's you know to believe no other assertions in the article....
I've seen an extremely aggressive uptick in API key requests and sales that I'm not sure where it's coming from. Like it's up 5x over the summer. Been a bit confused about this since I do basically zero traditional marketing or SEO, but I think it's AI search tools that's suggesting my services.
Anyway, it's over for Perplexity. They never had a great a product and the only reason for using them, was when they offered Pro accounts for free. Many people joined. Me included. But with a "meh" product and the general AI business not being very sticky, they lost quite harshly.
I thought they might be able to make money as a search api/index, but this article closed the book.
The home page for this "independent research firm" is also 100% nonsense [1]. "The record a machine reads is not the one a company writes.". Ironically this low-effort spam is exactly what this report warns about, and does not belong in HN - or anywhere else.
[1] https://trellner.com/
And very impressive list of angels too: Guillermo Rauch (Vercel), Karim Atiyeh (Ramp), Andrew Karam (AppLovin) among others
Last I heard they're trying to reposition from AEO/GEO to "AI Marketer". No clue how that's going, I feel like the AEO/GEO stuff isn't super defensible at that valuation if for no other reason than I assume (hope) the spamming stops working.
[1] https://dealroom.co/news/126181-profound-raises-96m-at-1b-va...