Back to News
Advertisement
Advertisement

⚡ Community Insights

Discussion Sentiment

67% Positive

Analyzed from 569 words in the discussion.

Trending Topics

#papers#journals#research#reviewing#should#never#open#read#automating#humans

Discussion (15 Comments)Read Original on HackerNews

nneonneoabout 1 hour ago
At this point, in the field of AI research:

- papers are written by AI (as pointed out in this article, and as obvious to anyone who spends a while actually reading recent AI research)

- papers are reviewed by AI (NeurIPS is doing an AI assisted review experiment - https://neurips.cc/Conferences/2026/ai-reviewing-experiment - and I feel the trend is moving towards AI reviewers whether we like it or not)

- papers are read, summarized and digested by AI, because there are just so many papers at leading AI conferences that nobody has time to eyeball them all

We are very rapidly automating humans out of the academic publication loop here.

jsrozner15 minutes ago
Idk if we're automating humans out of the publishing loop as much as rapidly automating the production of crap. I had a very similar experience reviewing for EMNLP recently.

We are nowhere near AI being able to judge the quality of research (in fact, one might reasonably state that even most humans can't really judge the quality of research). Most things in society are not like math: we can't automate (via verification) our way out of noise overwhelming the signal.

Folks are willing to entirely abuse the public resource that is faithful, honest reviewing. (This is unsurprising; the abuse of the commons / public resources has been rising for a long time). There isn't a good solution other than something akin to draconian social scoring to limit access to the reviewing system.

strictneinabout 1 hour ago
We just need journals run by an AI that charges other AI to read them, and then the AI run colleges can promote the AI with the most AI journal entries and citations.
conception38 minutes ago
Benchmaxxing is already here. No need to pine for the future!
dwaltrip18 minutes ago
Unless someone has discovered some magic sauce for getting AI to write well, I have immense sympathy for anyone trying to wade through these papers.

I may generate slop from time to time, but I do my best to keep it to myself.

kingstnap32 minutes ago
https://arxiv.org/stats/monthly_submissions

They should consider swapping this for a log plot.

I can imagine in 2027 academia looking like Moltbook.

dghlsakjg37 minutes ago
This is a side effect of academia never taking open accessibility to papers and journals seriously.

If all these papers were not gatekept by journals, it would be trivially easy to validate at least the existence of cited papers and quotes.

crote9 minutes ago
Validating existence should already be trivial: virtually all journal already have publicly-available indices which contain at least author information and an abstract. Combine that with DOI citations and you're basically done - even with closed-access journals.

Checking the content is of course a lot more difficult, but that doesn't magically become trivial with open-access journals: you still need to read and interpret what is being said in the paper and compare it to the claims being made in the citation. Granted, these days you could use AI for a first pass, but it's still going to be incredibly tedious work.

WarOnPrivacy14 minutes ago
> This is a side effect of academia never taking open accessibility to papers and journals seriously.

From my perspective, it's a clear manifestation of humanity's most pervasive failing - the one that defines every group, eventually.

    No One Anywhere Wants To Clean Their Own House.
touisteur10 minutes ago
And yet the automation we pour trillions in, is the one that will do anything, including everything I find interesting and will never clean my own house.
nhinck218 minutes ago
It is trivially easy to validate the existence of a cited paper.
jsrozner14 minutes ago
I'm sympathetic to the idea: we should have an open, publicly queryable citation graph. Google scholar could very easily offer this at marginal cost near zero, but they won't.
tolugenius17 minutes ago
> Both papers were accepted for oral presentations with the condition that they simply fix the hallucinated references.

I do wonder what truthfully could be on ai verification, if even one paper with such an error is accepted it sets the precedent you hopefully get lucky to not get caught (then again verifying for basic tells isn't the same verifying is this genuinely a worthwhile publication, but that's a separate matter)

DarkUranium35 minutes ago
I feel like this should be treated as, and have consequences similar to, plagiarism.

Alas, it's probably just wishful thinking on my part.

jsw9714 minutes ago
"A lot of the content of this blog was initially drafted by an agent of some sort"

What? I mean who does this. My voice is my voice and it's literally never occurred to me to have an LLM do a first draft. I thought that was college kid stuff.