Knowledge Distillation of Black-Box Large Language Models

dmezzetti•15 minutes ago

Well-Read Students Learn Better: On the Importance of Pre-training Compact Models

Related paper that's a good read: https://arxiv.org/abs/1908.08962

Alifatisk•about 2 hours ago

Why is this published again? Is this a reference to recent events?

babelfish•about 1 hour ago

I just saw some post about it on Threads and found it interesting so decided to share!

linolevan•about 2 hours ago

Can we note that this is a 2024 paper in the title?

duendefm•about 2 hours ago

The Chinese are really going strong on destroying the American AI economy bubble. Honestly, despite the fact that I'm totally pro USA and anti China, I think we should help them crashing the American AI bubble. They are controlling everything and we can't even buy a new computer nowadays while getting no benefit from this. I wish some influential programmers stimulated coders everywhere to skip Claude and Chatgpt subscriptions for Chinese ones, at scale. If we programmers united we could help this bubble burst, I'm sure.

nozzlegear•about 2 hours ago

> skip Claude and Chatgpt subscriptions for Chinese ones, at scale. If we programmers united we could help this bubble burst, I'm sure.

I'm doing my part!

cynicalsecurity•about 2 hours ago

Whoever convinced you that your life will improve when the US AI bubble bursts lied to you. The enemy does not care whether you live or die. They don't have Christian morals. You can improve the US by making positive changes, but helping the enemy will never improve anything.

duendefm•about 2 hours ago

Nvidia, Anthropic and OpenAI are controlling everything, and nothing is improving for everyone, quite the opposite. So I just hope they crash to the ground.

anon373839•about 1 hour ago

Dario, is that you? Is Anthropic’s next ploy to seek support via the culture wars?

gmerc•about 2 hours ago

lol Christian Morals. Epstein and his best buddy running the show tells you all about this

big-and-small•about 1 hour ago

What Epstein and buddies were doing was very... Christian...

Virgin Mary was very young in the events you know.

LNSY•about 1 hour ago

"They don't have Christian morals" -- does that mean they don't commit genocide and fuck kids? Because that sounds like a point for them

Knowledge Distillation of Black-Box Large Language Models

⚡ Community Insights

Discussion (12 Comments)Read Original on HackerNews