Back to News
Advertisement
Advertisement

⚑ Community Insights

Discussion Sentiment

50% Positive

Analyzed from 72 words in the discussion.

Trending Topics

#parameters#big#small#size#runs#web#browser#laptop#total#active

Discussion (1 Comments)Read Original on HackerNews

bob1029β€’about 2 hours ago
> Small size: Runs in a web browser or on a laptop – 1.5B parameters total and 50M active parameters.

This looks to be a big deal for my use case.

I've already got rule-based PII redaction in place, but there are still some leaky or ambiguous edge cases that crop up from time to time. Putting another layer like this in the way (before we send things to the big model) is likely to dramatically improve my ability to sell these tools to management. The block diagram does look much more reassuring once we introduce this step.