YouTube System Design for Robotics Data Infrastructure

kkstonekuan about 3 hours ago 2 commentsRead Article on hebbianrobotics.com

DE version is available. Content is displayed in original English for accuracy.

⚡ Community Insights

Discussion Sentiment

50% Positive

Analyzed from 101 words in the discussion.

Discussion (2 Comments)Read Original on HackerNews

tolugenius•about 2 hours ago

Very interesting thought experiment. One thing I'm curious is how you might think through scale, certain data formats scale much faster and may consume more space than others. How do balance both growth of data formats and overall how much data can be hosted?

kstonekuan•about 3 hours ago

What does YouTube system design have to do with robotics data?

When we started building Pareto, we weren’t thinking about YouTube, but the data path looked familiar: upload, process, store, index, play.

Here's what the classic system design question gets right in production.

- Read: https://hebbianrobotics.com/blog/youtube-system-design-for-r...

- Try Pareto: https://pareto.hebbianrobotics.com

- Code open source: https://github.com/Hebbian-Robotics/pareto