ZH version is available. Content is displayed in original English for accuracy.
I would end up jumping between a video player, subtitles/transcription, a dictionary, screenshots, audio clips and Anki. So I built SubSmith to bring that workflow together.
You can drop a video or audio file into it, generate a transcript locally and then use the transcript alongside the media to:
* look up words and sentences * replay individual lines * edit the transcript * save useful sentences with their original context/audio * export them as Anki cards
The important part for me is that it works with your own media. It isn't tied to a particular streaming service or library, so I can use the random anime episode, podcast, lecture, etc. that I'm actually interested in studying.
It's an offline-first desktop app, and transcription happens locally rather than sending the media to a transcription API.
I'm sharing it here because I'm now more interested in finding out where this workflow breaks down for other people rather than adding features randomly now that I have solid core/base.
For example:
* Would you actually save sentences from your own media? * Which part of this process feels like too much work? * Does having the audio/context attached make creating an Anki card more useful? * Would you prefer this to work inside your existing video player/browser? * Is installing a desktop app a significant barrier? * And does requiring an account before starting the free trial make you give up?
The current version does require an account to start the trial, and I'm trying to work out whether that's meaningful friction for the people who would actually use this.
It's free to try, and I'd particularly appreciate feedback from people who already learn languages through their own videos, anime, films, podcasts or other media.
I'm the developer, so I'll be around in the comments to answer questions and discuss how it works.
Discussion (38 Comments)Read Original on HackerNews
asbplayer Manatan Yomine Anki Miner AnimeCards Nagare
These are just for video, there are other similar solutions for games, manga and ebooks, and some of them are all in one
While I'm not so sure about learning a language with content from fictional sources, that should at least make it more relevant for the learners.
And you can use it on podcasts too, where people talk normally.
The biggest hurdle is probably that users need to get hold of the media so they can use it as input.
Yeah that is my suspicion too, I am considering adding an option to transcribe system audio too so it could hook into whatever video or audio is playing on the computer. That would be quite a big change so would like feedback first! hahah
I've been learning Japanese as well and the content at my level is boring while the content I'm interested in is a wall.
Definitely a domain a million miles from being solved if even English is this bad.
https://huggingface.co/openai/whisper-large-v3
This is my main issue with tools like these. Automated subtitles are inherently inaccurate, because much of language depends on context which you cannot get just from a brief snippet of something. This wouldn't be much of an issue if the tool was targeted at people dedicated to creating subtitles, but if you're trying to learn a new language, how are you supposed to know when the output is wrong or not?
The other thing is the speech recognition models are very sensitive to the audio. If the audio quality is good then the model would do a good job, I’m not sure how much experience you have with Whisper Large but it is very capable on normal speech. The issues arise when there are many competing sounds overriding each other
Not seeing a reason to switch atm tbh
ASR in LR is down often from my experience.
How does not study a sentence? You mean memorizing it later?
I'm confused why is this a yearly subscription or paid at all?
This tool might as well be open source to be brutally honest.