DE version is available. Content is displayed in original English for accuracy.
Today we're releasing MultiMatte, a background removal model you can aim with words. Name an object in your image. MultiMatte keeps just that thing, and removes everything else.
Try it out on your images: https://usefeyn.com/multimatte/.
Demo video: https://youtu.be/XZ5BJWAkOjs
MultiMatte is open source. Build with it using our NoBg library https://github.com/feyninc/nobg. Model card here: https://hf.co/feyninc/multimatte
MultiMatte is the second iteration of our background removal models. The first was FeyNoBg, which we released here https://news.ycombinator.com/item?id=49072462.
The big upgrade is promptability. Most models keep all foreground elements when cutting the background. MultiMatte lets you prompt the exact objects you want to keep and remove everything else. For example, If you have an image with a dog and a bowl, you can ask MultiMatte to keep just the dog.
MultiMatte is built on Meta's SAM 3, a concept-promptable detector that already understands phrases. Our biggest change was in masking. Instead of binary masks that classify each pixel as being inside or outside an object, MultiMatte uses alpha mattes that assign an opacity value to each pixel, with respect to an object. This allows us to better represent hair, fur, motion blur, and other kinds of fuzzy boundaries.
Across all our measured benchmarks, MultiMatte shows a step improvement over SAM 3. On DIS5K, S-measure rises from 0.674 to 0.908 (a 34.6% relative gain), and on DUT-OMRON from 0.792 to 0.901 (13.7%).
Our blog covers more of the training details and results https://usefeyn.com/blog/multimatte.
Happy to answer any questions!
Discussion (2 Comments)Read Original on HackerNews
the model does come with bounding box capability but we did not optimize for it in this release. In the next releases we intend to tackle that along with video capabilities and some other features.