Facebook researchers unveil new self-monitoring AI model, "TextStyleBrush" in the Newsroom. Using one picture of a word, can edit and replace the text by copying it font or the visual style in which it was written.
The tool works both in handwritten text and in real words. This is something very impressive, because - as Facebook itself states - AI must understand "unlimited" text styles.
You know that there are different types of calligraphy, but also a lot of stylistic details to consider. What if someone writes with slants or curves? Or if the surface the text is on makes it difficult to read? What about his clutter backgroundy or image noise?
Facebook explained that the TextStyleBrush model works similarly to the way styling tools work in word processors, but for text-to-image aesthetics:
Exceeds state-of-the-art accuracy in both automated testing and user studies for every type of text. (…) We use a more holistic approach educations and we decouple the content of a text image from all aspects of its appearance in the entire word frame. The representation of the overall appearance can then be applied as a monochrome metaphor.
If you want a more technical analysis of the functions of TextStyleBrush, you can read it full article on Facebook AI blog.
The Google Translate mobile app has a function similar to Facebook's new AI app in that it replaces text, but it aims to solve a different problem, translating text into a different language.