Facebook researchers unveil new self-monitoring AI model, "TextStyleBrush" in the Newsroom. Using an image of a word, it can edit and replace the text by copying the font or visual style in which it was written.
The tool works both in handwritten text and in real words. This is something very impressive, because - as Facebook itself states - AI must understand "unlimited" text styles.
You know that there are different types of calligraphy, but also many stylistic details that must be taken into account. What if someone writes in italics or curves? Or if the surface on which the text is located makes it difficult to read? What about background clutter or image noise?
Facebook explained that the TextStyleBrush model works similar to how style tools work in processors of text, but for the aesthetics of text in images:
Exceeds state-of-the-art accuracy in both automated testing and user studies for every type of text. (…) We use a more holistic approach educations and decouple the content of a text image from all aspects of its appearance in the entire word frame. The representation of the total appearances can then be applied as a monochrome transfer.
If you want one more technique analysis of the functions of TextStyleBrush, you can read it full article on Facebook AI blog.
Η application Google Translate για κινητά έχει μια λειτουργία παρόμοια με τη νέα AI εφαρμογή του Facebook, καθώς αντικαθιστά κείμενο, αλλά στοχεύει στην επίλυση ενός διαφορετικού προβλήματος, την μετάφραση του κειμένου σε μια διαφορετική γλώσσα.
