A Hidden Feature of Google Handwriting

Published in: Google

Google recently added handwriting recognition capabilities to their web search interface thus giving users an option to scribble search queries without opening the keyboard. Once you turn on the Handwriting mode, the entire Google page turns into a scratch pad - you can write anywhere on the screen and Google will instantly convert your freehand drawing into digital text.

The results are accurate and though the conversion happens on Google’s servers, you won’t notice the delay. Google suggests using block letters but cursive writing works as well.

You can use Google’s handwriting search on most touch-screen mobile phones and tablets but if you are on the desktop, you may change the user agent of your browser to iPad (or Android) and Google will then offer the Handwriting option on your desktop as well.

How Google Handwriting works?

When you draw a shape on the Google page, the path is captured in an array of X, Y points which is then sent to Google’s IME (Input Method Editor) API as a POST Request. It returns a list of possible suggestions (for instance, if you draw a round shape, IME may interpret that as “o, 0, O” while a straight line can be interpreted as “l, I, i, 1”) and one of them is added to the Google search box.

The Undocumented Feature

The JavaScript file associated with Google’s Handwriting feature reveal a hidden feature - other than letters and digits, you can also draw shapes and Google can convert some of them into words. For instance, if you draw a “heart” shape on the search page, Google will render that as the word “heart.”

Watch this YouTube video for a quick demo.

a = a.replace(/\u2661/g, “heart”), a = a.replace(/\u263A/g, “smiley face”), a = a.replace(/\u2639/g, “frowny face”), a = a.replace(/\u00A9/g, “copyright”), a = a.replace(/\u00AE/g, “registered trademark”), a = a.replace(/\u221E/g, “infinity”), a = a.replace(/\u2713/g, “check mark”), a = a.replace(/\uD834\uDD1E\u0020/g, “g clef”));

When you draw a heart shape, Google’s IME returns the Unicode equivalent of the heart character and Google, at the client side, converts that symbol into a word.

Google Handwriting Recognition includes similar logic for emoticons, check marks, copyright and trademark symbols but they aren’t working at this time. It does however offer a strong hint that Google Handwriting could be coming to other Google products - like Gmail and chat - because one rarely write smileys and frowning  faces in the search box.

Also see: An Undocumented Google Search Operator

📮  Subscribe to our Email Newsletter for Google tips and tutorials!
Published in: Google

Looking for something? Find here!

Meet the Author

Web Geek, Google Developer Expert
Amit Agarwal

Amit Agarwal is a Google Developer Expert in Google Workspace and Google Apps Script. He holds an engineering degree in Computer Science (I.I.T.) and is the first professional blogger in India. He is the developer of Mail Merge for Gmail and Document Studio. Read more on Lifehacker and YourStory

Get in touch

Google Add-ons

Do more with your Gmail and GSuite account

We build bespoke solutions that use the capabilities and the features of Google Workspace for automating business processes and driving work productivity.

  1. Mail Merge with Attachments
    Send personalized email to your Google Contact with a Google Sheet and Gmail
  2. Save Emails and Attachments
    Download email messages and file attachments from Gmail to your Google Drive
  3. Google Forms Email Notifications
    Send email notifications to multiple people when a new Google Form is submitted
  4. Document Studio
    Create beautiful pixel perfect documents merging data from Google Sheets and Google Forms
  5. Creator Studio for Google Slides
    Turn your Google Slides presentations into animated GIFs and videos for uploading to YouTube