Introductory content

Handwritten text recognition (HTR) is similar to OCR in that machine learning is used to generate transcriptions of documents, however HTR is using machine learning to transcribe handwritten documents instead of printed documents. There are different HTR tools, programs, and programming packages available for different types of HTR projects. In this LibGuide, they're organized into three categories: business, personal, and archival.

• Archival HTR tools are used by libraries, archives, museums, and government institutions to make their digitized collections of handwritten documents searchable, as well as by researchers studying handwritten manuscripts.
• Business HTR tools are built for businesses who use handwritten information written on physical documents in their work to be transcribed to computer text to increase access to that information and/or store it in databases. Businesses that use HTR are insurance companies, banks, and healthcare companies.
• Personal HTR tools are available via apps on smartphones and computers. Individuals use Personal HTR to generate transcriptions of handwritten documents usually written themselves. Students may use HTR to generate text transcriptions of their handwritten class notes to study or share online. Personal HTR tools are useful for community archiving and family archiving.

Transkribus is a software program that allows users to load documents into the program and create HTR models to generate transcriptions using PyLaia and HTR+ engines. Transkribus Expert Client is the software available for download to operate on your desktop, and Transkribus Lite is the online version of Transkribus with the same abilities to load documents, run line segmentation, transcribe ground truth, create models, and use premade models, with added capability of collaboration of multiple users working on the same document collection.

• Type: software program
• Cost: Transkribus uses a credit system for text transcriptions. Users may use Transkribus for free for everything except text transcriptions via premade models or models you create. Users get 500 credits for free upon signing up. Cost is calculated by the number of pages to transcribe and which engine used to transcribe them (PyLaia or HTR+). A single page of handwritten material costs 1 credit to transcribe using the PyLaia engine, while a single page of handwritten material costs 1.25 credits to transcribe using the HTR+ engine.
• Helpful Resource(s):
  • Transkribus How-To Guides
• Example Projects: 
  • Training my own Handwritten Text Recognition (HTR) model on Transkribus Lite
  • Qoruyo: Models for Automatic Transcription of Manuscripts 
  • Correspondence between Frederick, Prince of Wales, George II, and Caroline, Queen Consort

Handwriting OCR is one of a suite of features in SS&C Chorus Document Automation from Vivado, an AI company which engineers software for business such as banks, hospitals, and insurance agencies. SS&C Chorus Document Automation is designed for businesses to transfer information contained in handwritten documents from their clients and employees to a digital platform such as a database to easier access and assess that information in aggregate.

• Type: software program
• Cost: Pricing quotes are available from Vivado, calculated by the amount of information to be processed. Sign up for a free trial of SS&C Chorus Document Automation and test their Handwriting OCR in which you will be able to extract text from up to 200 pages of your own documents.
• Helpful Resource(s):
  • Case study: The Digital Mailroom: Reimagined with AI-Driven Document Automation at 98% Accuracy

Live Text is a feature from Apple IOS 15, available for use in Apple iPhones and and iPads. Live Text is HTR/OCR that can be used directly in your camera app and available in photos. If you take a picture of a sign with text on it, Live Text can detect and transcribe the text so that it is copy-and-paste-able directly from the camera app before the picture is taken or the photo in your camera roll. Live Text has some success with handwritten text as well, depending on how clear the text is written and how uniform the letters are to standardized characters.

• Type: software
• Cost: software is free with Apple products
• Helpful Resource(s):
  • The Complete Guide to Using Live Text on iOS 15
  • How to use Live Text with iOS 15

Google Lens is a feature of the Google app available for Apple and Android devices. Google Lens can be used with your device's camera or in photos to extract typed or handwritten text. That extracted text can be Google-searched from the Google Lens app or copy-and-pasted.

• Type: app
• Cost: free
• Helpful Resource(s):
  • Know How To Use Google Lens To Copy Handwritten Notes