Handwriting movement analysis: www.neuroscriptsoftware.com

Novel Multisensoric Smart Pens Assessing
Biometric and Neuromotoric Features
of Human Hand Movements
www.bisp-regensburg.de

We are developing novel multisensoric pen devices for recording and analyzing biometric behavioral or neuromotor features based on the kinematics and dynamics of handwriting or drawing movements. For a comprehensive monitoring of fine motor characteristics of the hand and fingers, the pen is equipped with a diversity of sensors measuring the position and tilt angles of the pen in space, the pressures generated in the pen during writing on an arbitrary pad as well as the grip pressure of the fingers holding the pen. In addition acoustics resulting from handwriting on paper or speech can be monitored. The pen transfers digital data to PC's, notebook, cell phones, smart cards etc. using the Zigbee wireless technology standard.

A software classifier implemented in the smart pen system is based on modern mathematical algorithms and covers a broad range of feature extraction, classification and correlation operations, statistics, and multivariate time-series analysis. Due to its user friendly design, specific sensors with high sensitivity, and a unique software engine for fast data acquisition and evaluation, the smart pen system is an ideal tool for:

biometric person authentication

neuromotor diagnostics and therapy in health care

hand writing, graphic and speech recognition and pen based input of cursor
movements of small mobile computers.

In the near future-with increasing maturity of the underlying technologies the smart pen system will enable innovations in many branches.

1. BiSP -Biometric Smart Pen in Biometrics

person verification and/or identification for access control and security to machines, rooms and services in business, legal and private sectors

input of digital biometric signature for eCommerce, eGovernment,
eDocumentation and eDatamanagement

input of biometric data for smart cards or health cards with biometric match on the chip

biometric data for smart cards or health cards

Biometric personalization in rooms, devices and services.

2. HecaPen - Medical and Diagnostic Smart Pen in health care

Quantitative Medication control (effect of drugs on fine motor coordination and psychomotor performance)

Patient monitoring: remote and mobile control of humans under drug treatment, physical or mental stress, or on drugs

Symptom assessment and therapy in psychology and education (ADDS, persons with problems in handwriting ect.)

Clinical trials (Phase I - IV)

Pharmacopsychiatry

Telemedicine, home care

Graphonomics

Biofeedback

The ongoing research work focuses on the:

Medication control of humans suffering under neuromotor dysfunction resulting from Parkinson, Schizophrenia, Multiple Sclerosis, Epilepsy , etc.

Combination with graphic tablets or tablet-PC's to investigate reactions and attentiveness of probands

Correlation of HecaPen with other diagnostic techniques such as EEG, NMR-CT.

2. Pen based input device of computers

The smart pen device also is well suited as an input device of mobile computers for:

handwriting, graphic and speech recognition: input of handwritten, and spoken notes, drawings and texts

desktop personalization of working environment and feasibilities
pen based input of cursor movements of small mobile devices, such as PDAs, cell phones, notebooks, etc.

Fields of research

The main issue of our present activities is the development of (1) applications for a pen device analyzing fine motor functions of human individuals, (2) algorithms and software for the evaluation of time series in medicine, pharmacology, psychology and biometrics.

Current projects

Design and prototyping of pen-based system equipped with sensors measuring finger grip pressure, tilt, tip position and vibrations generated during handwriting or a gesture

Development und fusion of different software classifiers

Pattern recognition and classification of hand motor performance in biometrics, neurology, psychiatry, psychology, pediatrics and sports medicine

Testing drug administration and dosage

Monitoring pharmaceutical side effects

Analyzing the neuromotoric effects of legal drugs such as nicotine or alcohol

Diagnosis of neuromotor dysfunction resulting from Parkinson's disease and Schizophrenia

Correlation of HecaPen and EEG data sampled during handwriting or drawing