Visual Design and Engineering Laboratory

Combining Geometry and Domain Knowledge to Interpret Hand-Drawn Diagrams

Paper

[Paper PDF]

[Publisher Version]

Abstract

We present a sketch understanding system for network-like diagrams consisting of symbols linked together. This system employs a novel parser to automatically extract symbols from a continuous stream of pen strokes. The parser uses geometric information to enumerate candidate symbols, and then uses domain knowledge to prune away unlikely candidates. The candidates are classified with a novel, domain- independent, probabilistic, feature-based symbol recognizer. Domain knowledge and context are used to correct parsing and recognition errors. To demonstrate our system, we used it to create a sketch-based interface for an electric circuit analysis program.

Citation

Leslie Gennari, Levent Burak Kara, Thomas F. Stahovich. (2004). Combining Geometry and Domain Knowledge to Interpret Hand-Drawn Diagrams. AAAI Fall Symposium Series 2004: Making Pen-Based Interaction Intelligent and Natural.

@inproceedings{Gennari04AAAI,
 author = {Leslie Gennari and Levent Burak Kara and Thomas F. Stahovich and Kenji Shimada},
 title = {Combining geometry and domain knowledge to interpret hand-drawn diagrams},
 booktitle = {AAAI Fall Symposium Series 2004: Making Pen-Based Interaction Intelligent and Natural},
 year = {2004}
}