[Paper PDF]     |
We present a sketch understanding system for network-like diagrams consisting of symbols linked together. This system employs a novel parser to automatically extract symbols from a continuous stream of pen strokes. The parser uses geometric information to enumerate candidate symbols, and then uses domain knowledge to prune away unlikely candidates. The candidates are classified with a novel, domain- independent, probabilistic, feature-based symbol recognizer. Domain knowledge and context are used to correct parsing and recognition errors. To demonstrate our system, we used it to create a sketch-based interface for an electric circuit analysis program.
Leslie Gennari, Levent Burak Kara, Thomas F. Stahovich. (2004). Combining Geometry and Domain Knowledge to Interpret Hand-Drawn Diagrams. AAAI Fall Symposium Series 2004: Making Pen-Based Interaction Intelligent and Natural.