README.md

im2ink

Overview

This project aims to reconstruct the offline character images back to online handwritten trajectories using an encoder-decoder with attention and GMM.

For questions or more details, please contact us via email addresses: ntuanhung@gmail.com or nakagawa (at) cc.tuat.ac.jp

Demo

In this part, we provide samples as animated movies rather than static figures in the paper. Moreover, we show here more samples than in the paper.

1. Recovered samples (Figures 3, 4 and 5 in the paper)

In the following figures, the original trajectories are colored by black and the recovered trajectories are colored by red. For figures generated by the attention layer, the focused regions on original trajectories at every step are shown by brighter color.

Next, the samples are successfully recovered either with or without the attention layer.

Figure 3. Successfully recovered examples.

	With attention layer	Without attention layer
Samples in paper
Other samples

The samples were successfully recovered with the attention layer, but unsuccessfully recovered without the attention layer.

Figure 4. Successfully recovered examples with attention.

	With attention layer	Without attention layer
Samples in paper
Other samples

The samples are unsuccessfully recovered either with or without the attention layer.

Figure 5. Unsuccessfully recovered examples.

	With attention layer	Without attention layer
Samples in paper

2. Unnatural recovered samples (Figure 6(a) in the paper)

Although the following samples are successfully recovered, their online trajectories consist of more points than the original ones, as shown in Figure 6 (a).

Figure 6 (a). Sample recovered with unusual pen/touch speed.

	Original trajectories	Recovered trajectories
Sample in paper
Other samples

3. Incompletely recovered samples (Figure 6(b) in the paper)

As shown in Figure 6 (b), there are incompletely recovered samples when attention was stuck.

Figure 6 (b). Sample whose recovery was stuck.

	Original trajectories	Recovered trajectories
Sample in paper
Other samples