3 Commits

Author	SHA1	Message	Date
Daniel Wolf	5f451feb00	Made entire application Unicode-aware ... All 8-bit strings are UTF-8-encoded now.	2017-08-15 20:47:05 +02:00
Daniel Wolf	c9b17e1937	Improved tokenization by taking dictionary into account	2016-06-25 21:52:04 +02:00
Daniel Wolf	4d95b4c2c5	Implemented text tokenization using Flite	2016-06-02 18:24:27 +02:00