SinoScript is an interactive reader of premodern literary and religious text from the Sinosphere (China, Vietnam, Korea, Japan). It is inspired by Quran.com, a web application where user can listen to different recitations of the Quran, with dynamically highlighted text and quick translations of Arabic. In its starting phase, SinoScript is focusing on the mock development of a reader for the Dao De Jing (China) and The Tale of Kieu (Vietnam). A brief demo video can be found below:
Screen.Recording.2025-12-20.at.2.08.00.PM.mov
In order for us to achieve the results in the mock demonstration, an audio (broken into chapters) of the Dao De Jing recitation is processed by an AI model (via ElevenLabs), returning a Forced Alignment file (each character and its timing inside the audio is stored inside a 'segment'). This file is then calibrated for better accuracy, then mapped onto the reader segment by segment. The highlighting effect is achieved via a common audio-text aligning technique using JavaScript.
This is a summary of the project's scope.
To run this application:
npm install
npm run startTo build this application for production:
npm run buildThis project uses Vitest for testing. You can run the tests with:
npm run testThis project uses Tailwind CSS for styling.