Text-to-Speech Synthesis: Literature Review with an Emphasis on Malayalam Language
Text to speech synthesis TTS literature review Indian language TTS Malayalam TTS
Department of Computer Applications Cochin University of Science India https: orcid.org India View Profile Jasir M. P Kannan Balakrishnan PJasir M
Text-to-Speech Synthesis (TTS) is an active area of research to generate synthetic
speech from underlying text. The identified syllables are uttered with proper duration
and prosody characteristics to emulate natural speech. It falls under the category
of ...
/pb-assets/head-metadata/apple-touch-icon-1574252172393.png
ACM Transactions on Asian and Low-Resource Language Information Processing
Abstract

Text-to-Speech Synthesis (TTS) is an active area of research to generate synthetic speech from underlying text. The identified syllables are uttered with proper duration and prosody characteristics to emulate natural speech. It falls under the category of Natural Language Processing (NLP), which aims to bridge the gap in communication between human and machine. So far as Western languages like English are concerned, the research to produce intelligent and natural synthetic speech has advanced considerably. But in a multilingual state like India, many regional languages viz. Malayalam is underexplored when it comes to NLP. In this article, we try to amalgamate the major research works performed in the area of TTS in English and the prominent Indian languages, with a special emphasis on the South Indian language, Malayalam. This review intends to provide right direction to the research activities in the language, in the area of TTS.

References

[1]

Sudipta Acharya and Shyamal Kr Das Mandal. 2013. Prosody modeling: A review report on Indian language. In Mining Intelligence and Knowledge Exploration. Springer, 831–842.

[2]

Ameeta Agrawal and Aijun An. 2012. Unsupervised emotion detection from text using semantic and syntactic relations. In Proceedings of the IEEE/WIC/ACM International Conferences on Web Intelligence and Intelligent Agent Technology, Vol. 1. IEEE, 346–353.

[3]

Md Kausar Ahmed and Md Monirul Islam. 2019. Syllable-based Bengali text-to-speech system. In Australian Journal of Science and Technology. AUJST.

[4]

D. Akhilaraj and Deepa P. Gopinath. 2010. Clustering of duration pattern in speech. https://www.researchgate.net/profile/Deepa-Gopinath/publication/229034822_Clustering_of_Duration_Pattern_in_Speech/links/0deec539fcdd84a76e000000/Clustering-of-Duration-Pattern-in-Speech.pdf.

[5]

Firoj Alam, S. M. Habib, and Mumit Khan. 2008. Text Normalization System for Bangla. Technical Report. BRAC University.

[6]

Donald R. Allen and William J. Strong. 1985. A model for the synthesis of natural sounding vowels. J. Acoust. Soc. Amer. 78, 1 (1985), 58–69.

[7]

Jonathan Allen. 1976. Synthesis of speech from unrestricted text. Proc. IEEE 64, 4 (1976), 433–442.

[8]

Jonathan Allen, M. Sharon Hunnicutt, Dennis H. Klatt, Robert C. Armstrong, and David B. Pisoni. 1987. From Text-to-Speech: The MITalk System. Cambridge University Press.

[9]

Gopala Krishna Anumanchipalli, Kishore Prahallad, and Alan W. Black. 2011. Festvox: Tools for creation and analyses of large speech corpora. In Proceedings of the Workshop on Very Large Scale Phonetics Research. 70.

[10]

AiTi Aw, Min Zhang, Juan Xiao, and Jian Su. 2006. A phrase-based statistical model for SMS text normalization. In Proceedings of the COLING/ACL on Main Conference Poster Sessions. Association for Computational Linguistics, 33–40.

[11]

Dzmitry Bahdanau, Kyunghyun Cho, and Yoshua Bengio. 2014. Neural machine translation by jointly learning to align and translate. Retrieved from https://arXiv:1409.0473.

[12]

Archana Balyan. 2018. Development of unit selection based speech synthesis system. In Proceedings of the 3rd International Conference on Internet of Things and Connected Technologies (ICIoTCT’18). 26–27.

[13]

World Bank. 2021. Land Area, Data Bank. Retrieved from https://data.worldbank.org/indicator/AG.LND.TOTL.K2.

[14]

Julio Barros and Ramon I. Diego. 2005. On the use of the hanning window for harmonic analysis in the standard framework. IEEE Trans. Power Delivery 21, 1 (2005), 538–539.

[15]

Tulika Basu and Arup Saha. 2013. Evaluation of prosody in text-to-speech synthesis system of Bangla. In Proceedings of the International Conference Oriental COCOSDA Held Jointly with the Conference on Asian Spoken Language Research and Evaluation (O-COCOSDA/CASLRE’13). IEEE, 1–6.

[16]

Afruza Begum, S. Md S. Askari, and Utpal Sharma. 2019. Text-to-speech synthesis system for Mymensinghiya dialect of Bangla language. In Progress in Advanced Computing and Intelligent Engineering. Springer, 291–303.

[17]

Akshar Bharati, Sushma Bendre, and Rajeev Sangal. 1998. Some observations on corpora of some Indian languages. Knowledge-Based Computer Systems, Tata McGraw-Hill.

[18]

Alan Black, Paul Taylor, Richard Caley, and Rob Clark. 1998. The festival speech synthesis system. version 1.4.2. Unpublished document available via http://www.cstr.ed.ac.uk/projects/festival.html 6 (2001), 365–377.

[19]

Alan W. Black and Nick Campbell. 1995. Optimising selection of units from speech databases for concatenative synthesis. https://era.ed.ac.uk/handle/1842/1279.

[20]

Alan W. Black and Paul A. Taylor. 1997. Automatically clustering similar units for unit selection in speech synthesis. In Proceedings of the Eurospeech 1997, Rhodes, Greece.

[21]

Alan W. Black, Heiga Zen, and Keiichi Tokuda. 2007. Statistical parametric speech synthesis. In Proceedings of the IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP’07), Vol. 4. IEEE, IV–1229.

[22]

Ramani Boothalingam, V. Sherlin Solomi, Anushiya Rachel Gladston, S. Lilly Christina, P. Vijayalakshmi, Nagarajan Thangavelu, and Hema A. Murthy. 2013. Development and evaluation of unit selection and HMM-based speech synthesis systems for Tamil. In Proceedings of the National Conference on Communications (NC’13). IEEE, 1–5.

[23]

Gerlof Bouma. 2009. Normalized (pointwise) mutual information in collocation extraction. Proceedings of the International Conference of the German Society for Computational Linguistics and Language Technology (GSCL’09). 31–40.

[24]

David J. Broad. 1979. The new theories of vocal fold vibration. In Speech and Language. Vol. 2. Elsevier, 203–256.

[25]

Samuel Brody and Mirella Lapata. 2009. Bayesian word sense induction. In Proceedings of the 12th Conference of the European Chapter of the ACL (EACL’09). 103–111.

[26]

Edward Bruckert, Martin Minow, and Walter Tetschner. 1983. 3-Tiered Software and VLSI Aid Developmental System to Read Text Aloud. Electronics 56, 8 (1983), 133.

[27]

Ivan Bulyko and Mari Ostendorf. 2001. Joint prosody prediction and unit selection for concatenative speech synthesis. In Proceedings of the IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP’01), Vol. 2. IEEE, 781–784.

[28]

Rolf Carlson and Björn Granström. 1975. A phonetically oriented programming language for rule description of speech. Speech Commun. 2 (1975), 245–253.

[29]

Rolf Carlson and B. Granstrom. 1976. A text-to-speech system based entirely on rules. In Proceedings of the IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP’76), Vol. 1. IEEE, 686–688.

[30]

John B. Carter, Bryan Ford, Mike Hibler, Ravindra Kuramkote, Jeffrey Law, Jay Lepreau, Douglas B. Orr, Leigh Stoller, and Mark Swanson. 1993. FLEX: A tool for building efficient and flexible systems. In Proceedings of IEEE 4th Workshop on Workstation Operating Systems (WWOS’93). IEEE, 198–202.

[31]

Pamela Chaudhur and K. Vinod Kumar. 2010. Vowel classification based approach for Telugu text-to-speech system using symbol concatenation. In Proceedings of the International Conference (ACCTA’10), Vol. 1. 183–187.

[32]

Noam Chomsky and Morris Halle. 1968. The sound pattern of English. Harper & Row Publishers. New York, Evanston, and London.

[33]

Eleanor Clark and Kenji Araki. 2011. Text normalization in social media: Progress, problems and applications for a pre-processing system of casual English. Procedia-Soc. Behav. Sci. 27 (2011), 2–11.

[34]

Franklin S. Cooper, Jane H. Gaitenby, Ignatius G. Mattingly, Patrick W. Nye, and George N. Sholes. 1973. Audible outputs of reading machines for the blind. Haskins Labortories Status Report on Speech Research SRr29/30 (1972), 91–95.

[35]

Corinna Cortes. 1995. Support vector machine. Machine Learning 20, 3 (1995), 273–297.

[36]

Niladri Sekhar Dash. 2020. Pre-editing and textstandardization on a Bengali written text corpus. Aligarh J. Linguistics 10, 1 (2020), 1–3.

[37]

Asoke Kumar Datta. 2018. Intonation rules for text reading. In Epoch Synchronous Overlap Add. Springer, 135–176.

[38]

A. V. D. Oord, S. Dieleman, H. Zen, K. Simonyan, O. Vinyals, A. Graves, and K. Kavukcuoglu. 2016. Wavenet: A generative model for raw audio. arXiv preprint arXiv:1609.03499.

[39]

Pierre C. Delattre, Alvin M. Liberman, and Franklin S. Cooper. 1955. Acoustic loci and transitional cues for consonants. J. Acoust. Soc. Amer. 27, 4 (1955), 769–773.

[40]

M. S. Dhananjaya, B. Niranjana Krupa, and R. Sushma. 2016. Kannada Text-to-Speech conversion: A novel approach. In Proceedings of the International Conference on Electrical, Electronics, Communication, Computer and Optimization Techniques (ICEECCOT’16). IEEE, 168–172.

[41]

Swapnil Dhanwal, Hritwik Dutta, Hitesh Nankani, Nilay Shrivastava, Yaman Kumar, Junyi Jessy Li, Debanjan Mahata, Rakesh Gosangi, Haimin Zhang, Rajiv Shah, et al. 2020. An annotated dataset of discourse modes in Hindi stories. In Proceedings of the 12th Language Resources and Evaluation Conference. 1191–1196.

[42]

P. A. M. Dirac. 1953. The lorentz transformation and absolute time. Physica 19, 1–12 (1953), 888–896. https://doi.org/10.1016/S0031-8914(53)80099-6

[43]

Hugh K. Dunn. 1950. The calculation of vowel resonances, and an electrical vocal tract. J. Acoust. Soc. Amer. 22, 6 (1950), 740–753.

[44]

Thierry Dutoit and Henri Leich. 1993. MBR-PSOLA: Text-to-speech synthesis based on an MBE re-synthesis of the segments database. Speech Commun. 13, 3–4 (1993), 435–440.

[45]

Peter Ebden and Richard Sproat. 2015. The kestrel TTS text normalization system. Natural Lang. Eng. 21, 3 (2015), 333.

[46]

James P. Egan. 1948. Articulation testing methods. Laryngoscope 58, 9 (1948), 955–991.

[47]

Isaac Elias, Heiga Zen, Jonathan Shen, Yu Zhang, Jia Ye, R. J. Ryan, and Yonghui Wu. 2021. Parallel tacotron 2: A non-autoregressive neural TTS model with differentiable duration modeling. Retrieved from https://arXiv:2103.14574.

[48]

Norman P. Erber. 1979. An approach to evaluating auditory speech perception ability. Volta Rev. 81, 1 (1979), 16–24.

[49]

Md Shah Fahad, Shreya Singh, Shruti Gupta, Akshay Deepak, et al. 2019. Synthesis of emotional speech by prosody modification of vowel segments of neutral speech. In Proceedings of the 2nd International Conference on Advanced Computing and Software Engineering (ICACSE’19).

[50]

N. B. FalDessai, Gaurav A. Naik, and Jyoti D. Pawar. 2017. Review of syllable based Text-to-Speech systems: Strategies for enhancing naturalness for Devanagari languages. International Journal of Computer Science and Applications 14, 2 (2017).

[51]

G. Fant. 1960. Acoustic Theory of Speech Production.’s Gravenhage, Mouton & Co.

[52]

G. Fant, Q. G. Lin, and C. Gobl. 1985. Notes on glottal flow interaction. KTH, Speech Transmission Laboratory, Quarterly Report 2–3. 21–45.

[53]

Raul Fernandez, Asaf Rendel, Bhuvana Ramabhadran, and Ron Hoory. 2015. Using deep bidirectional recurrent neural networks for prosodic-target prediction in a unit-selection text-to-speech system. In Proceedings of the 16th Annual Conference of the International Speech Communication Association.

[54]

R. P. Feynman and F. L. Vernon Jr.1963. The theory of a general quantum system interacting with a linear dissipative system. Ann. Phys. 24 (1963), 118–173. https://doi.org/10.1016/0003-4916(63)90068-X

[55]

J. L. Flanagan, L. R. Rabiner, R. W. Schafer, and J. D. Denman. 1972. Wiring telephone apparatus from computer-generated speech. Bell Labs Tech. J. 51, 2 (1972), 391–397.

[56]

Emma Flint, Elliot Ford, Olivia Thomas, Andrew Caines, and Paula Buttery. 2017. A text normalisation system for non-standard English words. In Proceedings of the 3rd Workshop on Noisy User-generated Text. 107–115.

[57]

G. David Forney. 1973. The viterbi algorithm. Proc. IEEE 61, 3 (1973), 268–278.

[58]

R. Gagnon. 1978. Votrax real time hardware for phoneme synthesis of speech. In Proceedings of the IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP’78), Vol. 3. IEEE, 175–178.

[59]

Sai Geeta and B. L. Muralidhara. 2017. Syllable as the basic unit for Kannada speech synthesis. In 2017 International Conference on Wireless Communications, Signal Processing and Networking (WiSPNET). IEEE, 1205–1208.

[60]

Louis J. Gerstman and John L. Kelly, Jr. 1964. Synthesis of speech from code signals. U.S. Patent 3,158,685.

[61]

P. Gokul, Neethu Thomas, Crisil Thomas, and Deepa P. Gopinath. 2015. Text normalization and unit selection for a memory based non uniform unit selection TTS in Malayalam. In Proceedings of the 12th International Conference on Natural Language Processing. 168.

[62]

Richard S. Goldhor and Robert T. Lund. 1983. University-to-industry advanced technology transfer: A case study. Res. Policy 12, 3 (1983), 121–152.

[63]

Deepa P. Gopinath. 2009. Duration analysis and modelling for Malayalam Text-to-Speech synthesis systems. (2009).

[64]

Deepa P. Gopinath, P. S. Sheeba, and Achuthsankar S. Nair. 2007. Emotional analysis for Malayalam Text-to-Speech synthesis systems. In Proceedings of the International Conference on Sciences of Electronic, Technologies of Information and Telecommunication (SETIT’07).

[65]

Deepa P. Gopinath, J. Divya Sree, Reshmi Mathew, S. J. Rekhila, and Achuthsankar S. Nair. 2006. Duration analysis for Malayalam text-to-speech systems. In Proceedings of the 9th International Conference on Information Technology (ICIT’06). IEEE, 129–132.

[66]

Deepa P. Gopinath, S. G. Veena, and Achuthsankar S. Nair. 2008. Modeling of vowel duration in Malayalam speech using probability distribution. In Proceedings of the Speech Prosody Conference. 6–9.

[67]

Deepa P. Gopinath, Chandra S. S. Vinod, S. G. Veena, and S. Nair Achuthsankar. 2008. A hybrid duration model using CART and HMM. In Proceedings of the IEEE Region 10 Conference (TENCON’08). IEEE, 1–4.

[68]

Olga Goubanova and Paul Taylor. 2000. Using Bayesian belief networks for model duration in text-to-speech systems. In Proceedings of the Conference of the International Speech Communication Association (INTERSPEECH’00). 427–430.

[69]

Steven L. Greenspan, Raymond W. Bennett, and Ann K. Syrdal. 1998. An evaluation of the diagnostic rhyme test. Int. J. Speech Technol. 2, 3 (1998), 201–214.

[70]

D. Griffin and Jae Lim. 1983. Signal estimation from modified short-time fourier transform. In Proceedings of the IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP’83), Vol. 8. 804–807. https://doi.org/10.1109/ICASSP.1983.1172092

[71]

B. Yegnanarayana and H. A. Murthy. 1991. Formant extraction from minimum phase group delay functions. Speech Commun. 1 (1991), 209–221.

[72]

J. Hawkins and S. Blakeslee. 2004. On Intelligence, St. Martin’s Griffin, New York, NY.

[73]

Simon Haykin. 2008. Communication Systems. John Wiley & Sons, New York, NY.

[74]

Donald O. Hebb. 1949. The first stage of perception: Growth of the assembly. Organiz. Behav. 4 (1949), 60–78.

[75]

Michael H. L. Hecker. 1962. Studies of nasal consonants with an articulatory speech synthesizer. J. Acoust. Soc. Amer. 34, 2 (1962), 179–187.

[76]

Zack Hodari, Alexis Moinet, Sri Karlapati, Jaime Lorenzo-Trueba, Thomas Merritt, Arnaud Joly, Ammar Abbas, Penny Karanasou, and Thomas Drugman. 2020. CAMP: A two-stage approach to modelling prosody in context. Retrieved from https://arXiv:2011.01175.

[77]

John N. Holmes, Ignatius G. Mattingly, and John N. Shearme. 1964. Speech synthesis by rule. Lang. Speech 7, 3 (1964), 127–143.

[78]

Florian Hönig, Anton Batliner, Karl Weilhammer, and Elmar Nöth. 2010. Automatic assessment of non-native prosody for English as l2. In Proceedings of the 5th International Conference on Speech Prosody.

[79]

Arthur S. House, Carl E. Williams, Michael H. L. Hecker, and Karl D. Kryter. 1965. Articulation-testing methods: Consonantal differentiation with a closed-response set. J. Acoust. Soc. Amer. 37, 1 (1965), 158–166.

[80]

Lan Huang, Shunan Zhuang, and Kangping Wang. 2020. A text normalization method for speech synthesis based on local attention mechanism. IEEE Access 8 (2020), 36202–36209.

[81]

Xuedong Huang, Alex Acero, Hsiao-Wuen Hon, and Raj Foreword By-Reddy. 2001. Spoken Language Processing: A Guide to Theory, Algorithm, and System Development. Prentice Hall PTR.

[82]

Andrew J. Hunt and Alan W. Black. 1996. Unit selection in a concatenative speech synthesis system using a large speech database. In Proceedings of the IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP’96), Vol. 1. IEEE, 373–376.

[83]

James R. Hurford. 2011. The Linguistic Theory of Numerals. Vol. 16. Cambridge University Press, Cambridge, UK.

[84]

W. John Hutchins. 2004. The Georgetown-IBM experiment demonstrated in January 1954. In Proceedings of the Conference of the Association for Machine Translation in the Americas. Springer, 102–114.

[85]

A. Femina Jalin and J. Jayakumari. 2017. Text-to-Speech synthesis system for Tamil using HMM. In Proceedings of the IEEE International Conference on Circuits and Systems (ICCS’17). IEEE, 447–451.

[86]

Jesin James and Deepa P. Gopinath. 2015. Pause duration model for Malayalam TTS. In Proceedings of the International Conference on Advances in Computing, Communications and Informatics (ICACCI’15). IEEE, 2206–2210.

[87]

Kannan Balakrishnan and Jasir M. P. 2014. A comprehensive survey on Text-to-Speech synthesis with a special emphasis to Indian languages. In Proceedings of the National Conference on Indian Language Computing (NCILC’14). 1–4.

[88]

Adrián Javaloy and Ginés García-Mateos. 2020. Text normalization using encoder–decoder networks based on the causal feature extractor. Appl. Sci. 10, 13 (2020), 4551.

[89]

R. Jayakrishnan, Greeshma N. Gopal, and M. S. Santhikrishna. 2018. Multi-class emotion detection and annotation in Malayalam novels. In Proceedings of the International Conference on Computer Communication and Informatics (ICCCI’18). IEEE, 1–5.

[90]

J. Jayakumari and A. Femina Jalin. 2019. An improved Text-to-Speech technique for Tamil language using hidden Markov model. In Proceedings of the 7th International Conference on Smart Computing and Communications (ICSCC’19). IEEE, 1–5.

[91]

T. Jayasankar and J. Arputha Vijayaselvi. 2016. Prediction of syllable duration using structure optimised cuckoo search neural network (SOCNN) for text-to-speech. J. Comput. Theoret. Nanosci. 13, 10 (2016), 7538–7544.

[92]

Frederick Jelinek. 1985. Markov source modeling of text generation. In The Impact of Processing Techniques on Communications. Springer, 569–591.

[93]

Martin Joos. 1948. Acoustic phonetics. Language 24, 2 (1948), 5–136.

[94]

Anusha Joshi, Deepa Chabbi, M. Suman, and Suprita Kulkarni. 2015. Text-to-Speech system for Kannada language. In Proceedings of the International Conference on Communications and Signal Processing (ICCSP’15). IEEE, 1901–1904.

[95]

Sun-Ah Jun. 2010. The implicit prosody hypothesis and overt prosody in English. Lang. Cogn. Process. 25, 7-9 (2010), 1201–1233.

[96]

Sudarsana Reddy Kadiri and B. Yegnanarayana. 2015. Analysis of singing voice for epoch extraction using zero frequency filtering method. In Proceedings of the IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP’15). IEEE, 4260–4264.

[97]

Jagadish S. Kallimani, K. G. Srinivasa, et al. 2012. Normalization of non standard words for Kannada speech synthesis. International Journal of Information Technology Infrastructure 1, 2 (2012).

[98]

Shilpi Kannojia, Ghanapriya Singh, and Sanjay Mathur. 2016. A Text-to-Speech synthesizer using acoustic unit based concatenation for any Indian language of devanagari script. In Proceedings of the 11th International Conference on Industrial and Information Systems (ICIIS’16). IEEE, 759–763.

[99]

Hideki Kawahara, Ikuyo Masuda-Katsuse, and Alain De Cheveigne. 1999. Restructuring speech representations using a pitch-adaptive time–frequency smoothing and an instantaneous-frequency-based F0 extraction: Possible role of a repetitive structure in sounds. Speech Commun. 27, 3–4 (1999), 187–207.

[100]

John L. Kelly Jr. and Louis J. Gerstman. 1961. An artificial talker driven from a phonetic input. J. Acoust. Soc. Amer. 33, 6 (1961), 835–835.

[101]

Tom Kenter, Vincent Wan, Chun-An Chan, Rob Clark, and Jakub Vit. 2019. CHiVE: Varying prosody in speech synthesis with a linguistically driven dynamic hierarchical conditional variational network. In Proceedings of the International Conference on Machine Learning. PMLR, 3331–3340.

[102]

Rubeena A. Khan and J. S. Chitode. 2016. Concatenative speech synthesis: A review. Int. J. Comput. Appl. 136, 3 (2016), 6.

[103]

Diederik P. Kingma and Jimmy Ba. 2014. Adam: A method for stochastic optimization. Retrieved from https://arXiv:1412.6980.

[104]

Diederik P. Kingma and Max Welling. 2013. Auto-encoding variational Bayes. Retrieved from https://arXiv:1312.6114.

[105]

S. P. Kishore, Rohit Kumar, and Rajeev Sangal. 2002. A data driven synthesis approach for Indian languages using syllable as basic unit. In Proceedings of the International Conference on NLP (ICON’02). 311–316.

[106]

S. Prahallad Kishore and Alan W. Black. 2003. Unit size in unit selection speech synthesis. In Proceedings of the 8th European Conference on Speech Communication and Technology.

[107]

Dennis H. Klatt. 1970. Synthesis of stop consonants in initial position. J. Acoust. Soc. Amer. 47, 1A (1970), 93–94.

[108]

Dennis H. Klatt. 1980. Software for a cascade/parallel formant synthesizer. the Journal of the Acoustical Society of America 67, 3 (1980), 971–995.

[109]

Dennis H. Klatt. 1987. Review of text-to-speech conversion for English. J. Acoust. Soc. Amer. 82, 3 (1987), 737–793.

[110]

Gerwin Klein. 2010. Jflex user’s manual. Available on-line at www. jflex. de. Accessed August (2010).

[111]

W. Koenig, H. K. Dunn, and L. Y. Lacy. 1946. The sound spectrograph. J. Acoust. Soc. Amer. 18, 1 (1946), 19–49.

[112]

N. Sridhar Krishna and Hema A. Murthy. 2004. Duration modeling of Indian languages Hindi and Telugu. In Proceedings of the 5th ISCA Workshop on Speech Synthesis.

[113]

Nemala Sridhar Krishna and Hema A. Murthy. 2004. A new prosodic phrasing model for Indian language Telugu. In Proceedings of the Conference of the International Speech Communication Association (INTERSPEECH’04).

[114]

N. Sridhar Krishna, Partha Pratim Talukdar, Kalika Bali, and A. G. Ramakrishnan. 2004. Duration modeling for Hindi text-to-speech synthesis system. In Proceedings of the International Conference on Spoken Language Processing (ICSLP’04).

[115]

N. S. Krishna and H. A. Murthy. 2004. Duration modeling of Indian languages Hindi and Telugu. In SSW.

[116]

Miroslav Kubat. 1999. Neural networks: A comprehensive foundation by Simon Haykin. Knowledge Eng. Rev. 13, 4 (1999), 409–412.

[117]

Naresh Kumar, Gerard Deepak, and A. Santhanavijayan. 2020. A novel semantic approach for intelligent response generation using emotion detection incorporating NPMI measure. Procedia Comput. Sci. 167 (2020), 571–579.

[118]

S. R. Rajesh Kumar and B. Yegnanarayana. 1989. Significance of durational knowledge for speech synthesis system in an Indian language. In Proceedings of the 4th IEEE Region 10 International Conference (TENCON’89). IEEE, 486–489.

[119]

Raymond Kurzweil. 1976. The Kurzweil reading machine: A technical overview. Science, Technology, and the Handicapped. 3–11.

[120]

Vikram Ramesh Lakkavalli, P. Arulmozhi, and A. G. Ramakrishnan. 2010. Continuity metric for unit selection based text-to-speech synthesis. In Proceedings of the International Conference on Signal Processing and Communications (SPCOM’10). IEEE, 1–5.

[121]

Younggun Lee and Taesu Kim. 2019. Robust and fine-grained prosody control of end-to-end speech synthesis. In Proceedings of the IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP’19). IEEE, 5911–5915.

[122]

Robert B. Lees and Noam Chomsky. 1957. Syntactic structures. Language 33, 3 Part 1 (1957), 375–408.

[123]

John R. Levine, John Mason, Tony Mason, Doug Brown, and Paul Levine. 1992. Lex & Yacc. O’Reilly Media, Inc.

[124]

Philip Lieberman. 1967. Intonation, perception, and language. MIT Research Monograph (1967).

[125]

Johan Liljencrants. 1985. Speech synthesis with a reflection-type line analog. DS Dissertation, Dept. Speech Commun. and Music Acoust., Royal Inst. Tech.

[126]

Fei Liu, Fuliang Weng, Bingqing Wang, and Yang Liu. 2011. Insertion, deletion, or substitution?: Normalizing text messages without pre-categorization nor supervision. In Proceedings of the 49th Annual Meeting of the Association for Computational Linguistics: Human Language Technologies. Association for Computational Linguistics, 71–76.

[127]

J. Logan, D. Pisoni, and B. Greene. 1985. Measuring the segmental intelligibility of synthetic speech: Results for eight Text-to-Speech systems, Research on Speech Perception Progress Report No. 11. University of Indiana, Bloomington, IN.

[128]

Paul A. Luce, Timothy C. Feustel, and David B. Pisoni. 1983. Capacity demands in short-term memory for synthetic and natural speech. Human Factors 25, 1 (1983), 17–32.

[129]

Minh-Thang Luong, Hieu Pham, and Christopher D. Manning. 2015. Effective approaches to attention-based neural machine translation. Retrieved from https://arXiv:1508.04025.

[130]

Molly Mack. 1982. Voicing-dependent vowel duration in English and French: Monolingual and bilingual production. J. Acoust. Soc. Amer. 71, 1 (1982), 173–178.

[131]

Manu Madhavan, O. Mujeeb Rehman, P. C. Reghu Raj et al. 2013. Computing prosodic patterns for Malayalam. NCILC.DCA.CUSAT.

[132]

A. S. Madhukumar, S. Rajendran, and B. Yegnanarayana. 1993. Intonation component of a Text-to-Speech system for Hindi. Comput. Speech Lang. 7, 3 (1993), 283–301.

[133]

M. Mahesh, Jeena J. Prakash, and Hema A. Murthy. 2018. Resyllabification in Indian languages and its implications in text-to-speech systems. In Proceedings of the Conference of the International Speech Communication Association (INTERSPEECH’18). 212–216.

[134]

Piyush Makhija, Ankit Kumar, and Anuj Gupta. 2020. HinglishNorm—A corpus of Hindi-English code mixed sentences for text normalization. Retrieved from https://arXiv:2010.08974.

[135]

Sreeja Manghat, Sreeram Manghat, and Tanja Schultz. 2020. Malayalam-English code-switched: Grapheme to phoneme system. In Proceedings of the Conference of the International Speech Communication Association (INTERSPEECH’20). 4133–4137.

[136]

Laura M. Manous, David B. Pisoni, Michael J. Dedina, and Howard C. Nusbaum. 1986. Comprehension of natural and synthetic speech using a sentence verification task. J. Acoust. Soc. Amer. 79, S1 (1986), S25–S25.

[137]

Leena Mary, Anil P. Antony, Ben P. Babu, and S. R. Mahadeva Prasanna. 2018. Automatic syllabification of speech signal using short time energy and vowel onset points. Int. J. Speech Technol. 21, 3 (2018), 571–579.

[138]

Mili Mary Mathew and Jayashree S. Bhat. 2010. Aspects of emotional prosody in Malayalam and Hindi. Buckingham J. Lang. Linguist. 3 (2010), 25–34.

[139]

Ignatius G. Mattingly. 1966. Synthesis by rule of prosodic features. Lang. Speech 9, 1 (1966), 1–13. DOI:https://doi.org/10.1177/002383096600900101

[140]

Ignatius Gorsline Mattingly. 1969. Synthesis by Rule of General American English.

[141]

Olga Maxwell and Janet Fletcher. 2009. Acoustic and durational properties of Indian English vowels. World Englishes 28, 1 (2009), 52–69.

[142]

John McCarthy. 1978. History of LISP. In History of Programming Languages. 173–185.

[143]

Warren S. McCulloch and Walter Pitts. 1943. A logical calculus of the ideas immanent in nervous activity. Bull. Math. Biophys. 5, 4 (1943), 115–133.

[144]

Khawar Mehmood, Daryl Essam, Kamran Shafi, and Muhammad Kamran Malik. 2020. An unsupervised lexical normalization for Roman Hindi and Urdu sentiment analysis. Info. Process. Manage. 57, 6 (2020), 102368.

[145]

Huaiping Ming, Yanfeng Lu, Zhengchen Zhang, and Minghui Dong. 2017. A light-weight method of building an LSTM-RNN-based bilingual TTS system. In Proceedings of the International Conference on Asian Language Processing (IALP’17). IEEE, 201–205.

[146]

James Moor. 2006. The Dartmouth College artificial intelligence conference: The next fifty years. AI Mag. 27, 4 (2006), 87.

[147]

J. Y. Mortimer and J. A. Salathiel. 1995. “Soundex” codes of surnames provide confidentiality and accuracy in a national HIV database. Communic. Disease Rep. CDR Rev. 5, 12 (1995), R183–6.

[148]

Eric Moulines and Francis Charpentier. 1990. Pitch-synchronous waveform processing techniques for text-to-speech synthesis using diphones. Speech Commun. 9, 5–6 (1990), 453–467.

[149]

W. A. Munson and J. E. Karlin. 1962. Isopreference method for evaluating speech-transmission circuits. J. Acoust. Soc. Amer. 34, 6 (1962), 762–774.

[150]

R. Muralishankar and A. G. Ramakrishnan. 2001. Human touch to Tamil speech synthesizer. In Proceedings of Tamilnet. 103–109.

[151]

R. Muralishankar, A. G. Ramakrishnan, and P. Prathibha. 2004. Pitch modification using DCT in the source domain. Submitted to J. Speech Commun. 42, 143–154.

[152]

H. A. Murthy. 1997. The real root cepstrum and its applications to speech processing. In Proceedings of the National Conference on Communication. 180–183.

[153]

T. Nagarajan, V. Kamakshi Prasad, and Hema A. Murthy. 2003. Minimum phase signal derived from root cepstrum. Electron. Lett. 39, 12 (2003), 941–942.

[154]

D. Nagaraju and R. J. Ramasree. 2014. Prosodic analysis for Telugu script. Int. J. Adv. Res. Comput. Sci. Softw. Eng. 4, 5 (2014), 1922–1925.

[155]

D. Nagaraju and R. J. Ramasree. 2018. Design issues of Telugu emotional speech system. Int. J. Appl. Eng. Res. 13, 4 (2018), 1922–1925.

[156]

A. Namboodiri, P. Narayanan, and C. Jawahar. 2007. On using classical poetry structure for Indian language post-processing. In Proceedings of the 9th International Conference on Document Analysis and Recognition (ICDAR’07), Vol. 2. IEEE, 1238–1242.

[157]

Bhuvana Narasimhan, Richard Sproat, and George Kiraz. 2004. Schwa-deletion in Hindi text-to-speech synthesis. Int. J. Speech Technol. 7, 4 (2004), 319–333.

[158]

N. P. Narendra, K. Sreenivasa Rao, Krishnendu Ghosh, Ramu Reddy Vempada, and Sudhamay Maity. 2011. Development of syllable-based Text-to-Speech synthesis system in Bengali. Int. J. Speech Technol. 14, 3 (2011), 167–181.

[159]

United Nations. 2019. World Population Prospects 2019. Retrieved from https://population.un.org/wpp/.

[160]

Tyson R. Na’im and Ila Nagar. 2009. Prosodic rules for schwa-deletion in Hindi text-to-speech synthesis. Int. J. Speech Technol. 12, 1 (2009), 15.

[161]

Charles W. Nixon, Timothy R. Anderson, and Thomas J. Moore. 1986. The perception of synthetic speech in noise. In Basic and Applied Aspects of Noise-Induced Hearing Loss. Springer, 345–356.

[162]

P. Nye, J. Hankins, T. Rand, I. Mattingly, and F. Cooper. 1973. A plan for the field evaluation of an automated reading system for the blind. IEEE Trans. Audio Electroacoust. 21, 3 (1973), 265–268.

[163]

Government of India. 2011. Data on Language and Mother Tongue. Retrieved from https://censusindia.gov.in/2011Census/Language_MTs.html.

[164]

Craig Olinsky and Alan W. Black. 2000. Non-standard word and homograph resolution for asian language text analysis. In Proceedings of the 6th International Conference on Spoken Language Processing.

[165]

Aaron van den Oord, Sander Dieleman, Heiga Zen, Karen Simonyan, Oriol Vinyals, Alex Graves, Nal Kalchbrenner, Andrew Senior, and Koray Kavukcuoglu. 2016. Wavenet: A generative model for raw audio. Retrieved from https://arXiv:1609.03499.

[166]

Sathish Pammi and Marcela Charfuelan. 2013. HMM-based sCost quality control for unit selection speech synthesis. In Proceedings of the 8th ISCA Speech Synthesis Workshop (SSW’13). 53–57.

[167]

K. Panchapagesan, Partha Pratim Talukdar, N. Sridhar Krishna, Kalika Bali, and A. G. Ramakrishnan. 2004. Hindi text normalization. In Proceedings of the 5th International Conference on Knowledge Based Computer Systems (KBCS’04). 19–22.

[168]

Pramod Pandey. 2014. Akshara-to-sound rules for Hindi. Writing Syst. Res. 6, 1 (2014), 54–72.

[169]

Pramod Pandey and Somnath Roy. 2017. A generative model of a pronunciation lexicon for Hindi. Retrieved from https://arXiv:1705.02452.

[170]

Hemant A. Patil, Tanvina B. Patel, Nirmesh J. Shah, Hardik B. Sailor, Raghava Krishnan, G. R. Kasthuri, T. Nagarajan, Lilly Christina, Naresh Kumar, Veera Raghavendra, et al. 2013. A syllable-based framework for unit selection synthesis in 13 Indian languages. In Proceedings of the International Conference Oriental COCOSDA held jointly with Conference on Asian Spoken Language Research and Evaluation (O-COCOSDA/CASLRE’13). IEEE, 1–8.

[171]

Vijayaditya Peddinti and Kishore Prahallad. 2011. Significance of vowel epenthesis in Telugu text-to-speech synthesis. In Proceedings of the IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP’11). IEEE, 5348–5351.

[172]

Deana L. Pennell and Yang Liu. 2010. Normalization of text messages for text-to-speech. In Proceedings of the IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP’10). IEEE, 4842–4845.

[173]

Gordon E. Peterson and Ilse Lehiste. 1960. Duration of syllable nuclei in English. J. Acoust. Soc. Amer. 32, 6 (1960), 693–703.

[174]

Janet Pierrehumbert and Rami Nair. 1996. Implications of Hindi prosodic structure. Curr. Trends Phonol.: Models Methods 2 (1996), 549–584.

[175]

D. Pisoni and Sharon Hunnicutt. 1980. Perceptual evaluation of MITalk: The MIT unrestricted text-to-speech system. In Proceedings of the IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP’80), Vol. 5. IEEE, 572–575.

[176]

David B. Pisoni, Howard C. Nusbaum, and Beth G. Greene. 1985. Perception of synthetic speech generated by rule. Proc. IEEE 73, 11 (1985), 1665–1676.

[177]

Louis C. W. Pols and J. P. Olive. 1983. Intelligibility of consonants in CVC utterances produced by dyadic rule synthesis. Speech Commun. 2, 1 (1983), 3–13.

[178]

R. K. Potter, G. A. Kopp, and H. C. Green. 1947. Visible Speech, D. Vannostrand Co., New York, NY, 28–56.

[179]

Ralph K. Potter. 1946. Introduction to technical discussions of sound portrayal. J. Acoust. Soc. Amer. 18, 1 (1946), 1–3.

[180]

V. R. Prabodhachandran Nayar. 1980. Svana vijnanam. Kerala Bhasha Institute. thiruvananthapuram.

[181]

Anusha Prakash, A. Leela Thomas, S. Umesh, and Hema A. Murthy. 2019. Building multilingual end-to-end speech synthesisers for Indian languages. In Proceedings of the 10th ISCA Speech Synthesis Workshop (SSW’10). 194–199.

[182]

Jeena J. Prakash. 2019. Transcription Correction and Rhythm Analysis for Applications in Text-to-speech Synthesis for Indian Languages. Ph.D. Dissertation. Indian Institute of Technology, Madras.

[183]

Jeena J. Prakash and Hema A. Murthy. 2019. Analysis of inter-pausal units in Indian languages and its application to text-to-speech synthesis. IEEE/ACM Trans. Audio, Speech, Lang. Process. 27, 10 (2019), 1616–1628.

[184]

D. Pravena and D. Govind. 2016. Expressive speech analysis for epoch extraction using zero frequency filtering approach. In Proceedings of the IEEE Students’ Technology Symposium (TechSym’16). IEEE, 240–244.

[185]

William H. Press and Saul A. Teukolsky. 1990. Savitzky-Golay smoothing filters. Comput. Phys. 4, 6 (1990), 669–672.

[186]

J. Ross Quinlan. 2014. C4.5: Programs for Machine Learning. Elsevier.

[187]

Lawrence Rabiner and Biinghwang Juang. 1986. An introduction to hidden Markov models. IEEE ASSP Mag. 3, 1 (1986), 4–16.

[188]

Bindhu K. Rajan, V. Rijoy, Deepa P. Gopinath, and Nimmy George. 2015. Duration modeling for Text-to-Speech synthesis system using festival speech engine developed for Malayalam language. In Proceedings of the International Conference on Circuits, Power and Computing Technologies (ICCPCT’15). IEEE, 1–5.

[189]

A. R. Rajaraja Varma. 1980. Vruthamanjari. DC Books. Kottayam.

[190]

A. R. Rajaraja Varma. 1986. Keralapanineeyam. DC Books. Kottayam.

[191]

Vibavi Rajendran and G. Bharadwaja Kumar. 2015. Text processing for developing unrestricted Tamil Text-to-Speech synthesis system. Indian J. Sci. Technol. 8, 29 (2015), 112–124.

[192]

Vaibhavi Rajendran and G. Bharadwaja Kumar. 2017. Prosody detection from text using aggregative linguistic features. In Proceedings of the International Conference on Next Generation Computing Technologies. Springer, 736–749.

[193]

Vaibhavi Rajendran and G. Bharadwaja Kumar. 2019. A robust syllable centric pronunciation model for Tamil Text-to-Speech synthesizer. IETE J. Res. 65, 5 (2019), 601–612.

[194]

K. C. Rajeswari and M. P. Uma. 2012. Prosody modeling techniques for text-to-speech synthesis systems—A survey. Int. J. Comput. Appl. 39, 16 (2012), 8–11.

[195]

Rajan Saha Raju, Prithwiraj Bhattacharjee, Arif Ahmad, and Mohammad Shahidur Rahman. 2019. A Bangla text-to-speech system using deep neural networks. In Proceedings of the International Conference on Bangla Speech and Language Processing (ICBSLP’19). IEEE, 1–5.

[196]

Krothapalli S. Rao and Shashidhar G. Koolagudi. 2010. Selection of suitable features for modeling the durations of syllables. J. Softw. Eng. Appl. 3, 12 (2010), 1107.

[197]

K. Sreenivasa Rao and B. Yegnanarayana. 2004. Modeling syllable duration in Indian languages using neural networks. In Proceedings of the IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP’04), Vol. 5. IEEE, V–313.

[198]

K. Sreenivasa Rao and B. Yegnanarayana. 2005. Modeling syllable duration in Indian languages using support vector machines. In Proceedings of the International Conference on Intelligent Sensing and Information Processing. IEEE, 258–263.

[199]

K. Sreenivasa Rao and B. Yegnanarayana. 2007. Modeling durations of syllables using neural networks. Comput. Speech Lang. 21, 2 (2007), 282–295.

[200]

K. Sreenivasa Rao and B. Yegnanarayana. 2009. Duration modification using glottal closure instants and vowel onset points. Speech Commun. 51, 12 (2009), 1263–1269.

[201]

K. Sreenivasa Rao and Bayya Yegnanarayana. 2009. Intonation modeling for Indian languages. Comput. Speech Lang. 23, 2 (2009), 240–256.

[202]

Muhammad Masud Rashid, Md Akter Hussain, and M. Shahidur Rahman. 2010. Text normalization and diphone preparation for Bangla speech synthesis. J. Multimedia 5, 6 (2010), 551–559.

[203]

Antoine Raux and Alan W. Black. 2003. A unit selection approach to F0 modeling and its application to emphasis. In Proceedings of the IEEE Workshop on Automatic Speech Recognition and Understanding (ASRU’03). IEEE, 700–705.

[204]

D. J. Ravi and Sudarshan Patilkulkarni. 2011. Text-to-speech synthesis system for Kannada language. Int. J. Adv. Res. Comput. Sci. 2, 1 (2011).

[205]

D. J. Ravi and Sudarshan Patilkulkarni. 2012. Evaluation of Kannada text-to-speech system. Int. J. Adv. Res. Comput. Sci. Softw. Eng. 2, 1 (2012).

[206]

M. Kiran Reddy and K. Sreenivasa Rao. 2018. DNN-based bilingual (Telugu-Hindi) polyglot speech synthesis. In Proceedings of the International Conference on Advances in Computing, Communications and Informatics (ICACCI’18). IEEE, 1808–1811.

[207]

V. Ramu Reddy and K. Sreenivasa Rao. 2011. Intonation modeling using FFNN for syllable based Bengali Text-to-Speech synthesis. In Proceedings of the 2nd International Conference on Computer and Communication Technology (ICCCT’11). IEEE, 334–339.

[208]

V. Ramu Reddy and K. Sreenivasa Rao. 2013. Two-stage intonation modeling using feedforward neural networks for syllable based text-to-speech synthesis. Comput. Speech Lang. 27, 5 (2013), 1105–1126.

[209]

V. Ramu Reddy and K. Sreenivasa Rao. 2016. Prosody modeling for syllable based text-to-speech synthesis using feedforward neural networks. Neurocomputing 171 (2016), 1323–1334.

[210]

V. Ramu Reddy, Parakrant Sarkar, and K. Sreenivasa Rao. 2014. Duration modeling by multi-models based on vowel production characteristics. In Proceedings of the 11th International Conference on Natural Language Processing. 39–47.

[211]

Uwe D. Reichel and Hartmut R. Pfitzinger. 2006. Text preprocessing for speech synthesis. In TC-Star Speech to Speech Translation Workshop, Barcelona.

[212]

Yi Ren, Chenxu Hu, Xu Tan, Tao Qin, Sheng Zhao, Zhou Zhao, and Tie-Yan Liu. 2020. Fastspeech 2: Fast and high-quality end-to-end Text-to-Speech. Retrieved from https://arXiv:2006.04558.

[213]

Sandy Ritchie, Eoin Mahon, Kim Heiligenstein, Nikos Bampounis, Daan van Esch, Christian Schallhart, Jonas Mortensen, and Benoit Brard. 2020. Data-driven parametric text normalization: Rapidly scaling finite-state transduction verbalizers to new languages. In Proceedings of the 1st Joint Workshop on Spoken Language Technologies for Under-resourced languages (SLTU’20) and Collaboration and Computing for Under-Resourced Languages (CCURL’20). 218–225.

[214]

Sandy Ritchie, Richard Sproat, Kyle Gorman, Daan van Esch, Christian Schallhart, Nikos Bampounis, Benoît Brard, Jonas Fromseier Mortensen, Millie Holt, and Eoin Mahon. 2019. Unified verbalization for speech recognition & synthesis across languages. In Proceedings of the Conference of the International Speech Communication Association (INTERSPEECH’19). 3530–3534.

[215]

Brian Roark, Richard Sproat, Cyril Allauzen, Michael Riley, Jeffrey Sorensen, and Terry Tai. 2012. The OpenGrm open-source finite-state grammar software libraries. In Proceedings of the ACL System Demonstrations. 61–66.

[216]

H. P. Rohit and Jagadish S. Kallimani. 2013. Text normalization in concatenative Text-to-Speech synthesis (TTS) for Kannada language. ICECIT.SIT, Tumkur.

[217]

Srikanth Ronanki. 2019. Prosody generation for text-to-speech synthesis. https://era.ed.ac.uk/handle/1842/36396.

[218]

George Rosen. 1958. Dynamic analog speech synthesizer. J. Acoust. Soc. Amer. 30, 3 (1958), 201–209.

[219]

Somnath Roy. 2014. Prominence detection in Hindi: A mathematical perspective. In Proceedings of the International Conference on Computational Science and Computational Intelligence (CSCI’14), Vol. 2. IEEE, 119–124.

[220]

Somnath Roy and Nishant Sinha. 2014. Duration modeling in Hindi. Int. J. Comput. Appl. 97, 6 (2014).

[221]

Shambhu Nath Saha and Shyamal Kr Das Mandal. 2014. Phonetic and phonological interference of English pronunciation by native Bengali (L1-Bengali, L2-English) speakers. In Proceedings of the 17th Oriental Chapter of the International Committee for the Co-ordination and Standardization of Speech Databases and Assessment Techniques (COCOSDA’14). IEEE, 1–6.

[222]

Lakshmi Sahu and Avinash Dhole. 2012. Hindi and Telugu text-to-Speech synthesis (TTS) and inter-language text conversion. Int. J. Sci. Res. Pub. 2, 4 (2012), 1–5.

[223]

J. Sangeetha, S. Jothilakshmi, S. Sindhuja, and V. Ramalingam. 2013. Text-to-Speech synthesis system for Tamil. Proceedings of the International Conference on Information Systems and Computing (ICISC’13).

[224]

Parakrant Sarkar, Arijul Haque, Arup Kumar Dutta, Gurunath Reddy, D. M. Harikrishna, Prasenjit Dhara, Rashmi Verma, N. P. Narendra, S. B. Sunil Kr, Jainath Yadav, et al. 2014. Designing prosody rule-set for converting neutral TTS speech to storytelling style speech for Indian languages: Bengali, Hindi, and Telugu. In Proceedings of the 7th International Conference on Contemporary Computing (IC3’14). IEEE, 473–477.

[225]

Anindya Sau, Tarik Aziz Amin, Nabagata Barman, and Alok Ranjan Pal. 2019. Word sense disambiguation in Bengali using sense induction. In Proceedings of the International Conference on Applied Machine Learning (ICAML’19). IEEE, 170–174.

[226]

S. R. Savithri. 1986. Duration of stop consonants in Kannada. JASI 14, 2 (1986), 3–14.

[227]

S. R. Savithri. 2005. Duration as a Cue for Stress Perception in Kannada. J. Indian Speech Hear. Assoc. 19 (2005), 67.

[228]

Madras SDL, IIT. 2020. Writing Systems followed in Indian languages. Retrieved from http://www.acharya.gen.in:8080/linguistics/wrisys.php.

[229]

S. Aswin Shanmugam and Hema Murthy. 2014. A hybrid approach to segmentation of speech using group delay processing and HMM based embedded reestimation. In Proceedings of the 15th Annual Conference of the International Speech Communication Association.

[230]

Jonathan Shen, Ye Jia, Mike Chrzanowski, Yu Zhang, Isaac Elias, Heiga Zen, and Yonghui Wu. 2020. Non-attentive tacotron: Robust and controllable neural TTS synthesis including unsupervised duration modeling. Retrieved from https://arXiv:2010.04301.

[231]

T. Shreekanth, M. R. Deeksha, and Karthikeya R. Kaushik. 2018. A novel data independent approach for conversion of hand punched Kannada braille script to text and speech. Int. J. Image Graph. 18, 02 (2018), 1850010.

[232]

T. Shreekanth, V. Udayashankara, and M. Chandrika. 2015. Duration modelling using neural networks for Hindi TTS system considering position of syllable in a word. Procedia Comput. Sci. 46 (2015), 60–67.

[233]

Keshan Sodimana, Pasindu De Silva, Richard Sproat, A. Theeraphol, Chen Fang Li, Alexander Gutkin, Supheak mungkol Sarin, and Knot Pipatsrisawat. 2018. Text normalization for Bangla, Khmer, Nepali, Javanese, Sinhala, and Sundanese TTS systems. In Proceedings of the 6th International Workshop on Spoken Language Technologies for Under-Resourced Languages (SLTU-2018), International Speech Communication Association (ISCA), 29–31 August, Gurugram, India. 147–151.

[234]

R. Soorajkumar, G. N. Girish, Pravin B. Ramteke, Shreyas S. Joshi, and Shashidhar G. Koolagudi. 2017. Text-independent automatic accent identification system for Kannada language. In Proceedings of the International Conference on Data Engineering and Communication Technology. Springer, 411–418.

[235]

Richard Sproat, Alan W. Black, Stanley Chen, Shankar Kumar, Mari Ostendorf, and Christopher Richards. 2001. Normalization of non-standard words. Comput. Speech Lang. 15, 3 (2001), 287–333.

[236]

K. S. Sreelekshmi and Deepa P. Gopinath. 2012. Clustering of duration patterns in speech for text-to-speech synthesis. In Proceedings of the Annual IEEE India Conference (INDICON’12). IEEE, 1122–1127.

[237]

Brooke Stephenson, Thomas Hueber, Laurent Girin, and Laurent Besacier. 2021. Alternate endings: Improving prosody for incremental neural TTS with predicted future text input. Retrieved from https://arXiv:2102.09914.

[238]

Kenneth N. Stevens. 1977. Physics of laryngeal behavior and larynx modes. Phonetica 34, 4 (1977), 264–279.

[239]

Kenneth N. Stevens and Arthur S. House. 1955. Development of a quantitative description of vowel articulation. J. Acoust. Soc. Amer. 27, 3 (1955), 484–493.

[240]

Kenneth N. Stevens, Stanley Kasowski, and C. Gunnar M. Fant. 1953. An electrical analog of the vocal tract. J. Acoust. Soc. Amer. 25, 4 (1953), 734–742.

[241]

Robert C. Streijl, Stefan Winkler, and David S. Hands. 2016. Mean opinion score (MOS) revisited: Methods and applications, limitations and alternatives. Multimedia Syst. 22, 2 (2016), 213–227.

[242]

B. Sudhakar and R. Bensraj. 2015. Development of concatenative syllable-based Text-to-Speech synthesis system for Tamil. In Artificial Intelligence and Evolutionary Algorithms in Engineering Systems. Springer, 585–592.

[243]

B. Sudhakar and R. Bensraj. 2016. Performance analysis of Text-to-Speech synthesis system using HMM and prosody features with parsing for Tamil language. Int. Res. J. Eng. Technol. 3, 06 (2016), 2233–2241.

[244]

Guangzhi Sun, Yu Zhang, Ron J. Weiss, Yuan Cao, Heiga Zen, and Yonghui Wu. 2020. Fully hierarchical fine-grained prosody modeling for interpretable speech synthesis. In Proceedings of the IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP’20). IEEE, 6264–6268.

[245]

K. V. N. Sunitha and P. Sunitha Devi. 2018. Unit selection to improve naturalness in speech synthesis. International J. Appl. Eng. Res. 13, 21 (2018), 15011–15015.

[246]

Ilya Sutskever, Oriol Vinyals, and Quoc V. Le. 2014. Sequence to sequence learning with neural networks. Retrieved from https://arXiv:1409.3215.

[247]

Philip H. Swain and Hans Hauska. 1977. The decision tree classifier: Design and potential. IEEE Trans. Geosci. Electronics 15, 3 (1977), 142–147.

[248]

Paul Taylor. 2009. Text-to-speech Synthesis. Cambridge University Press, Cambridge, UK.

[249]

Paul Taylor, Richard Caley, Alan W. Black, and Simon King. 1999. Edinburgh speech tools library. Syst. Document. Ed. 1 (1999), 1994–1999.

[250]

Ryunen Teranishi and Noriko Umeda. 1968. Use of pronouncing dictionary in speech synthesis experiments. In Proceedings of the 6th International Congress on Acoustics, Vol. 2. 155–158.

[251]

Jubin James Thennattil and Leena Mary. 2016. Phonetic engine for continuous speech in Malayalam. IETE J. Res. 62, 5 (2016), 679–685.

[252]

Abraham Thomas and Deepa P. Gopinath. 2012. Analysis of the chaotic nature of speech prosody and music. In Proceedings of the Annual IEEE India Conference (INDICON’12). IEEE, 210–215.

[253]

Neethu Thomas, P. Gokul, Crisil Thomas, and Deepa P. Gopinath. 2015. Non-uniform unit selection using fuzzy ARTMAP for memory based Malayalam TTS. In Proceedings of the IEEE Recent Advances in Intelligent Computational Systems (RAICS’15). IEEE, 218–223.

[254]

Samuel Thomas, M. Nageshwara Rao, Hema A. Murthy, and Coimbatore S. Ramalingam. 2006. Natural sounding TTS based on syllable-like units. In Proceedings of the 14th European Signal Processing Conference. IEEE, 1–5.

[255]

Ingo R. Titze. 1974. The human vocal cords: A mathematical model. Phonetica 29, 1-2 (1974), 1–21.

[256]

Kumud Tripathi, Parakrant Sarkar, and K. Sreenivasa Rao. 2016. Sentence based discourse classification for Hindi story text-to-speech (TTS) system. In Proceedings of the 13th International Conference on Natural Language Processing. 46–54.

[257]

Yoshimasa Tsuruoka, Yusuke Miyao, et al. 2011. Learning with lookahead: Can history-based models rival globally optimized models?. In Proceedings of the 15th Conference on Computational Natural Language Learning. 238–246.

[258]

Peter D. Turney. 2002. Thumbs up or thumbs down? Semantic orientation applied to unsupervised classification of reviews. Retrieved from https://cs/0212032.

[259]

Jan P. H. Van Santen. 1994. Assignment of segmental duration in text-to-speech synthesis. Comput. Speech Lang. 8, 2 (1994), 95–128.

[260]

Susmitha Vekkot and Deepa Gupta. 2019. Prosodic transformation in vocal emotion conversion for multi-lingual scenarios: A pilot study. Int. J. Speech Technol. 22, 3 (2019), 533–549.

[261]

S. Sakthi Vel, D. Muhammad Noorul Mubarak, and S. Aji. 2015. A study on vowel duration in Tamil: Instrumental approach. In Proceedings of the IEEE International Conference on Computational Intelligence and Computing Research (ICCIC’15). IEEE, 1–4.

[262]

M. V. Vinodh, Ashwin Bellur, K. Badri Narayan, Deepali M. Thakare, Anila Susan, N. M. Suthakar, and Hema A. Murthy. 2010. Using polysyllabic units for Text-to-Speech synthesis in Indian languages. In Proceedings of the National Conference on Communications (NCC’10). IEEE, 1–5.

[263]

Vincent Wan, Yannis Agiomyrgiannakis, Hanna Silen, and Jakub Vit. 2017. Google’s next-generation real-time unit-selection synthesizer using sequence-to-sequence LSTM-based autoencoders. In Proceedings of the Conference of the International Speech Communication Association (INTERSPEECH’17). 1143–1147.

[264]

Hongyan Wang and V. J. Van Heuven. 2006. Acoustical analysis of English vowels produced by Chinese, Dutch, and American speakers.

[265]

Wern Jun Wang, W. Nick Campbell, Naoto Iwahashi, and Yoshinori Sagisaka. 1993. Tree-based unit selection for English speech synthesis. In Proceedings of the International Conference on Acoustics, Speech, and Signal Processing (ICASSP’93), Vol. 2. IEEE, 191–194.

[266]

Yuxuan Wang, R. J. Skerry-Ryan, Daisy Stanton, Yonghui Wu, Ron J. Weiss, Navdeep Jaitly, Zongheng Yang, Ying Xiao, Zhifeng Chen, Samy Bengio, et al. 2017. Tacotron: Towards end-to-end speech synthesis. Retrieved from https://arXiv:1703.10135.

[267]

Xizi Wei, Melvyn Hunt, and Adrian Skilling. 2019. Neural network-based modeling of phonetic durations. Retrieved from https://arXiv:1909.03030.

[268]

Joseph Weizenbaum. 1966. ELIZA—A computer program for the study of natural language communication between man and machine. Commun. ACM 9, 1 (1966), 36–45.

[269]

James T. Wright, B. J. Malsheen, and Margot Peet. 1986. Comparison of segmental intelligibility and pronunciation accuracy for two commercial text-to-speech systems. In Proceedings of the Applied Voice Input Output Society (AVIOS’86). 235–261.

[270]

David Yarowsky. 1997. Homograph disambiguation in text-to-speech synthesis. In Progress in Speech Synthesis. Springer, 157–172.

[271]

B. Yegnanarayana. 2009. Artificial Neural Networks. PHI Learning Pvt. Ltd.

[272]

Hao Zhang, Richard Sproat, Axel H. Ng, Felix Stahlberg, Xiaochang Peng, Kyle Gorman, and Brian Roark. 2019. Neural models of text normalization for speech applications. Comput. Linguist. 45, 2 (2019), 293–337.

[273]

Zhilu Zhang and Mert R. Sabuncu. 2018. Generalized cross entropy loss for training deep neural networks with noisy labels. Retrieved from https://arXiv:1805.07836.

[274]

Xiao Zhou, Zhen-Hua Ling, and Li-Rong Dai. 2020. Extracting unit embeddings using sequence-to-sequence acoustic models for unit selection speech synthesis. In Proceedings of the IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP’20). IEEE, 7659–7663.

[275]

George Kingsley Zipf. 1949. Human Behaviour and the Principle of Least-effort. Addison-Wesley, Cambridge, MA.

Cited By

View all

Gupta RBagga SText-to-Speech Conversion Technology using Deep Learning Algorithms2024 11th International Conference on Computing for Sustainable Global Development (INDIACom)10.23919/INDIACom61295.2024.10498536(1122-1126)

R LS SS GV ST MK SText to voice conversion of text embedded in images2024 IEEE International Conference for Women in Innovation, Technology & Entrepreneurship (ICWITE)10.1109/ICWITE59797.2024.10503275(148-154)

Index Terms

Text-to-Speech Synthesis: Literature Review with an Emphasis on Malayalam Language

Computing methodologies

Artificial intelligence

Natural language processing

Language resources

Natural language generation

Recommendations

Development of syllable-based text to speech synthesis system in Bengali

This paper presents the design and development of unrestricted text to speech synthesis (TTS) system in Bengali language. Unrestricted TTS system is capable to synthesize good quality of speech in different domains. In this work, syllables are used as ...

Speech translation system for english to dravidian languages

In this paper the Speech-to-Speech Translation (SST) system, which is mainly focused on translation from English to Dravidian languages (Tamil and Malayalam) has been proposed. Three major techniques involved in SST system are Automatic continuous ...

Text analysis and language identification for polyglot text-to-speech synthesis

In multilingual countries, text-to-speech synthesis systems often have to deal with texts containing inclusions of multiple other languages in form of phrases, words, or even parts of words. In such multilingual cultural settings, listeners expect a ...

Information & Contributors

Information

Published In

464 pages

ISSN:2375-4699

EISSN:2375-4702

DOI:10.1145/3511099

Editor:

Imed Zitouni

Google, USA

Issue’s Table of Contents

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 19 January 2022

Accepted: 01 November 2021

Revised: 01 October 2021

Received: 01 November 2020

Published in TALLIP Volume 21, Issue 4

Permissions

Request permissions for this article.

Check for updates

Author Tags

Text to speech synthesis

TTS literature review

Indian language TTS

Malayalam TTS

Qualifiers

Research-article

Refereed

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

2

Total Citations

View Citations

560

Total Downloads

Downloads (Last 12 months)127

Downloads (Last 6 weeks)3

Other Metrics

Citations

Cited By

View all

Gupta RBagga SText-to-Speech Conversion Technology using Deep Learning Algorithms2024 11th International Conference on Computing for Sustainable Global Development (INDIACom)10.23919/INDIACom61295.2024.10498536(1122-1126)

R LS SS GV ST MK SText to voice conversion of text embedded in images2024 IEEE International Conference for Women in Innovation, Technology & Entrepreneurship (ICWITE)10.1109/ICWITE59797.2024.10503275(148-154)

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Sign in

Full Access

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Full Text

View this article in Full Text.

Full Text

HTML Format

View this article in HTML Format.

HTML Format

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Copied!

Copying failed.

Share on social media

Affiliations

Jasir M. P

Artificial Intelligence Research Lab, Department of Computer Applications, Cochin University of Science and Technology, Kalamassery, Kochi, Kerala, India

Kannan Balakrishnan

Artificial Intelligence Research Lab, Department of Computer Applications, Cochin University of Science and Technology, Kalamassery, Kochi, Kerala, India

Request permissions Authors Info & Affiliations