![]() However, this is not the only application of LanguageLeapAI. They can also speak English and the Japanese teammates will instead hear the translated Japanese speech generated by Voicevox. LanguageLeapAI's target audience is for users who want to chat with another but do not speak the same language.Īn example is an English-speaking user playing an online game in the Japan server but wants to use voice chat despite not knowing Japanese.īy running both subtitler.py and voice_translator.py, they can understand their fellow Japanese teammates by reading the english subtitles generated in real time. This English text is then displayed on screen using python's tkinter module, essentially acting as subtitles. Once it has detected that a phrase/sentence is complete, it saves the audio into a wav file and sends it to WhisperAI's translate endpoint which translates the speech from the target language to English. The second, subtitler.py, records your application's audio output and listens in the background for any speech. Thorsten has been added as a German TTS program. However, Voicevox can be replaced with any other text to speech program that can speak your desired language for limitless possibilities. Since Voicevox only takes in Japanese text as input and generates speech in Japanese, the project is technically only limited to Japanese as the target language. This file is then played to your target application's microphone input and your speakers/headphones. The translated text is then sent to Voicevox which performs text-to-speech and generates an audio file voiced in Japanese. Once this key is released, it saves your voice in an audio file which is then sent to WhisperAI's transcribe endpoint which runs Automatic Speech Recognition (ASR) on it.Īfter a response containing your speech as text is received, this text is then translated using DeepL's REST API. The first, voice_translator.py, records your microphone whenever a push-to-talk key is held down on the keyboard. ![]() LanguageLeapAI is made up of 2 main python programs. If DeepL is unavailable in your country, an option to use Google Translate instead is available. WhisperAI and Voicevox both have docker images available on DockerHub, so we will be building and running them both via a Docker Compose file.ĭeepL can be interacted with by signing up for a free plan and interacting with its REST API up to 500,000 character limit / month. ![]() Voicevox: Japanese Deep-Learning AI Voice Synthesizer.DeepL Translator: Powered by neural networks and the latest AI innovations for natural-sounding translations.WhisperAI: General-purpose Speech Recognition Model developed by OpenAI that can perform multilingual speech.This project integrates 3 free and open-source AI systems: (Targeted towards English to Japanese and German as of right now) LanguageLeapAI aims to provide you a real-time language AI assistant that can understand and speak your desired language fluently. If you don't want to share the entire document, select the text blocks and then click 'Share' to generate clips.LEAP across Language barriers by using AI to converse with other online users from across the globe! Export and shareĬlick the 'Export' button, you may export the transcription to TXT, DOCX, SRT, XLSX, or PDF formats, or you can click the 'Share' button to generate a unique URL to share the transcript with colleagues or friends online. You can translate the transcriptions into other languages such as English, German, and Spanish via the Notta mobile app. Notta will complete the transcribing in a few minutes. If the file size exceeds 1 GB, you can compress it first before uploading it to Notta. The max file size you can upload to Notta is 1 GB. Depending on the size of the file, it may take some time. Notta will begin transcribing audios automatically soon once you complete uploading files. Enter the dashboard, then on the right side, click 'Import Files,' select Japanese as the transcription language to improve the accuracy, and then drag or click 'Select Documents' to import audios. ![]() Create a Notta account and log in to Notta Web.
0 Comments
Leave a Reply. |
AuthorWrite something about yourself. No need to be fancy, just an overview. ArchivesCategories |