How to capture voice from the microphone in Decentraland? - decentraland

I have checked the Decentraland SDK documentation here. But there is no API for capturing voice from the microphone. I am trying to capture the sound and integrate it with a Conversational AI system like Google Dialogflow. 1. Is is possible to record voice from the microphone in Decentraland ? 2. Is there some alternative way to achieve this like using a nodejs library that integrates with the Decentraland SDK ?
For the second question, I could not find any node library that integrates with the Decentraland SDK.

Related

Flutter Windows simple voice recording app

I am trying to make a simple voice recording app via microphone using Flutter on Windows. I want to avoid writing C++ code and using method channel if possible. I was wondering if there is an easier way you can do it using Flutter.
I already tried searching on pub.dev for package which supports voice recording on Windows but I didn't find any.

Implementing a TTS service for Windows 10

I'm working on a research project in which we create a new text-to-speech (TTS) engine, that converts text to spoken audio.
As the engine is already performing good, we try to make it usable by a large number of applications which made us want the engine to show up as a TTS voice on Windows 10.
In Microsoft's developer documentations, all I found was information on how I can use exisiting/already installed voices in my application. However, I didn't find any information on how to implement a voice so that it shows up as a Windows voice and can be used by any application using the Speech SDK or SAPI.
Which interface do I have to implement or what API do I have to connect to in order to get our new TTS engine work with Windows Speech?
I already crawled the documentation of the Microsoft Speech SDK as well as developer sites like https://learn.microsoft.com/en-us/dotnet/api/system.speech.synthesis.ttsengine
You should look at the TTS Engine Vendor Porting Guide. You need to implement ISpTTSEngine, which does all the work, and ISpObjectWithToken, which manages registration and creation.

Xamarin and play videos with FairPlay or other DRM

I'm trying to stream a content from Azure Media Services, but I can't get it to work, so I'm wondering if it's doable, and if so, how do I achieve it? The content is protected by FairPlay. Similar issues on Android and Windows.
I tried to use Xamarin Media Player but it doesn't work with FairPlay because it requires an ExoPlayer2 implementation which is not yet in the plugin.
I don't think that is possible with the current version of the Xamarin Media Manager. Let me also correct the mistaken assumption about ExoPlayer2. ExoPlayer is a strictly Android only playback component, and so has nothing to do with FairPlay at all, as FairPlay is Apple only technology.
For FairPlay to work, you have to listen to events that are specific for FairPlay to handle the license exchange. Those do not seem to be implemented in Xamarin Media Manager as far as i can see. So you would have to do those platform specific implementations yourself. Information about these can be found on the Apple Developer site.
For Android, you would likely want to go with Widevine, which is implemented in ExoPlayer. I can't find any documentation for Xamarin Media Manager on how to set that up either though.

Access system audio in UWP App

I would like to write an app that
accesses the audio by being played by the user in another app
analyzes that audio
displays the analysis to the user
however, I have not found anything that makes this seem possible. Can apps access access the audio being played through the user's speakers as a byte stream or is this not built into the API?
Can apps access access the audio being played through the user's
speakers as a byte stream or is this not built into the API?
You can do that(Loopback recording), but you need to program with low level APIs - WASAPI. For available APIs for UWP, check the Core Audio part in Win32 and COM for Windows Runtime apps and Universal Windows Platform (UWP) apps (multimedia)
Here is an old article for 8.1 app, but it still applies to UWP on concept level. And Microsoft has provided a sample on GitHub about WASAPI and Core Audio API, which may help you to familiar with the APIs and understand how to make it work in UWP app.
Use the MediaCapture class to capture audio. link to docs

VOIP application - MediaElement output on ear-piece

I am developing a SIP based VOIP Application and stuck on following issue,
1 -- I am Able to play with the SIP Protocol and Server and able to get Audio data in PCM 8000 Sampling rate format,
2 -- for Playing Audio i am using MediaElement framework, and using this framework its giving output in SmartPhone multimedia Speaker, Is there anyway to get default output on the Ear-Piece, and let user to choose, whether they want to attend the call trough Speaker or through Speaker,
it seems WP8 has got this support, but i didn't find it for WP7
This is not possible.
Unless, you'll contact Microsoft and negotiate yourself a privilege to compile native ARM code. Some companies (e.g. Tango, Spotify, Garmin) did.

Resources