Is there an option to create a Snapchat-like features addon to interact with video calls? - microsoft-teams

Is there a way to create an add-on “snapchat-like” video feature for the video calls?
I want to build an app that will get and manipulate the user camera stream source, then the user will decide if and when to share it on his ms-teams calls.

Currently we only have Calls and online meetings support for bot. There is no support for processing video call stream yet.
As of now we don't have more details to share on this.

Related

How to embed audio in Slack via API?

We want to be able to embed an audio file in a Slack chat via the web API.
So far I managed to files.remote.add but that's just an external link.
Then I tried files.upload and share it to a channel, it does embed and play right inside Slack, but for us it's a suboptimal solution, as users can easily download the file, which is against our requirements.
Is there another way to achieve this?
PS: I've read almost all the documentation, there doesn't seem to be an audio or media block type, although I've seen examples that cite a file block type which is neither documented in the API and it's not defined in Bolt. (at least there are no type definitions for it for typescript)
It's not currently possible to embed a media player (audio or video) via the API. We're constantly tuning our APIs, if you have a specific use case in mind, would you mind writing in to feedback#slack.com and we'll get it logged. Thank you!

OpenTok real-time audio transcription

I am trying to transcribe the audio in an OpenTok session in real-time. The OpenTok API does not not seem to have that feature. Is there any way I can capture the data in some form and push it to another script/ tool that makes the transcription?
The issue is not with transcribing, the issue is in accessing the live audio stream data and using it in real-time.
You can get access to the video/audio stream (MediaStream) with https://tokbox.com/developer/sdks/js/reference/OT.html#getUserMedia in client SDK.
You can manipulate audio using available API from WebAudio spec.
Publish audio from an audio MediaStreamTrack object. For example, you can use the AudioContext object and the Web Audio API to dynamically generate audio. You can then call createMediaStreamDestination().stream.getAudioTracks()[0]on the AudioContext object to get the audio MediaStreamTrack object to use as the audioSource property of the optionsobject you pass into the OT.initPublisher() method. For a basic example, see the Stereo-Audio sample OpenTok-web-samples repo on GitHub.
This above GitHub example is about injecting your audio stream. However, you can also extract/capture your audio before injecting it. See detail here...
https://developer.mozilla.org/en-US/docs/Web/API/Web_Audio_API.

How to cast a specific song programatically with Cast Audio

I'd like to hook up a bttn such that when that button is pressed, a specific song is played through my speakers using the new Chromecast Audio. I couldn't find documentation for a REST API that would allow me to accomplish this.
Is there any direct hookup that would be possible such that I can call some REST API to play audio through Cast Audio?
There is no single rest apis to do so; the process of casting a media, using the Cast SDK, amounts to starting a discovery, selecting (connecting to) a device, setting up the so-called RemoteMediaPlayer and then loading a media. There is plenty of documentation on our Cast documentation site that helps you follow and implement the above steps, along with a good number of sample apps.

how to show a youtube video into WP7 application?

I want to develop a WP7 application. In this one, I would like to get video from youtube. For example, videos of a channel.
So, I know, I need youtube API, but I don't find a simple example to subscribe a channel and receive the latest video...
Is it possible ?
Thanks in advance , have a nice day !
I think there are simple RSS feeds for each channel... If there are no RSS feeds, parse the HTML feed (e.g. http://www.youtube.com/user/nokia/feed)
To play youtube videos, see
http://mytoolkit.codeplex.com/wikipage?title=YouTube
WP7 currently doesn't have a standard media layer for YouTube videos and you need the YouTube app in order to be able to play those. Unless you want to work on a low level with the encoding format used by YouTube, but then again - you would have to implement a decoding service.
To play a youtube Video you need to use the WebBrowserTask and open the target URL in the browser; if the youtube app is installed, it will play, if not installed, it will prompt the user to install and then play.
How to subscribe ?
I don't think if it's possible to make that directly from your app...

Audio chatting and phone calls through browser

If I want to create online phone for small office with web client (through Astrisk/Adhearsion) how can I stream IN/OUT audio right in my browser (like GTalk do). Preferably without Java applets and without Flash.
I need to get voice stream from Astriks call, stream it in browser, receive audio from mic and send it back to Astrisk.
And what shoud I choose for streaming audio IN/OUT as backend? XMPP?
You can't. There isn't a standard way (currently) to do what you are looking to do. You need something to help you out. This is often done in the form of a Flash application.
Google actually uses a browser plugin from Vidyo to make this happen effectively.

Resources