glTF 2.0 video texture support - three.js

I have been reading the glTF specs and looking around and haven't been able to find an explicit answer to this: are video textures supported by glTF 2.0 or one of its extensions? Could anyone point me to the right thread or documentation if such exists?
Thanks!

This might be possible with the upcoming KHR_texture_transmission extension. However, it is not finalized yet. Check out the following presentation for more information:
https://www.khronos.org/assets/uploads/developers/library/2018-gdc-webgl-and-gltf/glTF-Texture-Transmission-GDC_Mar18.pdf
It says on page 12:
Video Texture formats currently in design phase

Related

Convert GLB with animation to USD format?

I am working with threejs library. I want to convert glb animation file format to usda animation format? İs there any way/library to do it. Any answer would be helpful. Thanks :)
three.js provides GLTFLoader and USDZExporter, but the USDZ exporter does not support animation at this time. I'm not aware of any JavaScript USDZ exporter that does, currently.
Beyond that, your best option would be to use a non-web tool like USD from glTF, which must be run on your computer or a server that you can install software on.

Run time AR image target creation for Unity

Is there an SDK that supports run time image target creation for Unity?
I have tried User Defined Target from Vuforia but it does not give me the option to save the image for future use.
8th Wall SDK has image target support. You can provide an image at runtime by simply provide the RGB pixels to the engine configure call.
8th Wall calls into your phone available native support. So if you have ARKit, it uses ARKit image detection. If you have ARCore, it will call into ARCore (arcore 1.2 has image detection support but it just got released so it will take the 8th wall team a bit of time to roll out its support). The nice thing is you write your code once and it will just work.
Note: I worked on this product as my day job and was involved with this specific feature. Feel free to add comment to this answer if you would like more info.
Creating your own with tools like OpenCV is an option, and relatively easy. You can do this using either packages like OpenCV for Unity on the Unity Asset Store or EmguCV (paid).
This requires more work and a bit more understanding of computer vision, but there's useful tutorials available and I believe both packages provide examples that would cover what you're after.

How to load a glTF file in OpenGL ES

So after spending time looking around, I am not sure how I would even go about loading and using a glTF file I have found and want to use for my OpenGL ES 3.0 program.
Are there are loaders or am I charge of extracting all the data from the glTF file?
EDIT:
I am developing on Android API 24 with NDK to use OpenGL ES 3.0
AFAIK, as of today (April 2017), there is no easy/official way to load & draw a GLTF model in native/mobile environments - the webgl ecosystem is currently more friendly.
GLTF being quite young, you would have to find some code around, or build your own.
Another alternative would be to try to use assimp to convert your GLTF model to a format that you can easily display.
Check out the ATW Vulkan Sample from Khronos Group

3D engine collision detection modelimport

I am about to find a 3d engine which is capable of importing 3d models, detect their collisions and support joints. It's needed for an interactive animation and no platform is specified jet. I would prefer to code Javascript or AS3, but I think to be able to handle this with Java too.
Does Away3d support this? Is their a plain 3D collision detection framework I could use additionally to it? Which is the easiest Java Framework and which creates best Quality?
BTW.:
Proprietary Frameworks might also be an possibility, but I just do not any.
Greetings philipp
Away3D has Awayphysics library that is alchemy port of C++ engine and show very good performance. Away3D has clean readable source code and documentation + good set of example projects. It has 3ds max plugin that can export scene and generate code to render it. Support popular formats like 3ds, obj... and You can write importer plugin for own format. All so developers are pretty cool guys that answer questions on forum :)
For JavaScript the most popular engine is three.js Look what it can do.
General thoughts:
WebGL support isn't good at this time(sometimes it depends not only on user browser but all so on drivers) and You will need to deal with cross browser headache. Flash isn't supported on IOS and get kicked more and more from device browsers. But there is cross-platform adobe air for standalone apps.
Javascript, in my opinion, isn't good for writing such projects and its debugging can cause permanent brain damage. WebGL shader language is GLSL that has nice C-like syntax. Ordinary Flash shaders are written on assembler but You may try pixelbender3d. At this time Flash shaders more limited than WebGL(for example you can't fetch texture in vertex shader) but it's done to make Flash more compatible and it's not a problem for most cases. WebGL is tightly integrated with page.
If you want java WebGL and like pain try GWT 3D engines or gwt-elemental and there is tree-js port at early stage.
x3dom is declarative WebGL 3D engine with fallback to Flash it is ez but pretty limited and unstable.

Suitable technologies for a Windows video tool

A few years ago, DirectShow was around and let you manage video on DirectDraw surfaces. But since then I think both technologies have been replaced. What's currently the best solution to let you make a Windows app which can let you composite/blend/mix videos/music together? Does one still need to go the DirectX route with surfaces/textures, or is functionality found in the core Windows APIs?
Examples might be to overlay an image on a playing video, overlay two videos on top of each other with a transition effect, etc.
Apart from core technologies to handle video/audio, are their good 3rd-party libraries? Or maybe the core APIs have enough functionality on their own?
If you're talking managed code?
Microsoft.DirectX.AudioVideoPlayback
Short tutorial here:
http://forum.codecall.net/csharp-tutorials/20436-tutorial-playing-video-files-managed-directx.html

Resources