BABYLON.Augmented Reality ...

[lhx880619]

@Mostafa Kaouri i have cloned your code to run the example. that's very cool~~~ but i think you should hide the cube when there no marker detected. 

[mkaouri]

@lhx880619 Thanks for your advise. The issue is fixed already to hide the cube when there's no marker detected.

https://github.com/mkaouri/jsartoolkit5.git

 

[mkaouri]

YouAugment, a free augmented reality app creator that was developed with BabylonJs 3D Engine and jsartoolkit.

 

- What’s YouAugment AR app creator?
AR app creator is a web enabled application that can help anyone to create their AR app for free and without coding skills. It can work on your iphone/ipad or android enabled devices. It's highly depends on BabylonJs.

- Why I made it?
I’m looking for everyone to get the absolute benefit from Augmented Reality without pain on coding or paying for high cost licenses.

- Why it’s free?
I made it free for you to be part of AR community and let you engage your customers, family or friends to experience the AR technology for any purpose you are looking for such as increasing sales, education, or entertainment.

- How do I support it?
It’s my passion to continue improving and supporting the youaugment AR app creator from my income and interested investors.

- Contact us
If you’ve any question, please feel free to contact me on [email protected]

[HeadClot]

Hey not sure if this is still being worked on. But It would be great to see AR Core support for Babylon.JS

[ozRocker]

Has anyone got this working on iPhone?

I'm running iOS 11.3.1 and I can't get this working, but I have tested other webRTC demos and they work fine.

I tried using artoolkit.debug.js so I can get the actual line of the error but if I use that file I get:

Invalid asm.js: Invalid member of stdlib artoolkit.debug.js:6963

 

I've created a copy of the Babylonjs NFT example here https://preview.punkoffice.com/ar/

When I run on my iPhone 6+ I get this error

[Error] Failed to load resource: the server responded with a status of 404 (Not Found) (babylon.standardRenderingPipeline.js.map, line 0)

then when I touch the screen I get this error

[Error] Unhandled Promise Rejection: TypeError: Type error
createObjectURL (artoolkit.min.js:1:14551)
success (artoolkit.min.js:1:14551)
promiseReactionJob

Does anyone know what I'm doing wrong? Maybe @mkaouri knows?

[JCPalmer]

First, I do not think this ARToolkit uses webRTC at all.  iOS has has implemented webRTC in very recent versions, as you confirm.  AR has nothing to with "video chat", or the otherwise deal with bi-directional video transfer.  Not that it might not be able to handle all local camera streams, but your testing against other webRTC applications is flawed, if this artoolkit does not use it.

I can not find webRTC mentioned in the repo's readme.  If you look at the source, you see they are using navigator.getUserMedia media streaming.  Probably not directly helping, other than to say I think your assumptions might be wrong, & that is Never good.

[ozRocker]

9 minutes ago, JCPalmer said:

First, I do not think this ARToolkit uses webRTC at all.  iOS has has implemented webRTC in very recent versions, as you confirm.  AR has nothing to with "video chat", or the otherwise deal with bi-directional video transfer.  Not that it might not be able to handle all local camera streams, but your testing against other webRTC applications is flawed, if this artoolkit does not use it.

I can not find webRTC mentioned in the repo's readme.  If you look at the source, you see they are using navigator.getUserMedia media streaming.  Probably not directly helping, other than to say I think your assumptions might be wrong, & that is Never good.

WebRTC implements three APIs:

• MediaStream (aka getUserMedia)
• RTCPeerConnection
• RTCDataChannel

https://www.html5rocks.com/en/tutorials/webrtc/basics/

https://medium.com/@leemartin/hello-webrtc-on-safari-11-e8bcb5335295

https://github.com/processing/p5.js/issues/2146

 

 

[JackFalcon]

~ Awesome insights @ozRocker and @JCPalmer...

All tests in this thread were: Google PIXEL, Android, and MS Surface.

Did not see those errors.

[mkaouri]

On 5/23/2018 at 4:38 PM, ozRocker said:

Has anyone got this working on iPhone?

I'm running iOS 11.3.1 and I can't get this working, but I have tested other webRTC demos and they work fine.

I tried using artoolkit.debug.js so I can get the actual line of the error but if I use that file I get:

Invalid asm.js: Invalid member of stdlib artoolkit.debug.js:6963

 

I've created a copy of the Babylonjs NFT example here https://preview.punkoffice.com/ar/

When I run on my iPhone 6+ I get this error

[Error] Failed to load resource: the server responded with a status of 404 (Not Found) (babylon.standardRenderingPipeline.js.map, line 0)

then when I touch the screen I get this error

[Error] Unhandled Promise Rejection: TypeError: Type error
createObjectURL (artoolkit.min.js:1:14551)
success (artoolkit.min.js:1:14551)
promiseReactionJob

Does anyone know what I'm doing wrong? Maybe @mkaouri knows?

 

Hi @ozRocker

The iOS 11 works with Navigator.mediaDevices.getUserMedia, which is already configured in the Artoolkit.min.js. 

That sounds great... but still missing the video attribute "playsinline".

So, either you configure the attribute playsinline in the artoolkit.min.js after var video=document.createElement('video'); or replace  var video .... with var video=document.getElementById('video') and add the following video tag in the HTML:

<video  id="video" autoplay playsinline></video>

And make renderCanvas overlay on that video tag using position: fixed with z-index: -100 style. use this style on both tags: canvas and video.

If video camera still not showing, it could be from the video source configuration. In the 'var success = function(stream)' replace the video.src = window.URL.createObjectURL(stream) with video.srcObject = stream

If the iOS 11 showing the front camera, you've to make sure that faceMode constraint in artoolkit.min.js is set to 'environment' to use the back camera of your mobile.

Hope this will work.

 

[MackeyK24]

Yo @Deltakosh I can’t really tell from this thread. 

Do we officially support Augmented Reality. If so how to use. I see a guy made some kind of app creator but I am interested in support for this as an option for the toolkit.

 

[Guest]

We have nothing out of the box but you can use ar.js for proxy based AR or use a webapp inside a native app to use ARCore or ARKit

[MackeyK24]

That’s kool, just seeing or hoping someone in the community made some kind of support for this too ?

[JackFalcon]

This project is scheduled to continue in 2019. Need a good app 1st (check) then AR/VR as new version. : )

[MarianG]

Hi. I no more find examples with ar.js and babylonjs, most of the links are 404 NotFound ?. Can you help me please with a 'maybe old' version from scratch. Thank you. @jeromeetienne @JackFalcon

[brianzinn]

hi @MarianG, I didn't really follow the AR.js - from my recollection it was relying on another engine renderer.  If you are not specifically after AR.js, do the jsartookit examples no longer work https://github.com/mkaouri/jsartoolkit5?

Also, BabylonJS 4.0 has AR via WebXR, if that meets your needs (it's very early market for browser support).  I haven't been following close enough, but otherwise if you want a demo of that (like magic window) check here: https://github.com/BabylonJS/Babylon.js/issues/3899

[MarianG]

Thanks @brianzinn.
Actualy I checked webXR support from babylonjs, and I faced some issues, or I didn't understand very well how it work,...maybe I'll open a different topic for this. And I think I'll focus on this once webXR will be by default enabled on browser.
 I tried jsartoolkit5, and I'm faceing some problems with this too ? in one device is opening front camera, in other is opening back, and sometimes I lost camera for some reasons, I have to deep learn about this.
 ... and I have remembered about this topic and I wanted to check some links from here but most of them are NotFound. I hoped it'll be faster to do a simple example?

[brianzinn]

5 minutes ago, MarianG said:

in one device is opening front camera, in other is opening back

From @mkaouri "If the iOS 11 showing the front camera, you've to make sure that faceMode constraint in artoolkit.min.js is set to 'environment' to use the back camera of your mobile."

[JackFalcon]

looking into this...

babylonjs is no longer at this location on Ar.js:

https://github.com/jeromeetienne/AR.js/tree/dev/babylon.js

@jeromeetienne, friend, any info on AR.js + Babylon status?

Also @brianzinn is right - original solution cross-matrix calculations (because I don't understand matrix inversions..), but then jerome etienne figured out how to make them babylon specific (details above).

Old, but still have a backup if needed...

[DylanD]

On 12/28/2018 at 10:31 PM, JackFalcon said:

looking into this...

babylonjs is no longer at this location on Ar.js:

https://github.com/jeromeetienne/AR.js/tree/dev/babylon.js

@jeromeetienne, friend, any info on AR.js + Babylon status?

Also @brianzinn is right - original solution cross-matrix calculations (because I don't understand matrix inversions..), but then jerome etienne figured out how to make them babylon specific (details above).

Old, but still have a backup if needed...

Hey uh, theres a new forum, not sure if you knew that.  Maybe create a new post with this linked to it so we dont loose all this KNOWLEDGE

https://forum.babylonjs.com/

[Wingnut]

Yeah, Jack, what the hell is wrong with you?  heh.  Get your butt over to the new forum, we're only about 1/4 done with the house-warming party. 

And, we need a fresh announcement for Boxigon, at the new forum, too.  C'mon! 

[JackFalcon]

... Wingnut to the rescue. Great to see you and happy holidays.

Thank you for the assist Dylan. I was off tracking down some leads.

And with help from friends... bird finds new forum. Thanks. : )

Yes -> there is important news around PWA - it will be big for us. 

See you on the other side.

~jf

[JackFalcon]

Paging @davrous... referenced your great work in new forum: https://forum.babylonjs.com/t/pwa-babylonjs-on-homescreen-template-and-boxigon/532/6 

Please join us as we rock out PWAs! 

And thanks for showing us how BTW. : )