Using Camera

[mizuki1412]

When using camera, I have to click the allow button every time, is there any way to avoid it?
Something like "unsafely-treat-insecure-origin-as-secure" of chrome?

[leaanthony]

The best thing you can do is ask/search over at the webview2feedback repo and if they suggest that there's a webview2 preference that needs setting we can look at supporting it https://github.com/MicrosoftEdge/WebView2Feedback

Excited to see what you're building with the camera!

[leaanthony]

Also, do you have a test repo so I can test this? Thanks

[mizuki1412]

Yes, I think can add in the windows.Options .

And, I will prepare a test repo soon. Thanks!

[mizuki1412]

Hi, this is my test repo https://github.com/mizuki1412/webcam-test-wails. Thanks

[leaanthony]

Hi @mizuki1412 - please try latest version on master. Webcam working 👍

[mizuki1412]

nice!! It works well, Thanks!

[hermanbanken]

Wails 2.0 on WebKit doesn't seem to expose navigator.mediaDevices. Is this a known issue, or is this new in Wails 2.0?

[hermanbanken]

This doc notes

If you don’t implement this method in your delegate, the system returns WKPermissionDecision.prompt.

so either Wails is actively denying, or something weird is going on here.

[leaanthony]

Maybe it's denied by default. If there isn't a ticket for this, please open one and we'll add it to the backlog 👍

[hermanbanken]

https://github.com/wailsapp/wails/blob/b93cdcd942cc70686fc2790038707496948ff7ea/v2/internal/frontend/desktop/darwin/WailsContext.m

Nothing here, but this seems fairly trivial. I’ll add an issue/PR tomorrow (EU-based).

[marcio199226]

any progress about this ?

[leaanthony]

No. Do you fancy taking it on? Happy to accept a PR!

[fairking]

I am also thinking of camera implementation. Just wondering would it be better to capture camera in backend and then stream the video to the frontend? Also to control the camera by sending commands from the frontend? Why do we need to handle it by the webview?

As far as I know the byte streaming is not supported but it could open a wide range of possibilities like video calls, music player, qr code scanner etc.

[fairking]

I am not interested in frontend (webview) camera integration. I would like to process some camera data in backend using golang and then stream the result to the frontend.

Something like that: CreateSharedBuffer. It is not actually a stream but I guess it could send such buffers as chunks one by one simulating a stream.

Apart of that I think any hardware integration (sensors) should happen in backend. The WebView is a representation layer and it should not be used to process any data (nor integrate hardware), but to be able to receive such data for representation (rendering).

Please note: Wails role is not for camera (or any other hardware) integration support. Wails should provide a solid and simple communication support between the presentation layer (WebView) and the business layer (backend, golang). Everything else is up to devs what they can do with that. IMHO.

Examples:

• https://github.com/vee2xx/camtron (removed)
• https://github.com/AlexxIT/go2rtc
• https://medium.com/go4vl/building-a-webcam-with-go-and-go4vl-7b56d2c54e39
• https://medium.com/learning-the-go-programming-language/realtime-video-capture-with-go-65a8ac3a57da

[zhaojunliing]

camtron

It uses electron to get the camera and send it to the backend.

[fairking]

So in this case it is not suitable to me then. And again, it is not about camera, but about ability to stream data to the frontend (webview).

[leaanthony]

We'll look at supporting CreateSharedBuffer in v3 👍 I was looking at the docs yesterday.

[iamkhalidbashir]

Has v3 planned for this?

[madeindra]

My Wails apps need microphone access and days ago it work perfectly normal without any config, today it can't get access to navigator.mediaDevices saying it's undefined.

I'm on MacOS, seems like adding this to Info.plist and Info.dev.plist between <dict> </dict> solves it

<key>NSMicrophoneUsageDescription</key>
<string>This app requires access to the microphone</string>

If you need camera access in your wails app and it keep saying navigator.mediaDevices is undefined, try using this:

<key>NSCameraUsageDescription</key>
<string>This app requires access to the camera</string>

[ndelvalle]

I wonder if there is a way to setup this without modifying the build folder, something that can generate this for every build target.