Google Maps VR in Android app

I have an Android app with a map at the moment.

The Google Maps app has a button that appears on the street screen, and when double-tapped, it converts the street view to VR mode. More specifically, it splits the street view into two for a separate image for each eye to be used with the Google map. It then also tracks the device's movements and adjusts the FOV accordingly.

I am creating my own app and want to use this VR feature for maps in my own app.

It seems to me that I have to load two street images immediately next to each other and then update the FOV by reading the device's sensors.

I see this is slow as my implementation is not likely to be as fast as Google.

Is there a way to use native VR mode in a native app?

If not, what would you suggest doing to achieve the same effect?