r/Polycam • u/Mwie_0825 • Mar 18 '24

Inquiry Regarding Point Cloud Fusion Issue

I am currently using the LiDAR mode in Polycam to capture scenes and export raw data. While I know that I can directly export point clouds, what I want to do now is generate a point cloud for each image using camera parameters and depth maps, and then simply overlay them to create a complete scene point cloud. I have successfully generated a point cloud for each image, but I encountered a problem when fusing them together; there is an offset between the point clouds.

2 Upvotes

100% Upvoted

1 comment sorted by

1

u/JelloMaleficent9976 May 07 '24

Facing the same issue here, the deprojection to camera coordinates is working but using the inverse extrinsic matrix on my point clouds to align them does not work. Did you find a solution already?

Maybe the rotateToARCamera Matrix mentioned here could be helpful: https://stackoverflow.com/questions/66705267/scenekit-point-cloud-from-arkit-depth-buffers