Help with personal game-based CV project
Hopefully useful explanation of the problem
Hello all,
This is my first post on this subreddit. I am a fan of the game Sea of Thieves, and I thought it would be interesting to base some computer vision-based projects on it. There's a lot I can do in this problem space. My eventual goal might be something like path prediction for firing cannonballs, taking into account the sea state. I'm not quite sure yet.
I'm building up useful pieces for now, but as far as gunning accuracy, one problem I face frequently is not being able to reliably adjust my shots. In the game you can fire the cannon at various things (other ships for instance) and obviously you can either hit the thing or miss it. When the target is close, this isn't too bad, but when the target is far, I usually try to do some ranging shots first and dial it in from there. The problem arises that when I take a ranging shot, then observe the cannonball, I find it difficult to "adjust" based on what orientation I fired the shot.
All this background to explain that my first concrete task for this project is to simply be able to calculate and display the pitch and yaw of the cannon. I've always had kind of a hard time with trig and linalg, and I'm very "self-taught" with computer vision, so I also find it hard to really google about this problem and try to learn from there. I believe the problem I am trying to solve is "pose estimation" for the camera, is this correct? Where can I find a good guide for estimating camera pose? Is there something simple I can and should be doing?
Thank you for your time. Attached is a video of me panning a cannon all around for reference.