It’s a ‘just for fun’ project for motion tracking in YouTube videos.
Available in the Chrome Web Store.
Link: https://chrome.google.com/webstore/detail/youtube-motion-tracking/cpjloofnnmchhbdbdchjnhfoclnjliga
Some example animations: https://www.youtube.com/watch?v=P4DzAWm5mqg
I am grateful for any feedback.
And so far I have only tested it with MacPro 2021. Everything runs very smoothly. Maybe someone has older hardware available for testing and can write something about the performance.
Due to other ML topics and time constraints I have to stop working on this experiment.
It was interesting to see what is currently possible.
Real-time motion detection in the browser for YouTube videos without external API calls.
A more useful use case for this should still be designed.
Many thanks to the TFJS team for making this experiment possible.
A demo video of the latest version is available here.
If you want, try the extension from Chrome Web Store for free.
The code is available on GitHub.
If you want to create your own browser extension, it’s easy with TensorFlow.js.
There are only three steps necessary.