728.4K
BOBuilt this Real time Block computing programme that lets me track physical objects and bounce digital elements off of them in real-time
Im using OpenCV.js to process my webcam feed live. By converting the video frame to the HSV color space, the code isolates a specific color threshold to find their exact location and angle on the wall. I also built a custom "Corner Pin" mapping tool that uses OpenCV's Perspective Transform math to warp the digital canvas so it perfectly aligns with the physical projector screen(Reverse Projection mapping😛)
Once the contours are found, the coordinates are fed into Matter.js, an awesome 2D physics engine. The script dynamically generates rigid, static collision boxes matching the physical items frame by frame. I even wrote a spatial tracking algorithm to freeze the blocks to prevent jitter
Throw in some bouncing balls that mathematically reflect off the real-world surface bounds.
Built entirely in JavaScript using Anti-gravity
Dropping files for grab soon, stay tuned ;)
#CreativeCoding #ProjectionMapping #GenerativeArt #opencv #javascript
@bongyunng
