The Engineering Masochism of a 5,000-Piece Puzzle Robot
The Infinite Complexity of a Simple Task
Building a machine to perform a leisure activity sounds like a paradox, but for a hardware enthusiast, it's the ultimate stress test. Constructing a robot to solve a 5,000-piece puzzle—specifically one painted entirely white—presents a gauntlet of mechanical and computational hurdles. While a human might spend years matching shapes by trial and error, a robot requires a level of precision that makes standard DIY projects look like child's play. The project demands a custom-built gantry, a vision system capable of sub-millimeter accuracy, and a way to handle thousands of physical objects without jamming. It's a classic case of "integration hell," where individual components work perfectly in isolation but clash when united.
CoreXY and the Quest for Speed
To move pieces across a massive table, weight is the enemy. Standard gantry designs often mount heavy motors on the moving axes, which limits acceleration and introduces vibration. The CoreXY belt arrangement solves this by keeping the heavy stepper motors stationary at the corners of the frame. This setup uses a complex, winding belt path where the motion of both motors coordinates the X and Y movement. Pulling the belts in opposite directions moves the cart, while pulling them in the same direction moves the entire beam. It allows for aggressive speed, though it requires significant tuning to prevent belt skipping when the high-torque motors bite into a fast move.
Vision Precision Through Telecentricity

Standard camera lenses are terrible for measurement because they introduce perspective distortion. If you look at a puzzle piece through a wide-angle lens, you see the sides and edges at an angle, making it impossible to calculate the true footprint. To fix this, the build utilizes a telecentric lens. This specialized optic views the world as if it were infinitely far away, looking through a straight "tube" of light. This ensures that the piece is the same size regardless of its distance from the lens and eliminates the parallax error that would otherwise tank the matching algorithm's accuracy.
Software Calibration and Vibration Control
Even with a solid frame, mechanical play can ruin the assembly. To counter this, an OptiTrack camera system tracks the gantry's position in real-time, allowing the software to correct for non-square motion on the fly. However, moving a heavy gantry at high speeds creates massive vibrations. The solution involves structural bracing with tensioned steel cables—turning the table legs into rigid, non-flexing supports. For the final version, the table is designed to be a hollow vacuum plenum, capable of sucking 5,000 pieces down to the surface through 30,000 tiny drill holes to ensure they don't wander during assembly.
The Storage Nightmare
Where do you put 5,000 pieces while the robot thinks? Making the table larger wasn't an option, so the design includes a series of motorized magazine. These use a clever multiplexing system where a single motor on a rail slides between 21 different lead screws, lowering platforms as pieces are stacked. This avoids the cost and wiring nightmare of 21 individual motors while providing a vertical storage solution for a problem that would otherwise take up 35 feet of height if stacked in a single column.
- Brilliant
- 14%· companies
- CoreXY
- 14%· products
- integration hell
- 14%· science
- magazine
- 14%· products
- multiplexing
- 14%· science
- Other topics
- 29%

A simple human task that's insanely hard for a robot
WatchStuff Made Here // 20:04
I've been building things for as long as I can remember. It all started when my dad exposed me to plastic model building and soldering when I was around 4 years old. That set me on a path to building increasingly complex things and becoming an engineer. My goal is to do the same for as many people as possible by exposing them to the joy of engineering, fabricating and creating things out of nothing. If I'm lucky a few people may become engineers, which would be great for the world. Engineering is awesome. If you're interested in sending me something: P.O. Box 78470 Charlotte, NC 28271