The Family Game of Visual Perception

During quarantine I found myself playing a lot Set - a card game where you try to find sets of three cards that fit certain constraints

And example Set board

A set is three cards where each individual feature (color, shape, number and shading) is either all the same OR all different - here are some examples

examples of sets using the above board

Naturally, this had to be automated. My friends were running a "casual distanced hackathon" and I chose this as my project. Here was the hardware setup I used:

Hardware setup

Using the Kinect as a (annoying to work with) RGB camera I was able to take in images and do processesing in OpenCV and python. The program looks at an image of the board, labels the cards, finds sets and reports them with a refresh rate of 0.25s on my 2018 ultrabook.

Here is a video demonstrating it:

I was very happy with what I was able to create in one weekend in my first hackathon -- I'd definitely do another in the future