Waken Koopa Troopas Final Delivery: The Mario Detection System and Koopa Kompanion app

First, a video showcasing it all in use!

Technical explanation:


It all starts with a Raspberry Pi 4 Model B equipped with a camera:

The Rapberry Pi runs a facial recognition script, based on Caroline Dunn’s Raspberry Pi facial recognition repository: https://github.com/carolinedunn/facial_recognition.
The facial recognition algorithm uses the OpenCV (Open Computer Vision) library, and detects front-facing faces using Haar-cascades.
We’ve added a few short lines of code to send the image to Power Automate as a base64 string:

The power Automate flow is simple enough:

When the image is uploaded, another Power Automate flow takes over and notifies all Koopas (app users):

In the app, you can see all the Mario Bro sightings in a gallery list:

From here, Koopas can select a sighted Mario Bro and “handle” him. Once the bro has been dealt with the Koopa will be asked to confirm this with a photo of the defeated bro.
Once the kill is confirmed, the Koopa is awarded with 10 points!

The Koopa can then check their standings in the scoreboard, or on their own profile page:

Last but not least, there’s the Anti Mario Taskforce Training game.
The game works through several Timer controls, that each set the state of a separate group of images. The state is an int, and on the end of the timer, a random int between 0 and the amount of images in the group is selected. The separate images then have a short If condition in the Visible property which is true if their group state number is equal to the images number.

When the user clicks or touches the images, the image changes to have an explosion effect layered on top, a sound effect plays and their score is added to or subtracted from depending on what they hit.
Once the game timer runs out, the players score is stored on their profile information which is located in a Dataverse table so that it can be used throughout the app on the scoreboard and Profile pages!


Killer AI

With TWO killer AI that detects Mario and Luigi, the app make sure no Mario is left undetected. One AI is from a beautiful Rasberry Pi that has the surveillance camera attached to it. The Koopa puts this up around their house or where ever they want to feel safe. This AI will give the Koopa a notification whenever a Mario or Luigi passes by or is creeping.

We are also using power apps AI Builder to detect Mario/Luigi. We have chosen Prosses Image and object detection. Our Object detection model is trained to detect Mario and Luigi based on their beard and hat. Users can take a photo or select one already available in the device, and when an image is loaded, the component automatically scans it to identify Mario/Luigi.

We are also using power apps AI Builder to detect Mario/Luigi. We have chosen Prosses Image and object detection. Our Object detection model is trained to detect Mario and Luigi based on their beard and hat. Users can take a photo and when an image is loaded, the component automatically scans it to identify Mario/Luigi and if a Mario/Luigi is detected it adds a score of 10 to the user.

Still under training!!

Pandoras Box

Inside the Koopa Kompanion app, we have made a training program, so that Koopas who are a little afraid to kill Marios can practice, or just have a little break and have play a fun little game.

The game includes Marios that suddenly appear, and you have to kill them as fast as possible. Each time you hit a Mario you get points, but if you hit a friendly Koopa troopa, points will be taken from your score. The game also has immersive sound-effects!

You can always see your highscore on the homepage of the game, or on your profile and the scoreboard, so that you can keep up with your work.

Additionally, we would say the app itself is fun to use all around 🙂

Excellent User experience

Us Koopa Troopas haven’t gone to Harvard or Stanford, we are not super clever. Because of this we had to make the app easy to use, with colors that feels like home and we know are friendly. With four easy buttons on the menu bar on the bottom on the screen, the Koopas can easily navigate the app, from “Huntlist”, “Scoreboard”, “Training” and “Profile”.

Each site have titles that look familiar, so that we can feel safe. In addition to this, we have used Mario-based iconography all through the app, so the theme is consistent all the way through!

The Huntlist has a refresh button so that Koopas can always stay up to date with who is leading in kills. When a Koopa have chosen a target, they first have to defeat it, and after that they must confirm the kill using an object detector.

The Scoreboard shows what Koopa is leading in Mario Bros elimination, and also shows each Koopas highscore in the Anti Mario Taskforce Trainer.

On the profile page you can see your own information, like score from kills and highscore in the training game.

Most extreme business value

What is so good about the Koopa Kompanion – a mario detection system, is that it can be used wherever you want, for a lot of different purposes. While we prefer that it is used for it’s original purpose of stopping the Mario Bro terrorist organization, there are many other use cases for our creation!

A couple of examples:

  • Its time for a wedding, and you are hoping your stalker Browser don’t show up. You can install the Mario Detection System a few places around the wedding venue. If Bowser decides to ruin the wedding, you will know ahead of time, because you got a notification on your phone or your watch that Browser was detected. You can hire security guards to take him down before he causes a scene.
  • Lets say you are a wonderful yet loveless reptilian overlord, on the lookout for the princess of his dreams. By training the Mario Detection System on images of said princess, and attaching MDS-camera modules to your always willing minions, you could get instant notification of the princess’ current location. The object of your desire will no longer be able to hide!

The possibilities are endless! In a real world scenario, there are many uses for a system like this, especially considering the relatively small package the facial detection comes in!

It could be especially useful in security scenarios, especially for security centrals covering large areas/building with over 100 cameras, it could be used to reduce the amount of people needed to keep watch on everything. After all, there’s only so many camera feeds you can cram into one monitor. With our system, you could detect if a camera sees a person, and then only show feeds with people in them. Less time spent watching nothing!


We are implementing a face recognition app, Our app can address several challenges and provide solutions to various problems. Face recognition can improve security by replacing or supplementing traditional access control methods and face recognition can provide a convenient and secure method for verifying identities.

Putting Security-central Koopas out of Work: Automatically detecting miscreants for “apprehension”

One of our team members, Odin, has had the unfortunate experience of working in the security industry for 11 years. And he does not want anyone else to suffer the same fate.

That’s part of the reason why we created the Mario Detection System!

By creating a system for automatically detecting unwanted person (GDPR be damned), many security centrals around Bowsers kingdoms can now be emptied of all fault-prone flesh-based detection mechanisms!

And fewer Koopas have to be bored out of their mind on a 12-hour Sunday night shift in a dark and lonely security central 😉

Glossy Pixels / Chamelon

Glossy Pixels: For our app have we used Mario themed icons and Since we are Waken Koopa troopas have we choosen color-codes that represent Koopa Troopas colors. Green for their shell and yellow for their body.
Synne, being our lead designer, made sketches for our final design:

Our final design ended up quite close to the envisioned design:

We also have a minigame where you get to hunt as many Mario can, where we liberally use Mario inspired design language.

Our app is available both for desktop and mobile users. We also have built a responsive canvas app, however the minigame is only available in portrait mode so no one gets an unfair advantage 🙂

Pro code <3 Low-code

We have used both low-code platform and with pro code in in our solution.

The Pro code:

We are using Raspberry Pi to run our Mario Detection software. There was some programing needed to get it to work!!!
The Mario Detection camera posts the image, encoded in base64, to a Power Automate flow. The flow then uploads the image to a sharepoint folder, and another flow then sends a push notification to the Koopa Kompanion app.

The Low-code:

By using Power Apps—a low-code tool, helpful prebuilt templates and drag-and-drop tools, we could easily put together a nice front end for Koopas in the field.

Never back down! Never what!


Yesterday we did an amazing job, but still the judges did not agree with us, and we ended up with very few points in the fight for the title. Third to last, but that never stopped us.

Our motivation:


– waken Koopa troopas

Today, we put blood, sweat, and tears into our work.

With remarkable team spirit, we have risen… in rank.. singular. Forth to last.

A win is a win! LETSGO!

All koopas need training

The Mario vs Koopa Troopa war is brutal, and the Koopas need to be able to take Mario out.

In our Mario Detection System app we have created a training program so that the Koopas can practice their Mario Hunting/Killing skills.

You have 60 seconds to click on and kill as many Marios as possible. And your highscore will be saved in the games home screen.