Soooo. This is it! First off we will try to explain all the functionality and features of our solution. From the working android app to the admin dashboard and statistics for the Road Authority employees and notifications to next-of-kin in case of emergencies. Also we have some comments regarding the four main categories, and assess how we feel we answered them individually.
We had a lot of fun and would also like to take this opportunity to thank the organisers, jury members and all the other teams for an amazing event. Thank you!
That’s-a so nice!
Super mario
What started off as a quirky, fun mario kart related idea, quickly turned into a solution to reduce serious car accidents. Our app detects bananas, but the could, and should, be upscaled to detect other things that can prove a danger. Bananas are indeed dangerous, but there might be even bigger dangers, as we discuss below.
Short technical description:
AI model
We had lots of fun making the training data for the model, from the arts and craft part of it with cut-out bananas, to running around in the snow placing said bananas.
After filming loads of bananas from the car, we fed the videos to our model, and had it identify frames where there possibly could be bananas. We trained it over several days to include different types of weather and degrees of sunlight.
For more details concerning the data and training our model, see hte Data mine(kart) post.
A phone is placed in the car, and when running the app, bananas that appear will be detected. When a banana is detected from the car, the driver gets audio visual clues alerting them to the dangers ahead.
API
When a banana is detected alerts are also sent to our API, running the following steps:
User information is fetched from Entra ID
Next of kin information is retrieved from a SharePoint list
A Power Automate flow is triggered, this handles the following: Notifications to next of kin Registering incident in Dataverse
A map is generated based on the coordinates, and an optimised route is set if there are more than one incident
A notification is sent via Teams to the Banana Removal Car Dispatcher, with all data they need (timestamp and location)
Alert status is changed sending a request to the endpoint controlling the visual indication in the vehicle
The most impressing thing is that the detection actually works, and we are super proud of our result.
Excellent User Experience We have two primary user groups. The drivers who run the app on their phone in the car, and employees at the Banana Detection Service. For the first group, less gui is good gui. You run the app, and that is it. We don’t want to distract the drivers with lots of flashy things, just simply give them a feeling of safety, knowing all bananas are detected. For the other user group on the other hand, they need a lot of tools. Both for efficient banana removal, but also to keep their minds busy. We have a simple but beautiful admin panel with maps, games and statistics:
Most Extreme Business Value The business value we add are actually pretty extreme. Detecting bananas is important and fun, but on a serious note, this detection model can be upscaled to detect actual impediments and objects that should not be hit by a car. Like animals or actual persons. Also – automated reporting to first responders and road safety authorities adds proper, real-life value.
Alternatively, we as a society, can place big banana stickers on everything that shouldn’t be hit by cars, but that seems a bit silly. Maybe just tell people to carry more bananas when crossing the road?
Pandoras Box Bananas, games and alerts. What can be more fun than that? Also we have more mario mini figures to bribe you with 🙂
Killer AI This is probably our strongest card, to be honest. We have built our model ourselves, fed it with a lot of self filmed data, and trained it on said data. We are quite happy with the accuracy, on approx. 93 per cent average confidence on banana detection. We have made the model open source so that others can reuse it.
As mentioned above, the model can be trained to detect other things. The possibilities are as many as there are objects in the world. Future uses that seem useful from the top of our heads:
Car key finder
Wallet finder
Jury soft spot finder
Bonus content, footage of us training our model in order to handle different types of weather.
The BPMN diagram below is a simple representation of our KoopaKonstruct Manager.
In summary we are using Hololenses to inspect a chosen area where we want to e.g. hang up a coat rack, build a table, and similar. In order to make the Hololenses smart, we have integrated OpenAI. We are using Function calling to provide instructions about the requested project, information about necessary materials and quantity.This is where we are making our KoopaKonstruct really smart.
As real #Crawlers we use OpenAI’s Function calling to dynamically create the search criterias based on natural language. Google Speach to text is used to capture the natural language query. We are really integrating into everything that flips bits #Embedding numbnuts! With help of the search criterias, we are able to provide critical information further into the supply chain, meaning all the way down to the FinOps where we are improving critical business processes (this will be explained later in this blog post).
Below is a picture from the Hololenses where we use a button to speak with AI:
GPTVision helps us interpret work drawings and breaks it down into the steps needed, so that we can get a clear instruction of what materials we need, how many and how to build the desired object. Using Power Automate, we are able to share and send the item details and necessary quantity into FinOps.
As an addition to the OpenAI magic, we have also created a canvas app that is integrated in the Hololense #PlugN’Play. From this app you can perform business processes, such as triggering sales orders, check inventory status, and 4 different Power BI reports to monitor sales orders and follow up late deliveries #Dash it out.
And here is where we really improve business processes; when the information is sent to FinOps we use X++ code to check inventory status. If materials are in stock, a sales order is created and sales order confirmation is sent. If there are no (or not enough) materials in stock, we also create a purchase order in addition to the sales order. A link between the purchase order and sales order is created, enabling the ability to understand where the demand is coming from. Additionally, to make the KoopaKonstruct Manager adaptable to e.g. construction companies, we have created the possibility to link the purchase and sales orders with projects. This provides a lot of possibilities for detailed project management for the finance geeks.
Below is our argumentation to why we believe we should score high on all 4 categories!
Most Extreme Business Value
Our team embarked on a quest to redefine the meaning of business value, and we present to you KoopaKonstruct Manager – a solution that not only orders products through Hololenses but catapults business efficiency into a realm beyond imagination.
Automating the Complete Supply Chain with Hololenses
We harnessed the power of Hololenses to revolutionize the way products are ordered. One user, equipped with the mighty Hololens, registers the necessary quantity with a mere wave of the hand, triggering a Power Automate flow like a seasoned Mario collecting power-ups.
The adventure doesn’t stop there! Our Power Automate flow seamlessly transmits the order information to FinOps using the Execute action. The magic unfolds as FinOps automatically generates a sales order and a purchase order based on inventory stock. But here’s where the plot thickens – these orders are not solitary entities; they are linked together, creating a dynamic duo that unravels the mystery behind each purchase. There is no need to spend as much as a second wondering how or why the orders were created; the link indicate that there is a demand behind each purchase order.
See yourself sitting in an ordering office at a company where the customers are able to generate sales orders by only entering a demand. And, in addition to the automatic creation of sales order, imagine that you did not have to study the master plan to generate the purchase order as it is automatically created! And as a side salsa, you did not even have to trigger the sales order confirmation as it is sent automatically. So, while you are sitting there wondering about what to do with your life (and how long it takes before the CEO finds out that you are useless as the power of Power Automate and X++ took your job), you can relax and focus on other more important things in life, such as playing a Super Mario game.
Power Stars: Automated Project Linkage
But wait, there’s more! We also increased the business value for construction and engineering enterprises. With the ability to automatically link both the purchase and sales orders to projects, we’ve bestowed upon industries that thrive on projects a golden opportunity to enhance their efficiency and project management. It’s not just about ordering; it’s about constructing a bridge to a new era of project-linked prosperity.
The Warp Whistle to Most Extreme Business Value
We make a bold claim for the “Most Extreme Business Value” category in this year’s ACDC Hackathon. Here’s why our adventure deserves the highest score:
Efficiency: Our solution isn’t just about ordering; it’s about efficiency power-ups that automate the entire supply chain process, from order initiation to linkage in FinOps.
Dynamic and Time-saving: The automatic creation of linked sales and purchase orders provides unparalleled visibility into demand and supply, laying the foundation for strategic business decisions.
Project Linkage: For construction and engineering businesses, our automated project linkage is a treasure trove of golden coins, offering enhanced project management capabilities and business value beyond the ordinary.
Adaptable: Our solution is not only limited to the B2B-market, but can also be used for the B2C-market. Making the app available to customers, they can create orders automatically and receive high quality service as the complete supply chain has become even more efficient.
Excellent User Experience
We have created a Super Mario inspired canvas app that is adapted into the Hololenses. In other words, our app transforms ordinary into extraordinary!
Features:
Killer AI
Whether you’re a seasoned AI veteran or just dipping your toes into the mushroom-filled waters of innovation, our solution is a testament to the power that AI holds in shaping the future.
KoopaKonstruct Manager is not just a game-changer; it’s a game-transformer. Through the mastery of machine learning, we’ve empowered our solution to evolve, adapt, and learn from the challenges it encounters. From predicting order quantities to optimizing supply chain processes in the real world (and in FinOps), our AI-driven approach is a power-up for efficiency and foresight.
In the quest for the Killer AI “crown”, KoopaKonstruct offers more than just automated processes. It also includes magic in form of predictive insights, providing a glimpse into the future of demand, supply, and project landscapes. Strategic decision-making becomes second nature as our AI-driven system transforms data into actionable intelligence.
A mind of its own
In the pursuit of the existential risk badge, our AI solution goes beyond mere execution—it thinks, learns, and adapts with a mind of its own. Through autonomous decision-making capabilities, it navigates the complexities of supply chain processes and provides responses not even a 20 year old is able to find without searching the web.
KoopaKonstruct isn’t just smarter than a 5th grader; it engages in intelligent conversations that transcend the limitations of a classroom. It doesn’t just provide answers; it grapples with FinOps and supply chain complexities, understands nuances, and offers insights that reflect a level of intelligence resembling a dynamic dialogue.
Why KoopaKonstruct Manager deserves the Killer AI “crown”
Innovation Beyond the Blocks: KoopaKonstruct isn’t confined to the traditional boundaries. It breaks through the blocks of conventional solutions, paving the way for a new era of AI-driven innovation.
Adaptability in Every Pixel: Our solution dynamically adapts to the ever-changing business environment, ensuring resilience and adaptability in every pixel of our solution.
Mind Mastery: Our AI isn’t just a tool; it’s a mastery that elevates KoopaKonstruct into a symphony of efficiency, intelligence, and strategic foresight.
Pandoras Box
Equipping a Hololens with AI that can answer questions, order materials, and assist in selecting the right materials and tools for any project based on online instructions transforms DIY into an accessible experience for the less handy. This technology takes the guesswork out of building, offering tailored advice on what to build, the best materials and tools for the job, and even suggesting projects that match your interests and available space. It’s like having a personal tutor and assistant rolled into one, guiding you through the entire process from conception to completion. This seamless integration of technology with hands-on work not only makes crafting projects more approachable for beginners but also enriches the experience with educational value, ensuring that anyone can undertake and succeed in their DIY endeavors with confidence.
NerdeNinjas introduces a pioneering suite of applications, reshaping the landscape of race management through the integration of cloud-based and Microsoft Power Platform technologies. This comprehensive solution streamlines every aspect of race management, from preparation to execution, blending efficiency with innovation.
Preparatory Tools
CustomGPT: AI-Driven Content Creation
Core Function: CustomGPT, powered by GPT Studio, revolutionizes content creation, automating blog posts and solution descriptions.
Key Benefits: Offers AI-driven efficiency and consistency in content generation, crucial for digital marketing and information dissemination.
Dataverse: Advanced Data Management
Role in Data Handling: Dataverse provides a robust platform for data storage, modeling, and security.
Integration and Security: Seamlessly integrates with Microsoft services, ensuring high-level data security and streamlined management.
Python Scripts for Race Data Generation
Data Creation: Utilizes Python scripts to generate a rich dataset encompassing hundreds of race statistics.
Application: This dataset is pivotal for deep analytics and strategic planning in race management.
The Comprehensive SolutionÂ
Canvas App: Streamlining Race Enrollments
User-Focused Design: Offers an intuitive and efficient platform for race participants to sign up and receive updates.
Impact on Experience: Enhances participant engagement and simplifies their interaction with race events.
Model-Driven App for Race AdministratorsÂ
Administrative Efficiency: Specifically designed for race administrators, this app streamlines event planning and management.
Automated Tools: Reduces the administrative burden with a suite of automated tools, optimizing the organization process.
Power Automate: Automated Race Statistics
Automation at Work: Facilitates automatic entry and management of race statistics, ensuring accuracy and timeliness.
Integration with Data Sources: Seamlessly pulls data from various sources, providing a cohesive statistical overview.
AI Chatbot in Microsoft TeamsÂ
Advanced Features: Integrates a sophisticated AI Chatbot within Microsoft Teams, offering functionalities like chat memory and result statistics.
Enhanced Communication: Streamlines communication within teams, providing quick access to race information and sign-up features.Â
Power BI for Race Analytics
Real-Time Insights: Delivers a comprehensive analytics platform powered by Power BI, offering real-time data visualization and insights.
Strategic Advantage: Aids in strategic decision-making by providing in-depth analysis of race performance and trends.
Conclusion
NerdeNinjas’ solution represents a significant leap in race management technology. By harmoniously integrating advanced tools like CustomGPT, Dataverse, Python scripts, Canvas App, and Power BI, we have crafted a solution that not only addresses the logistical complexities of race management but also enhances strategic and administrative efficiency. This suite is a shining example of how cloud-based technologies can be synergistically combined to revolutionize industry practices, setting a new benchmark in sports administration and management.
Note: This expanded blog post draft comprehensively outlines the different components of the NerdeNinjas’ solution, emphasizing how each part contributes to the overall efficiency and innovation of the race management system. It’s crafted to highlight the cutting-edge use of technology in transforming traditional practices.
Welcome to our groundbreaking blog post, where we embark on a journey through the dynamic landscape of innovation, efficiency, and seamless automation. In today’s digital era, businesses are constantly seeking robust solutions to elevate their operations, and in this exploration, we present a lineup of powerful products and components that redefine the realm of possibilities.
At the forefront of this technological evolution is the “Power Page,” a hub of capabilities designed to enhance user experiences and drive operational excellence. Join us as we delve into the intricacies of the Copilot Studio Chat Bot, seamlessly integrated with the prowess of Power Automate flows. This powerful duo promises to revolutionize communication channels and automate tasks, streamlining workflows with unparalleled ease. We have also integrated Power BI visualizations for showing player progress and overviews.
Behind the scenes, we delve into the backbone of our system – the Dataverse. This robust backend storage solution effortlessly manages progression course levels and active user data, providing a foundation for scalability and adaptability. Witness the synergy between technology and data management as we navigate through the capabilities of Dataverse.
But that’s not all. Enter the PCF Component, specifically Koopa’s AI Challenge, a cutting-edge addition that brings artificial intelligence to the forefront of your applications. Explore the possibilities as we unravel the potential of this innovative component in enhancing user interactions and engagement.
Last but certainly not least, our journey wouldn’t be complete without a glimpse into actionable insights provided by Power BI Reports. Transform your data into visual narratives, gain meaningful insights, and make informed decisions to drive your business forward.
Together, these products and components form a formidable alliance, promising a holistic and transformative approach to your digital endeavors. Join us as we navigate through the intricacies of each element, paving the way for a future where efficiency and innovation coexist harmoniously. Welcome to the era of empowered possibilities – welcome to the Power Page Chronicles.
ALM – Deployment
We have created tree environements for development, testing and production purposes. We have automated the deployment process with ALM – pipeline.
Imagine you’ve developed a robust solution in your Dev environment, and now it’s time to move it to UAT and eventually to Prod. However, you want to ensure that changes don’t go live without proper scrutiny. That’s where an approval process comes into play.
Power Automate
Power Automate allows you to create automated workflows that connect different services and applications. We’ll leverage Power Automate to trigger the approval process when a user requests a solution deployment.
Microsoft Teams
Microsoft Teams provides a collaborative workspace for your organization. We’ll use Teams to notify an admin group about pending solution deployments and allow them to approve or reject the changes.
Setting Up the Approval Workflow
Let’s break down the steps:
1. User Requests Deployment
A developer completes the solution in the Dev environment.
When ready for deployment, they initiate the process by requesting it through a designated channel.
2. Power Automate Workflow
Create a Power Automate flow triggered by the user’s deployment request. Sends an adaptive card to admin group in Microsoft Teams
3. Approval in Microsoft Teams
The adaptive card is sent to an admin group in Teams.
Admins receive a notification and can review the deployment details.
They can either click approve or reject after review is done.
Following the introduction of our foundational technologies and their impact on business operations, we now turn our attention to the heart of our digital innovation: the game component, ingeniously embedded within our Power Page. This game, dubbed “Koopa’s AI Challenge,” is not just a testament to our creative prowess but a strategic tool designed to engage, educate, and entertain users in a uniquely interactive environment.
The Genesis of Koopa’s AI Challenge
At its core, “Koopa’s AI Challenge” leverages the dynamic capabilities of Phaser 3 for game mechanics, married seamlessly with the sophistication of React and TypeScript (TSX) for development. This blend of technologies allows us to present a game that is not only visually appealing but deeply integrated with the educational and interactive objectives of our PCF comopnent.
Integration into Power Page
The integration of the game within the Power Page is a feat of technical ingenuity. By embedding the PCF (Power Apps Component Framework) control, we ensure that the game is not an isolated experience but a cohesive part of the user’s journey on our site. This approach allows for a seamless transition between learning modules and interactive gameplay, enhancing the overall user experience and engagement.
Leveraging Phaser 3 for Game Mechanics
Phaser 3 stands at the forefront of our game development, providing a robust framework for creating immersive 2D gaming experiences. Its extensive suite of tools and features enables us to craft complex game mechanics, such as character movement, obstacle navigation, and interactive challenges that users must navigate through. This results in a game that is not only fun to play but also challenges the user’s problem-solving skills and application of knowledge acquired through the platform.
React and TypeScript: A Powerful Duo
The use of React and TypeScript for developing the game’s interface and logic ensures a highly responsive and intuitive user experience. React’s component-based architecture allows for efficient updates and rendering, making the game fluid and engaging. TypeScript, with its strong typing, enhances code quality and reliability, ensuring that the game mechanics are robust and error-free.
The Educational Twist
What sets “Koopa’s AI Challenge” apart is its educational underpinning. Each level of the game corresponds to a course or module within the platform, challenging users to apply what they’ve learned in a practical, engaging context. This gamification of learning not only reinforces knowledge retention but also adds an element of fun to the educational journey.
Integrating seamlessly within our Power Page, we leverage Power BI to vividly display user progress through dynamic, interactive reports. This integration ensures that users can visually track their achievements and milestones, enhancing motivation and engagement. Simultaneously, our solution taps into the Dataverse API to fetch course content, ensuring that each user’s journey through the courses is smooth, personalized, and up-to-date. Complementing these features, our site hosts a Copilot Chatbot, a virtual assistant ready to offer users guidance, answer queries, and provide support for course-related challenges. This trio of features—Power BI progress visualization, Dataverse content integration, and Copilot Chatbot assistance—synergistically elevates the user experience, making our solution not just a tool, but a comprehensive learning companion.
Conclusion
“Koopa’s AI Challenge” is more than just a game; it’s a bridge between education and entertainment, powered by cutting-edge technology and integrated seamlessly into our Power Page. As users navigate through the levels, they’re not just playing; they’re learning, engaging, and interacting with content in a way that’s both innovative and impactful. This game is a cornerstone of our digital offering, exemplifying our commitment to creating solutions that are not only technologically advanced but also meaningful and user-centric.
As we conclude our exploration of the Power Page Chronicles, “Koopa’s AI Challenge” stands as a beacon of our innovative spirit, showcasing the potential of combining technology, education, and gaming in creating transformative user experiences. Join us on this journey of discovery and empowerment, where each interaction is an opportunity to learn, grow, and be entertained.
Video with a full playthrough of the entire experience above.
We have created a game framework AND a game using the framework. During ACDC 2024 in 3 days! We used Power Platform and the products within like, Power Apps, Power Automate, Copilot Studio and Dataverse. We also used Azure DevOps for ALM and making the solution portable to other tenants and environments.
We have created a framework for a gamified way to learn. This framework can be reused to create new games with all kinds of thinkable subjects.Â
The framework has predefined content like
Game progress
Start and Story
Quests and Tasks
Finale
points
layouts
dialog boxes
inputs
outputs
Exceptional looks!
Images for backgrounds and characters can be customized to create a unique look and a complete new looking game and story. Look at this blogpost for screens:Â Great user experience and beautiful screens!
Quest and tasks
The Quests in the game can be created by adding new entries to the Quest and task tables. The tasks can be of any kind, just limited by the creators imagination.
In this solution we have tasks like:
Point and click
Puzzle
Send in an external email to unlock a task
This methology and design makes it easy to adjust and add content, making it reusable for all kinds of training or fun (or both some will say….)!
Of course we have AI!
A large amount of the actual content is generated by AI. Images and stories are created by custom GPTs within OpenAI.
Intelligent NPCs!
A NPC follows the user in the game and will guide the player. This makes the game a lot more fun and personal. The character has a personality and will answer question about the environment the player currently is in. The player ask in natural language and the NPC answers by using generativ AI. This is implemented as a custom prompt in Copilot Studio.Â
The information to the NPC is feed from the game database. This means that new quests and tasks will automatically be fed to the NPC.Â
Step into the Mushroom Kingdom 2.0, where Princess Peach is rewriting her story! Tired of the age-old cycle of rescue, she’s embracing empowerment in 2024. The team Boouvet present to you –> EMPEACHMENT – a groundbreaking app revolutionizing Peach’s quest for independence.
About the app
In order to achieve her ultimate goal in becoming independent, she must complete four modules. The modules are prepping and learning her skills to be her own master in Mushroom Kingdom. The modules are:
the good and the bad
Problem solving.
Exploration
Jumping Skills
As she is learning these skills, she can unlock several power ups that she can use in the Mushroom kingdom. She can also check her progress in a statistic page, where see can her review her strong and weak sides. To complete each module, she must play and collect enough coins and unlock several power ups along the way.
FIGMA:
EMPEACHMENT (APP):
Resource management
To enhance her skills, Peach can track her progress in the app’s Statistics page. Through Power BI-generated charts, she gains insights into her strengths, weaknesses, and overall progress. This visual data helps her identify areas that require further improvement, guiding her towards achieving the ultimate goal of independence.
HOW IT WORKS
Modules
The good and the Bad
After enduring prolonged captivity and countless kidnappings by the notorious Bowser, Peach is determined to distinguish friend from enemies.
In this revolutionary app, Peach is presented with profiles of Mushroom Kingdom characters. Using a Tinder-like interface, she can swiftly make decisions – swiping right or clicking the heart for allies, and swiping left or hitting the ‘X’ button for potential enemies. It’s a modern twist on the age-old struggle for independence, and can be called PeachyConnections.
However, PeachyConnections isn’t about finding love; it’s about staying safe. By engaging with this innovative app, Princess Peach trains her ability to discern who stands by her side and who poses a threat. It’s her proactive approach to navigating the challenges of her kingdom and breaking free from the cycle of perpetual captivity.
Following each gameplay session, Princess Peach can track her performance with a clear breakdown of right and wrong decisions. To successfully complete the module, she aims to accumulate enough coins in her overall score. The Statistics page provides a detailed view of her progress, offering insights into her evolving abilities and achievements. It’s a dynamic way for Princess Peach to measure her advancement towards independence in Mushroom Kingdom 2.0
HOW IT WORKS
This part of the application has been taking use of a custom PCF-component taken from PCF Gallery called Swipe. When swiping through characters the custom PCF acts as a layer which registers whether you’ve swiped left or right. This then triggers a process which includes a Power Automate flow where the Power Apps trigger passes two parameters Character description if Princess Peach (User) and if she has swiped correctly. The Power Automate uses these two parameters and leveraging an HTTP action to pass the information with a prompt through OpenAI’s Web API. Power Automate then gives the resulted answer back to the Power App and the user can use the full summary to learn about the details of the swiped character and the choice done by her. A great platform to learn and giving context of the reason it is correct or wrong answer.
Problem Solving
In this module, Princess Peach’s problem-solving skills are put to the test, focusing on her knowledge of the Mushroom Kingdom. The challenge involves answering multiple-choice questions accurately. Should she encounter a particularly tricky question, she can turn to “Ask Toad” for assistance. Toad, being Mario’s trusty helper, naturally extends a helping hand to Princess Peach in her moments of “damsel in distress.” The “Ask Toad” feature serves as a supportive chatbot, ensuring that Princess Peach can overcome any difficults situation with ease.
HOW IT WORKS
There is a database full of questions created with Bing AI. These questions and answers are displayed in a gallery. When Peach clicks an answer, one point is added if she clicked the correct answer, and one point is deducted if it’s incorrect. The gallery buttons also change color to indicate which is the correct answer.
Toad, an AI bot powered by Copilot Studio, learns from the web and adapts to new data. It uses advanced machine learning algorithms to understand and interpret information. This continuous learning makes Toad a versatile tool for tasks like data analysis, content creation, and problem-solving. It represents the next generation of AI, ready to assist with its ever-growing knowledge.
When Peach uses Toad for help, it triggers a power automate that again triggers a C# Azure function app so that we are able to track how often Peach uses AI for help. The idea here is to add to the KPI’s in Power BI so we have more useful data about how difficult the questions are, how often the user has to seek help and so.
Exploration
The Exploration module immerses Princess Peach in the art of navigating the intricate landscapes of the Mushroom Kingdom. A perilous realm filled with unexpected dangers – from clouds ejecting pig shells to sentient flowers with an appetite for mischief. While unconventional, it’s a survival-of-the-fittest scenario for Princess Peach.
Within this module, Princess Peach encounters diverse worlds, each harboring both kind and hazardous elements. By interacting with these elements, she gains insights into what aids or threatens her survival. With four distinct worlds to explore – sea, land, desert, and sky – Princess Peach must choose wisely. Selecting favorable elements earns her coins, while interacting with perilous one’s results in point deductions.
To triumph in this module, Princess Peach must accumulate enough points by making strategic choices and mastering the art of distinguishing between the Kingdom’s treasures and its potential pitfalls. It’s a test of survival instincts and strategic decision-making in the fantastical realms of Mushroom Kingdom.
How it works
The screen displays a picture with buttons in front of a landscape. Some people/items are predefined as good and some are bad. Peach earns one point if she clicks on an item or person that is considered good, and loses one point if it is bad.
Jumping skills
Mastering jumping skills is crucial in the Mushroom Kingdom. This module focuses on Princess Peach ability to judge how far she can jump safely. Using the app, she can measure distances and receive instant feedback on the feasibility of each jump. Repeating this process allows her to learn and make informed decisions about her jumping capabilities, ensuring she doesn’t attempt jumps that are beyond her reach. It’s all about enhancing her judgment for safer navigation through the kingdom. To successfully finish the modules, Princess Peach needs to accurately measure multiple safe jumping distances, gathering the necessary coins in the jumping skill module.
How it works:
We have implemented a out of the box solution called mixed reality and customized it to our needs. Especially the measuring feature, so Peach herself can point between two real life objects that she thinks she can make the jump between and get instant feedback about how it would go.
There is a threshold for her built in that increases as she levels up. So she (hopefully) gracefully increases her jumping abilities as she plays the game.
Power Ups
As Princess Peach learn different skills in the modules, she will gain power ups as she starts to collect coins. Power-ups are crucial for Princess Peach’s journey to independence. They enhance her abilities, mitigate risks, and provide versatility in problem-solving. By unlocking new areas and boosting her confidence, power-ups symbolize her empowerment in the Mushroom Kingdom, aligning with her ultimate goal of breaking free from the traditional damsel-in-distress role. To unlock a power up, Princess Peach must collect coins. Unlocked power ups are shown with a unlocked icon, while locked powers ups are shown with a lock. This will potentially motivate Princess Peach to unlock more power ups as she learns new skills.
DESIGN
In our development process, we prioritized the user experience, ensuring the best possible interaction. The color palette was picked from Princess Peach’s dress, jewels, and crown, aiming to evoke a sense of familiarity and safety for the user. Every page was designed in Figma before the actual development phase.
We employed clear and concise language, explicitly outlining the goals for each module to ensure Princess Peach’s understanding and engagement. Additionally, we conducted contrast checks across the entire design, considering the possibility of any vision disabilities Princess Peach might have. We also included several elements from the Mushroom Kingsom or Mario universe, like the coins, power ups and Toad, to endorse the sense for familiarity even further for Princess Peach. Buttons are placed within thumb reach at the bottom, to make sure easy access to navigation.
Join her on this tech-driven journey as she breaks free from the clutches of Bowser. It’s time for a new era, where Princess Peach takes control of her destiny!
Upgrade to Mushroom Kingdom 2.0 – Empowerment awaits!.
Our solution is built from multiple services and components. Our frontend is built with NodeJS and React with Typescript and SASS. These technologies make the user experience feel seamless and super quick in the browser.
The flow of the system starts with a user uploading their order request in our React frontend form which is then stored in our Azure Storage account. The plumbers receives the order and can start planning!
Only one click away, our customized Azure Custom Vision model is up-to-date on bathroom floor plans and maps out the coordinates of the different plumbing fixtures, sparing the plumber of tedious work.
Then, our custom made Azure Function App backend in C# Asp.net plans the piping based on the coordinates from the AI model, and draws the piping layout. The backend API then returns the piped-up floor plan to the frontend, drawing hot water and cold water pipes according to each of the bathroom components needs. The backend also calculates the equipment needed to build the bathroom, and provides a list of required equipment for the project. It also calculates a total project cost. Both the piping supplies and floor plan is saved in our Azure Blob Storage.
Because of this, the people working in the back office have instant interactive reports available to help them with filing and billing through Power BI.
The components of our architecture
It’s a wrap!
We had an amazing time at the Arctic Cloud Developer Challenge (ACDC) hackathon! Our team was so happy to work on a project that was both fun and challenging. We were able to create a plumbing planning system that was not only functional but also visually appealing
The judges were a group of highly experienced and knowledgeable people who were passionate about technology and innovation. We were impressed by their expertise and the valuable feedback they provided.
Overall, the ACDC hackathon was an incredible experience, and we learned a lot from it. We are grateful for the opportunity to participate and showcase our skills. We look forward to participating in future hackathons and continuing to develop our technical abilities!
Step into the world of Peaches Mini Games, where education meets innovation and business value takes center stage. Join us on a journey through an English classroom case study, user-centric design principles, and the integration of killer AI in crafting an engaging quiz game. Uncover the core philosophy behind Out of the Box Fun and understand why our participation in this competition is driven by a passion for spreading joy and fostering inclusivity. This post will guide you through the various components of Peaches Mini Games, providing insights into its educational impact, user-centric design, and groundbreaking use of AI technologies.
Most Extreme Business Value
The business value of Peach Mini Games is linked to education. The game is designed to make learning motivating for children while providing valuable insights for teachers. By analyzing the results from the game, teachers can tailor their instruction, optimize time usage, and address each student’s specific competency level.
Let’s go through the business value with a case study.
English teacher Katrine is going to teach class 2A about Australia. She wants to focus on where the country is located and what makes it special. She plans to use traditional chalkboard teaching methods, but to ensure that the students have truly grasped the information, she needs to assess them. She will do this in two ways:
Quiz
Glossary test
The quiz gathers information about Australia from ChatGPT, but Katrine has, of course, double-checked the content to ensure it aligns with her teaching materials. The purpose of conducting the quiz is to find out if the students have understood the key topics from the lesson.
In addition to the quiz, Katrine wants to take the opportunity to have a glossary test focusing on Australian animals. This way, she ensures that the children learn about the country’s unique animals and how to spell the related words.
After conducting the two tests, Katrine sees in her PowerBI dashboard that the class, as a whole, has a good understanding of Australia based on the quiz. However, she notices that many students had difficulty spelling the words for the Australian animals. Therefore, she needs to make some adjustments before moving on to the next topic in the curriculum.
Next week, Katrine focuses on improving the class’s spelling skills, and on Friday, she conducts the vocabulary test again. This time, she sees in PowerBI that the results are excellent, and the measures she implemented have had a very positive impact. This means that Katrine can continue teaching with confidence, knowing that Class 2A has a solid understanding of Australia.
Excellent user experience
From the outset, our primary focus was on designing a seamless and exceptional user experience. Our aim was to establish a cohesive visual identity throughout the entire solution, ensuring that users felt immersed in a unified universe.
Given that the overarching storyline across all the games revolves around the badass Princess Peach rescuing Super Mario from certain peril, we decided to make Peach’s signature color, pink, our primary color. However, we also wanted to infuse our own unique twist into the design, moving away from the traditional 2D aesthetic of the older Super Mario games.
To set the tone and serve as a foundation for our visual identity, we began by creating the logo. Additionally, we strived for consistency by employing the same background across all the games, maintaining a cohesive look and feel. This background was meticulously crafted from scratch, utilizing a photograph of a brick wall and incorporating Photoshop effects. Similarly, the buttons and other geometric elements in our apps were also created from scratch using Photoshop.
During our design process, we stumbled upon an incredible image of Princess Peach donning battle gear, perfectly aligning with the vision of our universe, where she portrays a badass version of herself while rescuing Mario.
In addition to our visual considerations, we were committed to ensuring accessibility in our design. To achieve this, we utilized a color contrast checker to ensure compliance with the Web Content Accessibility Guidelines, particularly in terms of color usage.
To deliver a remarkable user experience, we prioritize physical inclusion and social value creation in our game design. Our game is thoughtfully designed to be played both physically and digitally, catering to different preferences and abilities. In the physical version, players engage in outdoor play by moving around a designated area, scanning QR codes to access various mini-games, promoting physical activity and enjoyment of fresh air. For those with mobility challenges, the digital version allows players to control Princess Peach on a game board, unlocking mini-games in different rooms. This ensures inclusion and flexibility, enabling gameplay outside of school hours. By considering physical inclusion and offering a diverse range of play options, we enhance the user experience while also aligning with business value, expanding our market reach and creating an inclusive environment for all players. Additionally, our website is fully responsive, ensuring seamless access to the game on desktop and mobile devices, further promoting inclusivity and convenience for players of all backgrounds and preferences.
Killer AI
Our journey to make a Bowser Quiz mini-game revolves around creating an innovative chatbot browser quiz game using Copilot Studio. We embarked on an exploration of different AI technologies to enhance the functionality of our game.
Initially, we experimented with Generative AI, which proved effective in generating answers. However, we encountered a challenge in verifying the correctness of these answers. To overcome this limitation, we decided to leverage AI Builder in a power automate flow. Unfortunately, we encountered another obstacle as the process required an approval text before further processing.
Undeterred, we continued our pursuit of a robust solution and discovered the new Prompts feature in Copilot Studio. Through multiple iterations and fine-tuning of the prompts, we successfully trained Copilot to accurately determine whether a given answer is correct or incorrect.
Some examples:
It works!
By combining the power of exploring the limitations and uses of Generative AI, AI Builder, and Copilot’s Prompts, we have created a chatbot browser quiz game that not only provides answers but also verifies their accuracy. This innovative approach showcases our ability to harness the limitless possibilities of AI technologies, such as machine learning and neural networks, to craft unique and intelligent solutions.
Through our project, we aim to demonstrate the potential of AI in creating engaging and interactive experiences. The incorporation of various AI techniques and the iterative development process highlight our commitment to pushing the boundaries of AI innovation.
We are excited to present our Bowser Quiz mini-game, showcasing how we have harnessed the power of AI to create a cutting-edge chatbot browser quiz game that not only entertains but also ensures the accuracy of answers.
Pandoras Box
Out of the Box Fun is in many ways both the core of the product we deliver and the reason why we participate in the competition. The product, or more precisely, the game, is crafted based on pure joy with the primary goal of contributing to learning in a fun and engaging way for students. Inspired by the nostalgia of Super Mario, the opportunity to put our own spin on things (yes, made Super Mario into a pink paradise), and the ability to create whatever we wanted, planted a seed in all of us to develop something that genuinely stems from joy and fun.
In addition to the fact that what we have created obviously has the primary purpose of spreading joy, our participation is also based on the same. Our team comprises superstars in low code as well as those who never felt at home in the coding world but wanted to give it another chance and created their first canvas app this weekend (and now definitely want to do more of it).
The opportunity to create exactly what we want has given us the chance to explore our most creative ideas in an environment with the industry’s most skilled individuals. This unique environment has opened up opportunities for learning and mutual support in a way that surpasses other available options.
Peaches Mini Games
In the description of Peach Mini Games, we will first showcase the game as a whole and then delve deeper into each of the different parts of the solution.
Welcome to Mario Brothers Plumbing Field Service for all customers
First we will show how the customers can order and pay for the service
Here is the backend function for the mighty Donkey Kong to have full control of all orders and the whereabouts of the plumbers at all times. Documents sent out to customers are stored in SharePoint
The plumbers are using a Canvas app to perform their work. The gamification aspect involves receiving a random question from Azure AI through a custom connector that is connected to an Azure function.
By using Teams and Power BI, we can allow our office workers to handle new orders quickly, and easily. They will receive alerts through an channel of new orders, and to make sure they are handled quickly, a user will be tagged if not handled within 1 hour by using Power Automate
