Tag Archives: Killer AI

Final Delivery

Posted on by

The Final Solution: KoopaKonstruct Manager

The BPMN diagram below is a simple representation of our KoopaKonstruct Manager.

In summary we are using Hololenses to inspect a chosen area where we want to e.g. hang up a coat rack, build a table, and similar. In order to make the Hololenses smart, we have integrated OpenAI. We are using Function calling to provide instructions about the requested project, information about necessary materials and quantity.This is where we are making our KoopaKonstruct really smart.

As real #Crawlers we use OpenAI’s Function calling to dynamically create the search criterias based on natural language. Google Speach to text is used to capture the natural language query. We are really integrating into everything that flips bits #Embedding numbnuts! With help of the search criterias, we are able to provide critical information further into the supply chain, meaning all the way down to the FinOps where we are improving critical business processes (this will be explained later in this blog post).

Below is a picture from the Hololenses where we use a button to speak with AI:

GPTVision helps us interpret work drawings and breaks it down into the steps needed, so that we can get a clear instruction of what materials we need, how many and how to build the desired object. Using Power Automate, we are able to share and send the item details and necessary quantity into FinOps.

As an addition to the OpenAI magic, we have also created a canvas app that is integrated in the Hololense #PlugN’Play. From this app you can perform business processes, such as triggering sales orders, check inventory status, and 4 different Power BI reports to monitor sales orders and follow up late deliveries #Dash it out.

And here is where we really improve business processes; when the information is sent to FinOps we use X++ code to check inventory status. If materials are in stock, a sales order is created and sales order confirmation is sent. If there are no (or not enough) materials in stock, we also create a purchase order in addition to the sales order. A link between the purchase order and sales order is created, enabling the ability to understand where the demand is coming from. Additionally, to make the KoopaKonstruct Manager adaptable to e.g. construction companies, we have created the possibility to link the purchase and sales orders with projects. This provides a lot of possibilities for detailed project management for the finance geeks.

Below is our argumentation to why we believe we should score high on all 4 categories!

Most Extreme Business Value

Our team embarked on a quest to redefine the meaning of business value, and we present to you KoopaKonstruct Manager – a solution that not only orders products through Hololenses but catapults business efficiency into a realm beyond imagination.

Automating the Complete Supply Chain with Hololenses

We harnessed the power of Hololenses to revolutionize the way products are ordered. One user, equipped with the mighty Hololens, registers the necessary quantity with a mere wave of the hand, triggering a Power Automate flow like a seasoned Mario collecting power-ups.

The adventure doesn’t stop there! Our Power Automate flow seamlessly transmits the order information to FinOps using the Execute action. The magic unfolds as FinOps automatically generates a sales order and a purchase order based on inventory stock. But here’s where the plot thickens – these orders are not solitary entities; they are linked together, creating a dynamic duo that unravels the mystery behind each purchase. There is no need to spend as much as a second wondering how or why the orders were created; the link indicate that there is a demand behind each purchase order.

See yourself sitting in an ordering office at a company where the customers are able to generate sales orders by only entering a demand. And, in addition to the automatic creation of sales order, imagine that you did not have to study the master plan to generate the purchase order as it is automatically created! And as a side salsa, you did not even have to trigger the sales order confirmation as it is sent automatically. So, while you are sitting there wondering about what to do with your life (and how long it takes before the CEO finds out that you are useless as the power of Power Automate and X++ took your job), you can relax and focus on other more important things in life, such as playing a Super Mario game.

Power Stars: Automated Project Linkage

But wait, there’s more! We also increased the business value for construction and engineering enterprises. With the ability to automatically link both the purchase and sales orders to projects, we’ve bestowed upon industries that thrive on projects a golden opportunity to enhance their efficiency and project management. It’s not just about ordering; it’s about constructing a bridge to a new era of project-linked prosperity.

The Warp Whistle to Most Extreme Business Value

We make a bold claim for the “Most Extreme Business Value” category in this year’s ACDC Hackathon. Here’s why our adventure deserves the highest score:

  1. Efficiency: Our solution isn’t just about ordering; it’s about efficiency power-ups that automate the entire supply chain process, from order initiation to linkage in FinOps.
  2. Dynamic and Time-saving: The automatic creation of linked sales and purchase orders provides unparalleled visibility into demand and supply, laying the foundation for strategic business decisions.
  3. Project Linkage: For construction and engineering businesses, our automated project linkage is a treasure trove of golden coins, offering enhanced project management capabilities and business value beyond the ordinary.
  4. Adaptable: Our solution is not only limited to the B2B-market, but can also be used for the B2C-market. Making the app available to customers, they can create orders automatically and receive high quality service as the complete supply chain has become even more efficient.

Excellent User Experience

We have created a Super Mario inspired canvas app that is adapted into the Hololenses. In other words, our app transforms ordinary into extraordinary!

Features:

Killer AI

Whether you’re a seasoned AI veteran or just dipping your toes into the mushroom-filled waters of innovation, our solution is a testament to the power that AI holds in shaping the future.

KoopaKonstruct Manager is not just a game-changer; it’s a game-transformer. Through the mastery of machine learning, we’ve empowered our solution to evolve, adapt, and learn from the challenges it encounters. From predicting order quantities to optimizing supply chain processes in the real world (and in FinOps), our AI-driven approach is a power-up for efficiency and foresight.

In the quest for the Killer AI “crown”, KoopaKonstruct offers more than just automated processes. It also includes magic in form of predictive insights, providing a glimpse into the future of demand, supply, and project landscapes. Strategic decision-making becomes second nature as our AI-driven system transforms data into actionable intelligence.

A mind of its own

In the pursuit of the existential risk badge, our AI solution goes beyond mere execution—it thinks, learns, and adapts with a mind of its own. Through autonomous decision-making capabilities, it navigates the complexities of supply chain processes and provides responses not even a 20 year old is able to find without searching the web.

KoopaKonstruct isn’t just smarter than a 5th grader; it engages in intelligent conversations that transcend the limitations of a classroom. It doesn’t just provide answers; it grapples with FinOps and supply chain complexities, understands nuances, and offers insights that reflect a level of intelligence resembling a dynamic dialogue.

Why KoopaKonstruct Manager deserves the Killer AI “crown”

  1. Innovation Beyond the Blocks: KoopaKonstruct isn’t confined to the traditional boundaries. It breaks through the blocks of conventional solutions, paving the way for a new era of AI-driven innovation.
  2. Adaptability in Every Pixel: Our solution dynamically adapts to the ever-changing business environment, ensuring resilience and adaptability in every pixel of our solution.
  3. Mind Mastery: Our AI isn’t just a tool; it’s a mastery that elevates KoopaKonstruct into a symphony of efficiency, intelligence, and strategic foresight.

Pandoras Box

Equipping a Hololens with AI that can answer questions, order materials, and assist in selecting the right materials and tools for any project based on online instructions transforms DIY into an accessible experience for the less handy. This technology takes the guesswork out of building, offering tailored advice on what to build, the best materials and tools for the job, and even suggesting projects that match your interests and available space. It’s like having a personal tutor and assistant rolled into one, guiding you through the entire process from conception to completion. This seamless integration of technology with hands-on work not only makes crafting projects more approachable for beginners but also enriches the experience with educational value, ensuring that anyone can undertake and succeed in their DIY endeavors with confidence.

Super Crayon Bros – Soria Moria Nightmare – Final Delivery

Posted on by

Video with a full playthrough of the entire experience above.

We have created a game framework AND a game using the framework. During ACDC 2024 in 3 days! We used Power Platform and the products within like, Power Apps, Power Automate, Copilot Studio and Dataverse. We also used Azure DevOps for ALM and making the solution portable to other tenants and environments.

Of course it is responsive! and looks beatiful!

Gamification framework

We have created a framework for a gamified way to learn. This framework can be reused to create new games with all kinds of thinkable subjects. 

The framework has predefined content like

  • Game progress
    • Start and Story
    • Quests and Tasks
    • Finale
  • points
  • layouts
  • dialog boxes
  • inputs
  • outputs

Exceptional looks!

Images for backgrounds and characters can be customized to create a unique look and a complete new looking game and story. Look at this blogpost for screens: Great user experience and beautiful screens!

Quest and tasks

The Quests in the game can be created by adding new entries to the Quest and task tables.  The tasks can be of any kind, just limited by the creators imagination.

In this solution we have tasks like:

  • Point and click
  • Puzzle
  • Send in an external email to unlock a task

This methology and design makes it easy to adjust and add content, making it reusable for all kinds of training or fun (or both some will say….)!

Of course we have AI!

A large amount of the actual content is generated by AI. Images and stories are created by custom GPTs within OpenAI.

Intelligent NPCs!

A NPC follows the user in the game and will guide the player. This makes the game a lot more fun and personal. The character has a personality and will answer question about the environment the player currently is in. The player ask in natural language and the NPC answers by using generativ AI. This is implemented as a custom prompt in Copilot Studio. 

The information to the NPC is feed from the game database. This means that new quests and tasks will automatically be fed to the NPC. 
 
Look at this blogpost for details. Using AI to create a game

The game progress framework as a picture

Final delivery Peaches Mini Games

Posted on by

Step into the world of Peaches Mini Games, where education meets innovation and business value takes center stage. Join us on a journey through an English classroom case study, user-centric design principles, and the integration of killer AI in crafting an engaging quiz game. Uncover the core philosophy behind Out of the Box Fun and understand why our participation in this competition is driven by a passion for spreading joy and fostering inclusivity. This post will guide you through the various components of Peaches Mini Games, providing insights into its educational impact, user-centric design, and groundbreaking use of AI technologies.

Most Extreme Business Value

The business value of Peach Mini Games is linked to education. The game is designed to make learning motivating for children while providing valuable insights for teachers. By analyzing the results from the game, teachers can tailor their instruction, optimize time usage, and address each student’s specific competency level.

Let’s go through the business value with a case study.

English teacher Katrine is going to teach class 2A about Australia. She wants to focus on where the country is located and what makes it special. She plans to use traditional chalkboard teaching methods, but to ensure that the students have truly grasped the information, she needs to assess them. She will do this in two ways:

  • Quiz
  • Glossary test

The quiz gathers information about Australia from ChatGPT, but Katrine has, of course, double-checked the content to ensure it aligns with her teaching materials. The purpose of conducting the quiz is to find out if the students have understood the key topics from the lesson.

In addition to the quiz, Katrine wants to take the opportunity to have a glossary test focusing on Australian animals. This way, she ensures that the children learn about the country’s unique animals and how to spell the related words.

After conducting the two tests, Katrine sees in her PowerBI dashboard that the class, as a whole, has a good understanding of Australia based on the quiz. However, she notices that many students had difficulty spelling the words for the Australian animals. Therefore, she needs to make some adjustments before moving on to the next topic in the curriculum.

Next week, Katrine focuses on improving the class’s spelling skills, and on Friday, she conducts the vocabulary test again. This time, she sees in PowerBI that the results are excellent, and the measures she implemented have had a very positive impact. This means that Katrine can continue teaching with confidence, knowing that Class 2A has a solid understanding of Australia.

Excellent user experience

From the outset, our primary focus was on designing a seamless and exceptional user experience. Our aim was to establish a cohesive visual identity throughout the entire solution, ensuring that users felt immersed in a unified universe.

Given that the overarching storyline across all the games revolves around the badass Princess Peach rescuing Super Mario from certain peril, we decided to make Peach’s signature color, pink, our primary color. However, we also wanted to infuse our own unique twist into the design, moving away from the traditional 2D aesthetic of the older Super Mario games.

To set the tone and serve as a foundation for our visual identity, we began by creating the logo. Additionally, we strived for consistency by employing the same background across all the games, maintaining a cohesive look and feel. This background was meticulously crafted from scratch, utilizing a photograph of a brick wall and incorporating Photoshop effects. Similarly, the buttons and other geometric elements in our apps were also created from scratch using Photoshop.

During our design process, we stumbled upon an incredible image of Princess Peach donning battle gear, perfectly aligning with the vision of our universe, where she portrays a badass version of herself while rescuing Mario.

In addition to our visual considerations, we were committed to ensuring accessibility in our design. To achieve this, we utilized a color contrast checker to ensure compliance with the Web Content Accessibility Guidelines, particularly in terms of color usage.

To deliver a remarkable user experience, we prioritize physical inclusion and social value creation in our game design. Our game is thoughtfully designed to be played both physically and digitally, catering to different preferences and abilities. In the physical version, players engage in outdoor play by moving around a designated area, scanning QR codes to access various mini-games, promoting physical activity and enjoyment of fresh air. For those with mobility challenges, the digital version allows players to control Princess Peach on a game board, unlocking mini-games in different rooms. This ensures inclusion and flexibility, enabling gameplay outside of school hours. By considering physical inclusion and offering a diverse range of play options, we enhance the user experience while also aligning with business value, expanding our market reach and creating an inclusive environment for all players. Additionally, our website is fully responsive, ensuring seamless access to the game on desktop and mobile devices, further promoting inclusivity and convenience for players of all backgrounds and preferences.

Killer AI

Our journey to make a Bowser Quiz mini-game revolves around creating an innovative chatbot browser quiz game using Copilot Studio. We embarked on an exploration of different AI technologies to enhance the functionality of our game.

Initially, we experimented with Generative AI, which proved effective in generating answers. However, we encountered a challenge in verifying the correctness of these answers. To overcome this limitation, we decided to leverage AI Builder in a power automate flow. Unfortunately, we encountered another obstacle as the process required an approval text before further processing.

Undeterred, we continued our pursuit of a robust solution and discovered the new Prompts feature in Copilot Studio. Through multiple iterations and fine-tuning of the prompts, we successfully trained Copilot to accurately determine whether a given answer is correct or incorrect.

Some examples:

It works!

By combining the power of exploring the limitations and uses of Generative AI, AI Builder, and Copilot’s Prompts, we have created a chatbot browser quiz game that not only provides answers but also verifies their accuracy. This innovative approach showcases our ability to harness the limitless possibilities of AI technologies, such as machine learning and neural networks, to craft unique and intelligent solutions.

Through our project, we aim to demonstrate the potential of AI in creating engaging and interactive experiences. The incorporation of various AI techniques and the iterative development process highlight our commitment to pushing the boundaries of AI innovation.

We are excited to present our Bowser Quiz mini-game, showcasing how we have harnessed the power of AI to create a cutting-edge chatbot browser quiz game that not only entertains but also ensures the accuracy of answers.

Pandoras Box

Out of the Box Fun is in many ways both the core of the product we deliver and the reason why we participate in the competition. The product, or more precisely, the game, is crafted based on pure joy with the primary goal of contributing to learning in a fun and engaging way for students. Inspired by the nostalgia of Super Mario, the opportunity to put our own spin on things (yes, made Super Mario into a pink paradise), and the ability to create whatever we wanted, planted a seed in all of us to develop something that genuinely stems from joy and fun.

In addition to the fact that what we have created obviously has the primary purpose of spreading joy, our participation is also based on the same. Our team comprises superstars in low code as well as those who never felt at home in the coding world but wanted to give it another chance and created their first canvas app this weekend (and now definitely want to do more of it).

The opportunity to create exactly what we want has given us the chance to explore our most creative ideas in an environment with the industry’s most skilled individuals. This unique environment has opened up opportunities for learning and mutual support in a way that surpasses other available options.

Peaches Mini Games

In the description of Peach Mini Games, we will first showcase the game as a whole and then delve deeper into each of the different parts of the solution.

Brettet

Mini game 1: Hangman

This is a Canvas App built only using the out of the box components and Fx logic.
Here is a step by step guide to how to build the Hangman game.

Mini game 2: Bowser Kill Quiz

Here is a step by step description of how the quiz is built

Mini game 3: Glossary test

Mini game 4: Head 2 Head

Mini game 5: Peaches flight

Score board

Here is a description of how we integrated it into Teams.

Using AI to create a game

Posted on by

AI has been core to the development of our game in several ways. Almost all graphics has been generated by an AI, the story has largely been influenced by an AI and, an AI is a key component that you can talk to within the game itself!

Story and media

Both the story and media assets within the game has been created using custom GPTs from OpenAI. https://chat.openai.com/g/g-rjjz1GE5I-pixel-art has proven itself to be able to create imagery with a remarkable consistent look and feel based on our prompts, and https://chat.openai.com/g/g-dmgFloZ5w-storyteller has been a great sparring partner in the development of the story

The village butler

Meet the village butler, a core character in our game. He is omnipresent on your adventure and is always ready to answer any questions our adventurers may have.

The butler lives as a custom prompt in Copilot studio, and gets his personality there. In addition we feed him with context aware information based on where the adventurer is in the game together with every prompt he is sent, in this way adventurers can probe him for possible game clues or sometimes straight up answers to the clues.

Also, our guy knows who Botten Anna is, if that isn’t existential risk, we don’t know what is!

Get a Personal plumber, all fully automated with AI

Posted on by

How do we give you the help you need in such speed, you may ask!
It’s because we leverage the AI Builder to assign you a plumber based on your incident description.
It will automaticly do sentiment analysis on your topic to give you the right guy/gal, as well as translating the description to Italian, to make life easier for our plumbing friends!

How does it work?

First you create a incident through our PlumbQuest website

This will create a case that runs through a Power Automate flow to set all described above.

First we check if a new case is created and then we run 2 AI Builder jobs, Translate language and Sentiment analysis.

Then we split then we assign you a plumber based on the severity of the situation!
WIth a properly certified plumber!


As you can see the case is updated with the information directly, and showing the assigned plumbers info and certifications.

Welcome to SMBPLUMBING

Posted on by

Brand logo for Super Mario Bros. Plumbing

Brand colors to achieve a cohesive look

Power Pages with a Punch!

We have developed a portal that offers a seamless, user-friendly experience, complete with an aesthetically pleasing interface.

Pay attention to the brand colors, logo, and AI-generated images tailored specifically to match the context of the page.

PlumbAdmin Unplugged: Where Pipes Meet Punchlines!

The design of the internal UI is as vital as a perfect tomato sauce – it boosts the user experience, makes work efficient like a well-oiled machine, and cuts down the learning curve, making everything as smooth as a gondola ride! Capisce?

Super Mario

The theme in the model driven app “PlumbAdmin” is set to our brand colors and our logo is added to the header.

The menu items are named with brand lingo and engaging emojis.

The Dashboard “Coin Generator” gives Mario and Luigi the best overlook of key business data
The Contact form gives a good overview of contact information, achieved certifications and the contact’s assets
PlumbQuests forms has a custom business process flow and Quick View Form showing the assigned plumber’s contact information and certifications.

The Devil is in the Details

Custom favicon

Luigi’s profile picture in PlumBot and his italian sassy accent gives an extra touch

You can open your personalized diploma in wide screen:

We claim the badge Glossy Pixels because our designs not only shine with clarity and vibrancy, but also bring every pixel to life with a touch of sophistication and engaging visuals.

We strive to achieve high scores in the excellent user experience category because our platform is meticulously crafted to be intuitive, responsive, and tailored to meet internal AND external user needs, ensuring a seamless and satisfying interaction at every touchpoint.

We aim to showcase our skill in the Killer AI category, highlighting our use of customized AI-generated images tailored specifically for the websites page’s context.

Moreover, our approach goes beyond just having a chatbot. We’ve intricately designed it to embody the spirited personality of Luigi, complete with charming Italian sass. Offering users a dynamic and personalized interaction experience

How to see without eyes?

Posted on by

Azure Custom Vision!

We had a problem. A huge problem. We needed to know where in our floor plan the different components are placed.

By training our own custom vision model based on training data of bathroom floor plans, we managed to obtain an AI model able to detect components such as:

  • Toilet
  • Shower
  • Bath tub
  • Sink
  • Main pipes
Bathroom components detection with our custom vision model
Model scores on the training data

The model was published and the API made available for our backend application in C# to consume.

Super easy!

Copilot. The Rise of Machines

Posted on by

We claim badges:

  • Existential risk – for risk of existence of software developers

App should collect, list, track or managed the incidents that was assigned to engineers. The table must contains technical info for resolving the incident. Also the app should include the chart with summary of incident statuses. 

Specify prompt for app generation and submit:

Wait until the entities are created

Adjust if needed and proceed with app creation:

Just 10 seconds and you have an app that you are not ashamed to show on a demo to a client or to prove to a manager that you have been actively working and here are the results of your work. Isn’t it?

Mixed reality – out of the box solution

Posted on by

We have incorporated a mixed reality component into the app to help Peach improve her jumping skills. This feature allows her to measure the distance between two objects within the app.

The idea is that Peach should be able to point and measure the distance between two objects she can jump. If the measured distance is shorter than a predetermined threshold, she receives positive feedback generated by AI, along with points that are stored in Dataverse.

To complete the module, Peach needs to successfully perform 10 jump exercises. Her current score or progress is displayed in the top left corner of the screen.

If Peach measures a distance that exceeds her jumping abilities, she will receive feedback from the AI and no points will be awarded.

Example of an Overly Optimistic Measurement:

One could argue that the ability to take a 3D model and view it in a real-life environment to get a sense of its size compared to real-life objects can be beneficial when dealing with unfamiliar objects or sizes. This is particularly useful for objects measured in inches for anyone not from the US.