Greetings, fellow wizards of innovation and technology! 🧙♂️✨ Today, we’re excited to unveil the mystical workings of our project, aptly named the “Potion Production Platform.” It’s a spellbinding fusion of IoT, Microsoft Power Platform, and Dynamics 365 Finance and Operations (D365FO) that brings real-world potion brewing into the digital realm.
With the Early Delivery Badge deadline looming over us like a Dementor, we’ve worked our wands (and keyboards) tirelessly to conjure an end-to-end solution. Grab your butterbeer and prepare to be enchanted!
🧪 The Magic Behind the Brew
Our solution centers on a Raspberry Pi-powered IoT setup that combines sensors, Python code, and cloud-based automation to brew potions (or, in the Muggle world, trigger production processes). Here’s how the magic unfolds:
Ingredients Added to the Cauldron We use a liquid-level sensor attached to a Raspberry Pi to measure ingredient levels as they are poured into the cauldron. Data flows seamlessly via a REST POST to a custom SensorDataTable in D365FO.
Voice Commands to Cast Spells A microphone captures spell-like commands (e.g., “Start production!”). These are processed through Azure Speech Services, triggering specific workflows in Power Automate. Want to brew a Pepperup Potion? Just say it!
Potion Brewing Status and Progress The elixir’s brewing progress is visualized using Power BI dashboards, displaying real-time updates like ingredient levels, potion type, and time to completion. For those who prefer a hands-on approach, Power Apps provides a UI for manual overrides.
Workflows & Notifications Our Power Automate workflows orchestrate the magical flow, linking sensor data and voice commands to create production orders, log material consumption, and notify wizards (and Muggle stakeholders) via email or Teams.
🖼️ Architecture Overview
The following diagram illustrates our architecture (#ShowAndTell)
Raspberry Pi + Python Script: Reads sensor data and sends REST POST requests.
D365FO + OData Service: Receives data, updates the SensorDataTable, and triggers production orders.
Power Platform Tools:
Power Automate triggers workflows.
Power BI visualizes data.
Power Apps provides manual interaction points.
🎩 Why This Deserves the Early Delivery Badge
We’ve delivered a working prototype that spans the entire solution lifecycle: from sensor to cloud to user interface. Here’s why it qualifies:
End-to-End Functionality The system captures real-time sensor data, processes it, and triggers automated workflows in D365FO.
Detailed Solution Architecture We’ve mapped out every connection, from IoT sensors to Power BI dashboards, ensuring clarity for future iterations.
Practical Magic While whimsical in theme, this solution has real-world applications in inventory management, production automation, and business intelligence.
🧙♀️ What’s Next on Our Quest?
We’re not resting on our laurels (or broomsticks). Here’s what lies ahead:
Enhanced Voice Commands: Adding more spell-like triggers for potion types and batch sizes.
Advanced Visualizations: Building immersive dashboards in Power BI with magical themes.
AI Integration: Incorporating predictive insights for potion demand and ingredient forecasting.
With our potion brewing well underway, we hope to not only claim the Early Delivery Badge but also inspire our fellow wizards to explore the possibilities of combining IoT, automation, and the Microsoft ecosystem.
Until next time, may your solutions be as magical as your imaginations! ✨⚡
The BPMN diagram below is a simple representation of our KoopaKonstruct Manager.
In summary we are using Hololenses to inspect a chosen area where we want to e.g. hang up a coat rack, build a table, and similar. In order to make the Hololenses smart, we have integrated OpenAI. We are using Function calling to provide instructions about the requested project, information about necessary materials and quantity.This is where we are making our KoopaKonstruct really smart.
As real #Crawlers we use OpenAI’s Function calling to dynamically create the search criterias based on natural language. Google Speach to text is used to capture the natural language query. We are really integrating into everything that flips bits #Embedding numbnuts! With help of the search criterias, we are able to provide critical information further into the supply chain, meaning all the way down to the FinOps where we are improving critical business processes (this will be explained later in this blog post).
Below is a picture from the Hololenses where we use a button to speak with AI:
GPTVision helps us interpret work drawings and breaks it down into the steps needed, so that we can get a clear instruction of what materials we need, how many and how to build the desired object. Using Power Automate, we are able to share and send the item details and necessary quantity into FinOps.
As an addition to the OpenAI magic, we have also created a canvas app that is integrated in the Hololense #PlugN’Play. From this app you can perform business processes, such as triggering sales orders, check inventory status, and 4 different Power BI reports to monitor sales orders and follow up late deliveries #Dash it out.
And here is where we really improve business processes; when the information is sent to FinOps we use X++ code to check inventory status. If materials are in stock, a sales order is created and sales order confirmation is sent. If there are no (or not enough) materials in stock, we also create a purchase order in addition to the sales order. A link between the purchase order and sales order is created, enabling the ability to understand where the demand is coming from. Additionally, to make the KoopaKonstruct Manager adaptable to e.g. construction companies, we have created the possibility to link the purchase and sales orders with projects. This provides a lot of possibilities for detailed project management for the finance geeks.
Below is our argumentation to why we believe we should score high on all 4 categories!
Most Extreme Business Value
Our team embarked on a quest to redefine the meaning of business value, and we present to you KoopaKonstruct Manager – a solution that not only orders products through Hololenses but catapults business efficiency into a realm beyond imagination.
Automating the Complete Supply Chain with Hololenses
We harnessed the power of Hololenses to revolutionize the way products are ordered. One user, equipped with the mighty Hololens, registers the necessary quantity with a mere wave of the hand, triggering a Power Automate flow like a seasoned Mario collecting power-ups.
The adventure doesn’t stop there! Our Power Automate flow seamlessly transmits the order information to FinOps using the Execute action. The magic unfolds as FinOps automatically generates a sales order and a purchase order based on inventory stock. But here’s where the plot thickens – these orders are not solitary entities; they are linked together, creating a dynamic duo that unravels the mystery behind each purchase. There is no need to spend as much as a second wondering how or why the orders were created; the link indicate that there is a demand behind each purchase order.
See yourself sitting in an ordering office at a company where the customers are able to generate sales orders by only entering a demand. And, in addition to the automatic creation of sales order, imagine that you did not have to study the master plan to generate the purchase order as it is automatically created! And as a side salsa, you did not even have to trigger the sales order confirmation as it is sent automatically. So, while you are sitting there wondering about what to do with your life (and how long it takes before the CEO finds out that you are useless as the power of Power Automate and X++ took your job), you can relax and focus on other more important things in life, such as playing a Super Mario game.
Power Stars: Automated Project Linkage
But wait, there’s more! We also increased the business value for construction and engineering enterprises. With the ability to automatically link both the purchase and sales orders to projects, we’ve bestowed upon industries that thrive on projects a golden opportunity to enhance their efficiency and project management. It’s not just about ordering; it’s about constructing a bridge to a new era of project-linked prosperity.
The Warp Whistle to Most Extreme Business Value
We make a bold claim for the “Most Extreme Business Value” category in this year’s ACDC Hackathon. Here’s why our adventure deserves the highest score:
Efficiency: Our solution isn’t just about ordering; it’s about efficiency power-ups that automate the entire supply chain process, from order initiation to linkage in FinOps.
Dynamic and Time-saving: The automatic creation of linked sales and purchase orders provides unparalleled visibility into demand and supply, laying the foundation for strategic business decisions.
Project Linkage: For construction and engineering businesses, our automated project linkage is a treasure trove of golden coins, offering enhanced project management capabilities and business value beyond the ordinary.
Adaptable: Our solution is not only limited to the B2B-market, but can also be used for the B2C-market. Making the app available to customers, they can create orders automatically and receive high quality service as the complete supply chain has become even more efficient.
Excellent User Experience
We have created a Super Mario inspired canvas app that is adapted into the Hololenses. In other words, our app transforms ordinary into extraordinary!
Features:
Killer AI
Whether you’re a seasoned AI veteran or just dipping your toes into the mushroom-filled waters of innovation, our solution is a testament to the power that AI holds in shaping the future.
KoopaKonstruct Manager is not just a game-changer; it’s a game-transformer. Through the mastery of machine learning, we’ve empowered our solution to evolve, adapt, and learn from the challenges it encounters. From predicting order quantities to optimizing supply chain processes in the real world (and in FinOps), our AI-driven approach is a power-up for efficiency and foresight.
In the quest for the Killer AI “crown”, KoopaKonstruct offers more than just automated processes. It also includes magic in form of predictive insights, providing a glimpse into the future of demand, supply, and project landscapes. Strategic decision-making becomes second nature as our AI-driven system transforms data into actionable intelligence.
A mind of its own
In the pursuit of the existential risk badge, our AI solution goes beyond mere execution—it thinks, learns, and adapts with a mind of its own. Through autonomous decision-making capabilities, it navigates the complexities of supply chain processes and provides responses not even a 20 year old is able to find without searching the web.
KoopaKonstruct isn’t just smarter than a 5th grader; it engages in intelligent conversations that transcend the limitations of a classroom. It doesn’t just provide answers; it grapples with FinOps and supply chain complexities, understands nuances, and offers insights that reflect a level of intelligence resembling a dynamic dialogue.
Why KoopaKonstruct Manager deserves the Killer AI “crown”
Innovation Beyond the Blocks: KoopaKonstruct isn’t confined to the traditional boundaries. It breaks through the blocks of conventional solutions, paving the way for a new era of AI-driven innovation.
Adaptability in Every Pixel: Our solution dynamically adapts to the ever-changing business environment, ensuring resilience and adaptability in every pixel of our solution.
Mind Mastery: Our AI isn’t just a tool; it’s a mastery that elevates KoopaKonstruct into a symphony of efficiency, intelligence, and strategic foresight.
Pandoras Box
Equipping a Hololens with AI that can answer questions, order materials, and assist in selecting the right materials and tools for any project based on online instructions transforms DIY into an accessible experience for the less handy. This technology takes the guesswork out of building, offering tailored advice on what to build, the best materials and tools for the job, and even suggesting projects that match your interests and available space. It’s like having a personal tutor and assistant rolled into one, guiding you through the entire process from conception to completion. This seamless integration of technology with hands-on work not only makes crafting projects more approachable for beginners but also enriches the experience with educational value, ensuring that anyone can undertake and succeed in their DIY endeavors with confidence.
The Hololense device is not just a headset; it’s a portal to a world where the boundaries between the virtual and the real blur. To achieve this seamless integration, we leverage the prowess of four distinct Microsoft Cloud APIs, each playing a crucial role in orchestrating our KoopaKonstruct Manager adventure.
Power Automate: Automating the Journey
Power Automate acts as the orchestrator of our adventure, seamlessly connecting the various components of our solution. With Power Automate, we automate workflows that trigger updates in FinOps, generate purchase and sales orders, and send confirmation emails. Additionally, the flow sends inventory status back to the Hololenses for the user to be updated on inventory quantity on sight. This cloud-based automation engine ensures that our journey unfolds with precision and efficiency, leaving no room for manual intervention.
FinOps: Navigating the Financial Landscape
FinOps, a cloud financial management framework, guides us through the financial landscape of our project. By integrating FinOps, we ensure that the procurement of materials aligns with budgetary constraints. The cloud-based financial intelligence provided by FinOps becomes the compass that guides our decisions, ensuring a smooth journey through the financial complexities of our adventure.
Unity: Crafting the Virtual Reality
Unity, a powerful cross-platform game engine, becomes the canvas for our Hololens-powered adventure. Through Unity, we bring the Super Mario-themed world to life, creating a virtual playground where users can interact with their surroundings. Unity’s versatility allows us to seamlessly integrate Hololens functionalities, providing an immersive and interactive experience that blurs the lines between the physical and digital realms.
Uniting the Microsoft Cloud APIs
The integration of Power Automate, Unity, and FinOps with Hololens exemplifies the synergy achieved by uniting Microsoft Cloud APIs. Together, they form a cohesive ecosystem where data seamlessly flows, processes are automated, and a Super Mario-themed world comes to life before our eyes.
This integration is not just about earning a badge; it’s about unlocking the potential of cloud technologies to create experiences that transcend the ordinary. Our journey is a testament to the endless possibilities that unfold when diverse Microsoft Cloud APIs unite in a symphony of innovation!
Based on the following article: https://synoptek.com/insights/it-blogs/evolution-of-microsoft-dynamics-ax/ X++ can be dated all the way back to 1998 (and maybe even earlier)!
With help from our own wise wizard – AKA Grandfather/Frank – we have been able to create our own magic in FinOps. The screenshot below shows a customized screen of item number and item related information, in addition to purchase and sales order and project links:
With the help from X++ and Power Automate we are able to send order quantity to FinOps which automatically creates a purchase and sales order. And it does not stop here – it also creates a link between the purchase and sales orders, which is critical to understand what actually triggered the purchase order in the first place. Additionally, we link the orders to project as that would gain a lot of business value for industries such as the construction business. The code below ends with returning the quantity that is going through the order process, which triggers email to the Hololens-user with an order confirmation.
Attending the ACDC Hackathon is not just about swearing and sweating – it is also an opportunity to eat some snacks and have fun. You are currently witnessing new and older Cepheo employees getting along playing RC car (Super Mario edition of course) and making big jumps!
The boys look more beautiful than ever with their Princess Peach-inspired tiaras and cute smiles! And even better; our Super Mario below brought beer and other delicious beverages in his portable cooler.
In the spirit of collaboration and efficiency, our project seamlessly integrates several third-party solutions to enhance its capabilities. At the forefront, we employ Hololenses, a #hip and mixed reality device that brings magic into our everyday lives.
#Thieving the great knowledge of OpenAI plays a vital role in our project, helping us define the materials needed to construct a table – and potentially bigger projects in the future. By tapping into OpenAI’s advanced AI capabilities, we empower our users to receive real-time insights and instructions, making the crafting process both intuitive and engaging.
Power Automate serves as the orchestrator behind the scenes, effortlessly connecting different components of our solution. From updating FinOps with material quantities to generating purchase orders and sales orders, Power Automate ensures a seamless flow of information.
As soon as the Hololens have detected the necessary materials and quantity, it triggers a flow in Power Automate:
The flow ships the information into FinOps to automatically generate purchase and sales orders to improve efficiency and to automate critical business processes. Further on, the sales order information travels back to the Power Automate and sends a response to OpenAI:
Using Function calling to OpenAI in combination with Power Automate we intend to claim the #Power User Love badge along with #Hipster for extensial use of hip technology and #Thieving Bastards for stealing the awesomeness of OpenAI!
In the vast landscape of the ACDC Hackathon event, there exists a lone adventurer, navigating the intricate realms of technology with only a keyboard and a dream. Meet David, a one-person team determined to conquer the challenges of solo development!
As fate would have it, our paths crossed, and we saw the spark of brilliance in David’s endeavors. Recognizing the potential for growth and innovation, we decided to extend a helping hand to our solo coder friend and include him in our team! Remarkable team spirit, don’t you think?
In the spirit of KoopaKonstruct, we leveraged Power Automate to streamline the order request process. When an order request is sent into FinOps, our Power Automate workflow springs into action, automatically triggering creation of both sales and purchase orders and linking to project. What makes this journey truly exciting is the dynamic linking of these orders based on material availability.
Using Execute action we send and retrieve critical information about items and order quantity with FinOps:
Konstructing the Perfect Order
Here’s how it works: If materials are not available, a sales order is crafted alongside a corresponding purchase order. The two are linked together, creating a seamless flow that ensures efficiency and accuracy.
The Power of Projects
But that’s not all! In the Mushroom Kingdom of business productivity, projects play a crucial role. Our solution goes beyond order creation – both sales and purchase orders are intelligently linked to projects. This feature provides enhanced visibility and control over every aspect of the workflow, ensuring that each adventure contributes to the success of the larger project quest.
Behind Her Majesty, the FinOps itself, we can find all the Koopa-magic (read: pro code customization):
Power-up Delivery!
As soon as your orders emerged victorious from the crafting chamber – or FinOps if you may – Our speedy Toad couriers, equipped with red hats and jumping prowess, are on a mission to deliver your Order Confirmation straight to your inbox! They dodge Goombas, leap over pipes, and ensure your confirmation reaches you in warp speed!
Conclusion: Leveling up with Power Automate!
In the world of business operations, automating workflows is like discovering a hidden 1-Up mushroom. With KoopaKonstruct Manager, our team has not only embraced the challenge but emerged victorious, proving that the right automation can turn any business quest into a successful adventure #Go with the flow #Power User Love
