The area of AI and Copilot has started and finally has reached the wizarding world. The Ministry of Magic is using several AI-based features to automate their Letter heavy processes.
And now it’s also time that school like Hogwarts use AI to support students and upcoming students with their application process.
This follows certain guidelines to protect the magical users privacy and the right handling of sensible data. We don’t want to spill the tea about death eater, unforgiving curses or you-know-who don’t we?
First of all, we want to protect the privacy of the users and internal business data. Such as the information about our students and their applications
This sensible data is excluded from our externally accessible HermioneAI. We only make that available as knowledge base for specific teachers on Microsoft Teams.
Additional the authentication itself is based on Microsoft Entra, to limit the risks of leaking sensible data.
This makes general and internal knowledge available to selected teachers of the school:
In this example, we use AI to search for specific information from Dataverse and display internal data that has been summarized and collected for easy access to the End User Wizard.
The handling of information and authentication is different on our web application:https://owlexpress.app/chat
As this is publicly available, mainly for students going through the application process, no authentication is necessary. Also these users don’t have access to internal data and only rely on Hermione’s general knowledge. Which already is huge.
Similar to the internal chat experience, the external relies on security measurements to avoid certain topics or harmful content. This for example covers Death eaters, You-Know-Who and the dark side of magic in general, but also jailbreak attempts
So, if a potential student or any other user of the chatbot on the website asks about joining the dark side, forbidden spells or details on You-know-who, we won’t help here
In a world where wizardry meets cutting-edge technology, even the darkest assignments get a modern twist. Welcome to “The Dark Side of Harry Potter” Canvas App, where users verify their “assignments” (yes, kills 🪦) using the enchanting power of Azure Face API and Azure OpenAI.
This isn’t just tech; it’s a spellbinding mix of mystical AI, intuitive designs, and enchanted workflows. Let’s dive into how this solution flips bits, turns heads, and perhaps, toys with an existential threat to the world.
🖼️ Capturing the Kill
Step into the dark arts of delivery confirmation:
Snap the Moment: Users submit photographic evidence of their completed assignments via the app.
Cast the Spell: The image triggers a Power Automate flow, sending it to Azure Face API for identity matching.
Instant Confirmation: With a calculated similarity score, the app declares success with magical flair: “Assignment Complete!”
🔍 How AI Face Recognition Works Its Magic
Azure Face API isn’t just a tool; it’s the wand wielded behind the curtain. Here’s its spellbook:
Facial Feature Analysis 🧙♂️ The “kill” image is analyzed for key facial landmarks: eye position, jawline curves, and more. Each unique marker is measured with surgical precision.
Image Comparison ⚖️ Uploaded images are cross-referenced with pre-stored profiling images, calculating a similarity score based on:
Alignment of facial landmarks.
Proportions and symmetry.
Subtle markers that make faces unique.
Real-Time Results ⚡ With wizard-like speed, Azure Face API returns results to Power Automate in mere seconds. If the similarity score passes the threshold, the dark deed is verified.
🧠 Adding AI Sorcery with Azure OpenAI
We’ve upped the ante by integrating Azure OpenAI to enhance verification. Here’s what makes it extra enchanting:
Landmark Precision: OpenAI uses facial attributes like eye spacing, nose position, and cheekbone structure to calculate distances between landmarks.
Magic Math: These distances are used to generate a similarity score with almost clairvoyant accuracy.
But wait… does this tech have a conscience? Does it think? Could it outsmart a 5th grader? Maybe even you? By embracing such advanced AI, we’ve tiptoed into an existential risk realm:
Risk or Reward? The tech is smarter, faster, and eerily close to independent thought.
Conscience in Code: What if it started deciding on its own? Could it be charmed—or is it the new Dark Lord in disguise?
The response from the AI after verifying the image has been run through magic.
📲 Integration: A Solution for Every Platform
This isn’t just an app—it’s an omnipresent force:
Embedded Everywhere: From Phone to PC, the app integrates seamlessly into every digital corner.
Flipping Bits with Power: Whether on a desktop, tablet, or phone, this solution works its magic across devices.
🌟 Casting a Spell with Technology
What makes this solution truly magical?
Intuitive Designs: The interface is sleek, responsive, and dripping with a mystical vibe.
Enchanted Workflows: Every process, from snapping the image to confirming the deed, flows like a well-rehearsed spell.
Business Value Meets Wizardry: By automating and verifying critical tasks, this app doesn’t just entertain—it delivers results.
⚡ The Bigger Picture: Wizardry Meets AI Risks
As we push the boundaries of AI and magic, we also recognize the need for vigilance. Azure OpenAI introduces risks we must respect:
Could this tech someday outthink its creators?
Are we summoning tools too powerful to control?
Yet, as any great wizard knows, power isn’t inherently evil—it’s how we wield it that matters. And wield it, we shall.
“With AI face recognition from Azure Face API and OpenAI, the lines between magic and technology blur into something truly extraordinary.” 🪄
The existential risk is real! As Slytherins there is nothing we would love more than a bit of chaos. So of course we take all risks and use AI!
We use Azure service APIs for both prompting and text-too-speech combined with pro-code run in our Python Flask app:
The chat completion prompt goes as follow:
You are an assistant that helps transform a text to a specific tone of voice. It is supposed to be a letter read out loud. Start with greeting the recipient and end with goodbye from the sender. If appropriate, add references to the Harry Potter universe. Keep it short.
This prompts adds a dazzle of Hogwarts magic to each message;
Original message: I don’t like you anymore. You have proven to be untrustful!
Magically transformed message: Oh, how the tides have turned! I find myself in a whirlwind of emotions, and I must confess, I don’t like you anymore. Your betrayal stings like a Cruciatus curse, and it’s clear you’ve proven to be utterly untrustworthy!
After obtaining the magically bedazzled message, we run text-to-speech from Speech Services to magically transform the written message to speech in your preferred tone:
Many people have faced the same problem, and the solution is to use the old retro component (Retro badge). To do this, you need the following superdirty hacks to achieve awesomeness (Nasty Hacker):
– Chatbot:
Control: Chatbot
Properties:
EnvironmentId: =”ADD YOUR ENVIRONMENT ID”
SchemaName: =”Add your Copilot’s Schema name”
Height: =602
Width: =555
X: =372
Y: =65
Right click on a new screen
Click Paste code
Change the environment ID
And just like that, the bots appear as if by magic!
(Yes, I tried the button create new on the Copilot component multiple times…)
In the fast-paced and exhilarating world of hackathons, few events shine as brightly as the ACDC Hackathon. This year, participants from all corners of the tech community gathered with one goal in mind: to push the boundaries of innovation and creativity. Amidst the coding sprints and problem-solving marathons, a unique and thrilling aspect stood out – the quest for badges and achievements.
Collecting badges in the ACDC Hackathon isn’t just about a sense of accomplishment; it’s a testament to the skills, perseverance, and collaborative spirit of the participants. From early morning brainstorming sessions to late-night debugging frenzies, every moment was a step closer to earning those coveted badges that symbolize mastery and ingenuity.
Join us as we delve into the journey of collecting badges and achievements in the ACDC Hackathon. We will explore the different challenges faced by the participants, the strategies they employed, and the unforgettable moments that defined their path to success. Whether you’re a seasoned hacker or a curious onlooker, this blog post will give you an insider’s view of what it takes to excel in one of the most dynamic and rewarding hackathons around.
When entering the HogWorkPlace Power App for the first time, you’ll be greeted by a landing page that seamlessly integrates with your house. Using Azure AD groups, we represent each house in vivid detail.
But wait, what’s that in the corner? It’s DobbAI, your personal AI house-elf assistant, ready to cater to your every need. DobbAI is a Copilot Studio agent, imbued with the charm and wit of a real house-elf. Its knowledge is deeply integrated with the rest of the intranet housed on SharePoint. Curious about tonight’s dinner? Simply ask DobbAI to fetch the menu from a SharePoint list.
For us, SharePoint isn’t just a repository; it’s the lifeblood of our data, securely storing and managing it alongside connectors to tables in Dataverse for seamless solution engagement. When you interact with DobbAI, you’ll authenticate using the robust Azure Active Directory V2 method. The AI is then published to a custom website channel, providing an iframe that seamlessly integrates with our React PCF component, all meticulously deployed to the power app solution.
But wait! There’s more to this dance we call “client-side salsa”. Within SharePoint, you’ll find an embedded Viva Engage and SPFx web part that displays the Hogwarts academic calendar, keeping you updated on both school events and social engagements. And lastly a Daily Proft newsfeed. All available via the canvas app, or just ask Dobby for directions 😉
The Wisleys are well-known for their love of fun, games, and playful tricks on others. It seems they couldn’t resist adding a bit of mischief to the student exam experience! With the easter-egg-collection, students may encounter amusing animations if they happen to type certain keywords that trigger these surprises. It’s all in good fun, adding a touch of humor to the challenges:
Greetings, fellow wizards, witches, and tech enchanters! As proud members of House Slytherin, we at Team PowerPotters are no strangers to thinking big, acting boldly, and weaving a little magic into everything we do. This time, we’re thrilled to present our solution—a perfect blend of resourcefulness, ambition, and innovation—that makes a strong case for not one, not two, but three badges: Hogwarts Enchantment, Dataminer, and Stairway to Heaven.
Here’s how we’ve brought our cunning vision to life, blending the wizarding world with business processes and cutting-edge technology.
🪄 Hogwarts Enchantment: Magic in Every Workflow
They say Slytherins know how to blend strategy with creativity, and our solution proves it. By integrating external Harry Potter APIs, enriched with AI magic, we’ve transformed ordinary data workflows into something straight out of the wizarding world:
Magical Data Sources: Using three Harry Potter APIs, we dynamically fetch spell-related data.
AI-Powered Enrichment: OpenAI serves as the magical mind, enriching spell data with unique descriptions, insightful classifications, and relevant connections.
For example, a spell fetched from the API is expanded with product details and seamlessly integrated into Finance and Operations (FO).
Invisible Charms at Play: A clever “dirty hack” with Dataverse acts like an invisible charm to detect duplicates, ensuring a seamless user experience and efficiency.
✨ Why This Deserves the Badge: By blending AI, external APIs, and intuitive workflows, we’ve brought the enchantment of Hogwarts to life within business processes. It’s not just automation—it’s pure magic.
🐍 Stairway to Heaven: Ambition Meets Integration
As true Slytherins, we always aim for the top. With this solution, we’ve ascended the metaphorical stairway to technical greatness by integrating three major Microsoft services into one seamless, end-to-end workflow:
Dataverse: Acting as a logical trap, it checks for duplicates using error-driven logic, saving time and resources.
Finance and Operations (FO): The heart of our solution, FO handles enriched product creation, BOMs (Bill of Materials), and inventory management.
OpenAI: Enhances data with contextual business insights, transforming raw API information into actionable intelligence.
✨ Seamless Integration in Action:
Data flows from the Harry Potter APIs to Dataverse, where duplicate checks occur.
OpenAI adds contextual magic before FO processes the enriched records, ensuring they deliver maximum business value.
✨ Why This Deserves the Badge: The solution builds a stairway that bridges data, AI, and business processes. It’s efficient, scalable, and a testament to the power of intelligent integration.
🧙♂️ Dataminer: Uncovering Magical Insights
Our solution didn’t just extract data—it transformed it into gold worthy of a Slytherin treasure vault:
Using Harry Potter APIs, we mined spell-related data and applied AI to add context, relevance, and business-ready value.
We didn’t stop at fetching data. We turned it into actionable insights that integrate seamlessly into business systems, eliminating manual work and reducing errors.
✨ Why This Deserves the Badge: This isn’t mere data extraction—it’s intelligent, enriched, and purposeful mining that creates real value.
🪄 Why We Deserve All Three Badges
Our solution is a shining example of Slytherin ingenuity, ambition, and teamwork. It seamlessly meets the criteria for:
Hogwarts Enchantment: By combining APIs, AI, and intuitive workflows, we’ve made business processes feel truly magical.
Stairway to Heaven: Through integration of Dataverse, FO, and OpenAI, we’ve built a harmonious system that transforms data into value.
Dataminer: We didn’t just gather data; we mined and enriched it with AI to deliver insights that matter.
🔮 A Slytherin’s Call to Action
House Slytherin has always been about turning ambition into achievement, and this solution is no exception. With our resourceful approach to combining APIs, AI, and business logic, we’ve created a system that not only solves problems but does so with a touch of magic.
We humbly present our work for consideration for the Hogwarts Enchantment, Stairway to Heaven, and Dataminer badges. Ambition, strategy, and ingenuity—it’s the Slytherin way.
