LOW CODE category and Crawler for social data

As a team, we have a primary goal: We help magic happen by utilizing modern AI approaches. 

We also understand that every student needs a mentor, but the number of available mentors is minimal today. Our idea is to introduce digital twins for available mentors, which would allow us to help a more significant number of students. To achieve that, we are using all available data about the mentors. But to keep it fresh and reliable, we must have the latest events in our OneLake. 

So, we implemented the LinkedIn profiles’ social crawlers to track all the mentors’ activities and events and suggest new potential mentors. 

We do that via the most modern and most straightforward way by utilizing the PowerAutomate Desktop: 

Then, the data will be collected and stored in an Excel spreadsheet, making it available for future processing with our Data Factory.  

The primary consumer of the data regarding upcoming events is the students, who use the complex search request to find the proper event by searching across different fields. Participation in community events potentially increases the chances of successful onboarding to the new school. 

Relevant search API functionality if covering 98% percent of the required functionality. Unfortunately, this API is unavailable on the Power Pages side. We implemented the Power Automate Flow from the portal, a wrapper around the original Dataverse API, to resolve that issue. 

On the portal side, we are using the Select2 component to implement autocomplete functionality. 

Leave a Reply