Overview Of Power Platform AI Builder - Power Platform AI Builder Series - Part One

Overview

 

Welcome to the Power Platform with AI series. During this entire series, we will talk about one of the most important components of AI Builder which is – “Form Processing”.

 

I have divided this entire series into the following parts,

1. Overview of Form Processing model – Prerequisites, Scenario, and Limitations
2. Build your Form Processing Model
3. Train and Publish your Form Processing Model
4. Build a Power Apps to detect Form using Form Processor and Store the information to SharePoint list

So, now let’s get started!

 

Prerequisites

 

AI Builder feature is available only for specific regions. If you want to know if your region is supported by the AI Builder feature or not please refer to the below link.

• Feature availability by region

What is Form Processing?

 

AI Builder Form Processing allows us to create an AI model that uses machine learning to identify the exact key-value pairs and table data from the form document.

 

Real-life Use Case

 

Let’s say, for example, your organization is managing some form filling procedure manually from the end-users. Some of the examples are:

 

HR Interviews

 

When interviewer came for an interviewer they will be provided with the form to fill in. Now, with the form processing model, we can scan that form using Power Apps, identify the Key-Value Pairs and store the information to our SharePoint list.

 

Rent Processing System

 

Property owner generates a rent receipt every month to their tenant. They are doing this procedure manually. Now, with the form processing model, we can scan that form using Power Apps, identify the Key-Value Pairs and store the information to our SharePoint list and do further analysis for the data.

 

What will be covered during this entire series?

 

We have taken an example of the Rent Processing System. We have a rent receipt like below.

 

 

We will build our model and Train our model with different forms.

 

 

 

Once our model is trained, we will create one PowerApps, which scan the pdf file and store the data to the SharePoint list.

 

 

Download Sample Forms for Practice

 

You can download Test Lab material for this series using my GitHub and the Power Apps demo which we are going to perform in this entire series is available here.

 

Important Points to Remember for Form Processing Input Document

• Extension Supported: PDF, PNG, JPG
• File Size: Combined file size should not exceed 50 MB and should not more than 500 pages for PDF.
• Dimensions: For Images, dimensions must be 530 x 100 and 4200 x 4200 pixels.
• For scanned documents – Recommends high-quality Images.
• Must use English characters.
• Must have Key-value Pair (Example: “Phone: [phone]”).
• Without a key label, the value will not be detected.
• Keys can appear above or to the left of the values, but not below or to the right.
• Use forms with different fields' value. The form template should be the same.

Limitations

• Complex tables – Nested tables, merged headers are not supported.
• Checkboxes and radio buttons not supported.
• PDF documents larger than 50 pages are not supported.
• Fillable PDFs are not supported.

Conclusion

 

This is how the basics of Form Processing works with the AI model. We will be discussing more about this with my next article.

 

Stay connected with me.

 

Happy Power Apping.