AI Builder form processing models can now train using documents that have different layouts

Previously, you had to provide sample documents that all had the same layout to train each form processing model. For example, to automate data extraction from five different vendors’ invoices, you had to train five separate form processing models if those vendors used invoices with a different layout from one another.

Today we are excited to announce that you can now create a unique form processing model that will extract the same information from up to 100 different document layouts.

Get started

It’s easy to get started using this feature: just create a new Form Processing model and gather at least five sample forms for each layout that you want to process. For example, you can use five invoices from a given provider from five different months, and five other invoices from a different provider.

1. – Define fields and tables

List all fields and tables that you want the AI model to extract from your documents.

2. – Group documents by collections

A collection is a group of documents that share the same layout. Create as many collections as documents with different layout that you want your model to process.

For each collection, upload at least five sample forms.

3. – Tag your documents

After AI Builder has finished analyzing the documents, click on a collection on the right to start tagging the sample documents you have uploaded. By tagging the documents you are teaching the model how to extract the different fields and tables you have defined.

If one of the fields or tables is not present on a document, you can just mark it as unavailable in document.

Once you are done tagging a collection, navigate to the next collection to tag.

Once you have tagged all collections, you can move to the next step and train your AI model.

4. – Use your model

Once your model has been trained and published, you can go ahead and use it in your flows in Power Automate or apps in Power Apps.

Thanks to this new feature that we are launching today, the automation of your document processing is drastically simplified. There’s no longer a need to maintain a list of models for different document types. Now you can automate all your documents using the same model.

If you want to improve your model or add support for more layouts, just go to the model details page, select edit and add more collection or documents to your model.

Learn more

To learn more about creating your Form Processing model, you can refer to this documentation page.

The Get started with form processing in AI Builder module in Microsoft Learn is also a great way to discover the basics of form processing in AI Builder and how it can benefit your business.

If you prefer video, Microsoft MVP Reza Dorrani has published a how-to video for this new form processing feature.

We are always working to improve AI Builder to meet your needs. Feel free to share your feedback with us in the AI Builder forum or email us directly at aihelpen@microsoft.com.

We are looking forward seeing all the scenarios you will enable with this new functionality in AI Builder Form Processing!