AI Builder: How to Monitor Your AI Builder Activity

Key insights

• AI Builder Activity Monitoring provides insights into AI model usage within the Power Platform, tracking data processing, task status, and AI credit consumption.


• Enhanced Model Management: Monitoring helps optimize model performance and manage costs by tracking AI credit usage.


• Improved Data Insights: Ensures data quality for better decision-making and aids compliance through clear audit trails of AI model usage.


• Role-Based Access: Customizes monitoring data views based on user roles to ensure relevant information is displayed for effective management.


• Key Components: Includes data processed, type, date, model name, status, processed by user, and AI credits consumed.


• Preview Feature and Future Developments: Currently in preview with future updates focusing on enhanced governance and administration capabilities for better monitoring and management.

Introduction to AI Builder Activity Monitoring

AI Builder is a powerful tool within the Microsoft 365 Power Platform that allows users to create custom AI models for various tasks such as form processing, object detection, and sentiment analysis. One of the key aspects of managing AI models is monitoring their activity, which is crucial for understanding how these models are being used and optimizing their performance. In this article, we will explore what AI Builder activity monitoring is about, its advantages, the basics of the technology, and what's new in this approach.

What is AI Builder Activity Monitoring?

AI Builder activity monitoring is a feature that provides insights into how AI models are being used within the Power Automate Platform. This includes tracking the data processed by these models, the status of processing tasks, and the consumption of AI credits. The AI Builder activity section in the Power Automate portal offers tables and charts to visualize this data, making it easier for users to manage and optimize their AI models.

Advantages of Using AI Builder Activity Monitoring

Enhanced Model Management

• Optimization: By monitoring AI model activity, users can identify areas where models are inefficient or underperforming, allowing for targeted improvements.
• Cost Management: Tracking AI credit consumption helps in managing costs associated with AI model usage.

Improved Data Insights

• Data Quality: Monitoring data processed by AI models ensures that the input data is accurate and relevant, leading to better decision-making.
• Compliance and Governance: Activity monitoring aids in maintaining compliance by providing a clear audit trail of AI model usage.

Role-Based Access

• Customized Views: Depending on user roles (e.g., System Administrator, Basic User), the monitoring data can be customized to display relevant information, ensuring that users see only what they need to manage their responsibilities effectively.

Basics of AI Builder Activity Monitoring

Key Components

• Data Processed: Includes text input for text processing models or image/document types for other models.
• Data Type: Indicates the type of data processed (e.g., Text, Jpeg, Png).
• Date: Shows the processing date.
• Model: Displays the name of the AI model used.
• Status: Indicates the processing status (Processing, Processed, Failed).
• Processed By: Identifies the user who initiated the predict action.
• AI Credits: Tracks the number of credits consumed.

Accessing Monitoring Data

Users can access the AI Builder activity page through the Power Automate portal by navigating to More > Discover all > Monitor > AI Builder activity (preview).

What's New in AI Builder Activity Monitoring

Preview Feature

The AI Builder activity monitoring is currently a preview feature, indicating that it is still in development and may not be fully available in all regions.

Integration with Other AI Capabilities

The latest updates in AI Builder include enhanced document processing and prompt engineering capabilities, which are integrated with Copilot Studio. These advancements allow for more sophisticated AI model management and customization.

Future Developments

The 2025 release wave for AI Builder focuses on AI governance and administration, including capacity management and usage monitoring. These updates will further enhance the ability to monitor and manage AI activities effectively. In summary, AI Builder activity monitoring is a valuable tool for managing and optimizing AI models within the Power Platform. Its advantages include better model management, improved data insights, and role-based access. As AI Builder continues to evolve with new features and capabilities, users can expect more robust monitoring and management options to emerge.

Keywords

AI Builder monitoring, track AI Builder activity, monitor AI performance, AI Builder analytics, AI usage tracking, optimize AI processes, analyze AI data, improve AI efficiency