Skip to content
Merged
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
39 changes: 34 additions & 5 deletions release-notes.mdx
Original file line number Diff line number Diff line change
@@ -1,6 +1,36 @@
---
title: "Release Notes"
---
<Update label="Week of 2025-09-27">


## What's New

**Features**

- **Agent Definition Versioning Upgrades:** Managing agent definitions is now faster, simpler, and more organized. Instead of manually copy-pasting and creating new definitions each time, you can instantly create new versions with meaningful commit messages. All test reports are consolidated in one place, making it easy to access and compare logs across versions. With one-click versioning and unified test history, iteration cycles are now much faster—allowing you to update and test new agent configurations in seconds, not minutes.

- **Automated Scenario & Workflow Builder:** Creating scenarios with synthetic data or uploaded datasets was useful, but it often lacked clarity in visualizing agent interactions. With the new Future AGI Scenario & Workflow Builder, you can simply upload SOPs or conversation transcripts and let the AI automatically generate comprehensive test scenarios—including edge cases that humans might miss. Each run now provides a clear, visual map of the exact conversation paths traversed by your agent, while the interactive workflow builder makes it easy to design, edit, and optimize flows. This enhanced experience delivers deeper insights, targeted edge case discovery, and a more intuitive way to implement and evaluate agent behavior.


- **Simplified User Session Tracking:** Session management is now effortless. Instead of shutting down the trace provider and re-registering everything, you can simply add a session.id attribute to your spans. This makes it easy to group data into multiple sessions, enabling granular, user-level insights into your application’s performance and behavior.



**Bugs/Improvements**

- **Direct Trace-to-Prompt Linking:** Introduced seamless linking of traces to prompts by leveraging the code snippet on the Prompt Workbench Metrics screen.

- **Enhanced Transcript Clarity:** Updated transcript terminology so users can easily distinguish between messages from the Agent and responses from the FAGI Simulator, improving readability and context during review.

- **Workspace Switching Loader Fix:** Fixed the loader behavior during workspace switching, ensuring a smoother transition.

- **Large Dataset Upload Stability:** Improved dataset upload experience by resolving loading issues for large CSV/JSON files, enhancing stability and user visibility.

- **Custom Evaluation Editing Fixes:** Resolved bugs in the Evals Playground to ensure smoother and more reliable editing of custom evaluations.
- **Group Evaluation UI/UX Improvements:** Refined the user interface and experience when editing group evaluations, making the process more intuitive and consistent.

</Update>

<Update label="Week of 2025-09-22">

Expand All @@ -24,15 +54,14 @@ title: "Release Notes"

**Features**
- **Intelligent Prompt Organization System:** Transform your prompt management with our new folder-based architecture. Organize prompts and templates in a hierarchical structure, create reusable templates from existing prompts, and maintain consistency across your AI workflows. Templates function as fully-featured prompts while eliminating repetitive configuration tasks.
- **Performance of Simulate Voice Agents:** You can now view the performance of your voice agent test run in an easy-to-read dashboard. You can check out Top Performing Scenarios and other valuable metrics to optimize your voice AI implementations and track conversation quality across different test scenarios.
- **Enhanced Test Execution Visibility:** We've expanded the simulate feature with additional scenario columns in the test execution list, complete with grouping capabilities. Users can now filter results more effectively and customize column visibility to focus on the most relevant data for their testing workflows.
- **Enhanced Voice Agent Testing & Analytics:** View comprehensive performance metrics of your voice agent test runs in an intuitive dashboard, including Top Performing Scenarios and conversation quality insights. The expanded simulate feature now includes additional scenario columns with grouping capabilities, customizable column visibility, and advanced filtering options—enabling you to optimize your voice AI implementations and focus on the most relevant data for your testing workflows.
- **Enhanced Plans & Pricing Experience:** Navigate pricing options effortlessly with our completely redesigned pricing page featuring interactive plan comparison cards, a dynamic price calculator, and detailed plan breakdowns. The new design provides clear visibility into feature tiers and helps you make informed decisions about your subscription.

**Bugs/Improvements**
- **Enhanced Observability & Dashboard Accuracy:** Resolved filtering issues for User ID across User Details Dashboard and Observe sections. Improved project selector clarity in Observe Eval Task Drawer and fixed workspace-level OTEL trace creation issues for more reliable monitoring.
- **UI/UX Enhancements:** Streamlined simulation flow interfaces for better user experience and standardized decimal precision across platform (displaying 2 decimal places for all numeric values).
- **UI/UX Enhancements:** Streamlined simulation flow interfaces for better user experience and standardized decimal precision across the platform (displaying 2 decimal places for all numeric values).
- **Enhanced Data Visibility in Dataset Summary:** Understand exactly how many data points contributed to your summary results and evaluation metrics, helping with complete transparency.
- **Code Snippet for Running Evals via SDK:** Copy-paste ready terminal commands to run any evaluation without manual configuration by leveraging code snippet on evals playground.
- **Code Snippet for Running Evals via SDK:** Copy-paste ready terminal commands to run any evaluation without manual configuration by leveraging code snippet on the evals playground.
- **Unified Design System:** Experience consistent interactions across the platform with our custom DatePicker component, ensuring a polished and cohesive user experience throughout your workflow.

</Update>
Expand All @@ -44,11 +73,11 @@ title: "Release Notes"
**Features**
- **Comprehensive Annotation Quality Dashboard:** Monitor annotation quality at scale with our centralized analytics dashboard. Track key metrics including annotator agreement rates, completion times, and advanced quality scores (cosine similarity, Pearson correlation, Fleiss' kappa) to ensure your training data meets the highest standards.
- **Enterprise-Grade Multi-Workspace Security:** Deploy with confidence using our complete RBAC framework. Create isolated workspaces, manage team members with full CRUD capabilities (edit, deactivate, resend invitations), and implement role-based access controls that scale with your organization's security requirements.
- **AI-Powered Trace Intelligence:** Unlock deeper insights into your AI applications with our comprehensive trace analytics agent. Get detailed performance scores across multiple evaluation metrics, pinpoint problematic spans in your execution flow, and receive AI-generated recommendations to optimize your AI agent's performance automatically.
- **Advanced Observability with Feed Insights:** Gain unprecedented visibility into agent performance with the new Feed Insights tab in the Observe section. Identify failed stages, affected spans, view error cluster events, track user counts, and analyze trend data over time for rapid issue diagnosis and agent optimization.
- **Intelligent Onboarding Navigation:** Experience streamlined onboarding with our redesigned sidebar that prominently highlights the 'Get Started' section until all 7 onboarding steps are completed. This ensures new users follow a structured path to success before transitioning to the regular navigation experience.
- **No Config Evals – Agent Compass for AI Teams:** AI agent developers often struggle to identify performance bottlenecks and system failures across complex execution flows. Traditional evaluation methods and system metrics offer only fragmented, span-level visibility—leaving teams blind to the bigger picture. As a result, diagnosing latency spikes, inefficient prompts, or tool-call failures becomes a time-consuming, manual process. Without actionable, trace-level insights, performance optimization turns reactive, error-prone, and expensive.


**Bugs/Improvements**
- **Improved Observability Reliability:** Enhanced backend resilience for incomplete span creation scenarios and fixed issues when OpenTelemetry exports fail partially, ensuring complete trace visibility.

Expand Down