Test Pilot
Product · Hardware / device · Engineering & development by FlutterFlow
Automated AI testing for your apps in plain English.
Test Pilot is an AI-powered testing tool for FlutterFlow Studio that executes app tests written in plain English. It provides visual, step-by-step reports and failure analysis to help teams validate their mobile and web applications without writing complex scripts.
Category: Software Testing
- Platforms
- Web, macOS, iOS, Android
- Eligibility
- Requires a paid FlutterFlow subscription (Pro or Max)
- Test Limit (Pro)
- 1 test per project
- Test Limit (Max)
- Up to 3 tests per project
- Input Format
- Plain English text
- Output Format
- Step-by-step screenshots (PNG/JPEG)
- Write tests in plain English for AI execution
- Step-by-step screenshots of real app builds
- Visual failure analysis with downloadable evidence
- Integrated with FlutterFlow Studio Pro and Max plans
Overview
Test Pilot is an AI-powered automated testing tool for mobile and web applications built within FlutterFlow Studio. It allows developers and product teams to write test cases in plain English, which an AI agent then executes by interacting with a real build of the app. The tool documents every action with step-by-step screenshots and provides visual reports that identify exactly where a flow fails to meet expectations. Test Pilot is designed to simplify the QA process by removing the need for traditional test scripts while maintaining rigorous validation. It is available as a feature for users on FlutterFlow's Pro and Max subscription plans.
Test Creation and Execution
- Natural language testing: Users can write application tests in plain English for an AI agent to execute.
- AI-driven execution: An AI agent taps through a real build of the application to verify its behavior.
- Step-by-step screenshots: The tool provides step-by-step screenshots of the test run to document the process.
- Device frame preview: Tests can optionally be viewed within a device frame to simulate real-world usage.
Reporting and Debugging
- Failure identification: The tool identifies exactly where a test failed, such as an expected page not loading.
- Downloadable evidence: Every screenshot from the test run is available for download to assist in debugging.
- Run management: Users can cancel a test mid-run or re-open any past run for review.
- Failure reporting: The agent reports failures while the user or the AI Agent Panel handles the fixing.
Use cases
- QA teams write tests in plain English to verify login and sign-up flows across different device frames.
- Developers use Test Pilot to identify exactly which step in a complex navigation sequence causes an error banner to appear.
- Product managers download step-by-step screenshots of successful test runs to document app behavior for stakeholders.
Specifications
- Platforms
- Web, macOS, iOS, Android
- How to get it
- Available within FlutterFlow Studio for users on Pro or Max plans
- Eligibility
- Requires a paid FlutterFlow subscription (Pro or Max)
- Test Limit (Pro)
- 1 test per project
- Test Limit (Max)
- Up to 3 tests per project
- Input Format
- Plain English text
- Output Format
- Step-by-step screenshots (PNG/JPEG)
- Platform Integration
- FlutterFlow Studio desktop and web apps
How it works
- Write test in English: Write your test instructions in plain English within the Test Pilot interface in FlutterFlow Studio.
- AI agent execution: The AI agent taps through a real build of your application, following your instructions step-by-step.
- Review visual reports: Review the results, including screenshots for every step and a detailed report if the test fails to meet expectations.
Pricing
- Pro Plan (includes 1 test per project)
- $80 per month or $720 billed yearly
- Max Plan (includes up to 3 tests per project)
- $150 per month or $1,350 billed yearly
FAQ
What is Test Pilot?
Test Pilot is an automated testing tool that lets you write tests in plain English, which an AI agent then executes by tapping through a real build of your app.
Is Test Pilot free?
Test Pilot requires a paid plan, specifically the Pro or Max subscription tiers.
What are the test limits for Test Pilot?
The Pro plan includes 1 test per project, while the Max plan allows for up to 3 tests per project.
How does Test Pilot report failures?
Test Pilot provides step-by-step screenshots of the run, identifies where expectations weren't met, and allows you to download every screenshot for documentation.
Added by AntSpace from public sources (flutterflow.io).