Editorial Guidelines
How we evaluate, rate, and recommend AI tools.
Our Testing Process
Every tool listed on PilotTools goes through a structured evaluation before we publish any recommendation. We do not accept payment for reviews, sponsored placements, or preferential treatment. Here is exactly how our process works:
- Discovery — We identify new tools through product launches, user requests, and competitive analysis. We track 50+ AI tool categories.
- Hands-On Testing — A team member uses the tool on real projects for a minimum of 15 hours across at least 5 different use cases relevant to the tool's category.
- Feature Mapping — We document every feature, integration, and limitation. We compare feature sets against the top 3-5 competitors in the same category.
- Pricing Analysis — We calculate true cost of ownership including hidden fees, per-seat costs, API charges, and overage fees. We track pricing changes monthly.
- Scoring — Each tool is scored 0-5.0 across five dimensions: Output Quality, Ease of Use, Feature Set, Pricing Value, and Community Reputation.
- Peer Review — Reviews are checked for accuracy and bias before publication.
- Publication + Updates — Published reviews are re-evaluated quarterly or when significant updates ship.
Scoring Criteria
| Dimension | Weight | What We Evaluate |
|---|---|---|
| Output Quality | 30% | Accuracy, reliability, consistency of results across multiple tests |
| Ease of Use | 20% | Onboarding time, UI intuitiveness, documentation quality |
| Feature Set | 20% | Breadth of capabilities, integrations, customization options |
| Pricing Value | 20% | Cost relative to capabilities, free tier generosity, pricing transparency |
| Community | 10% | User reviews, support responsiveness, update frequency, company stability |
Conflict of Interest Policy
- We never accept payment for reviews or ratings.
- Affiliate commissions do not influence our scores. Tools with no affiliate program receive the same evaluation rigor as those with one.
- If a tool offers us free access for testing, we disclose it. Free access does not guarantee a positive review.
- Our editorial team does not have access to revenue data from individual affiliate links — they cannot see which tools earn us more commission.
- We will always disclose if we have a financial relationship with any tool we review.
Update Policy
AI tools evolve rapidly. We commit to:
- Re-testing our top picks every quarter
- Updating reviews within 48 hours when major features ship or pricing changes
- Marking reviews with "Last Updated" dates so you know how current our information is
- Removing tools that shut down or degrade significantly in quality
How to Request a Review
If you've built an AI tool and want us to review it, contact us. We evaluate all submissions but cannot guarantee coverage. We prioritize tools that serve our audience of creators, freelancers, and small business owners. Requesting a review does not guarantee a positive outcome — we publish honest assessments regardless of the tool maker's relationship with us.
Corrections
Found something inaccurate? We take corrections seriously. Email us at hello@pilottools.ai with the specific issue and we'll investigate within 24 hours. All corrections are logged and timestamped.