Our Testing Methodology
Why We Publish Our Methodology
Every score and recommendation on eComGuider comes from a documented process. We publish that process so you can evaluate our work, understand how we reached a conclusion, and adjust recommendations if your priorities differ from our scoring weights.
Every platform is evaluated using the same testing process, scoring framework, and editorial standards.
How We Score eCommerce Platforms
Every platform review on eComGuider uses a weighted scoring system across eight categories. Each category is scored individually, then weighted to calculate an overall platform score.
| Scoring Category | Weight | What We Measure |
|---|---|---|
| Technical Performance and SEO | 20% | Speed, Core Web Vitals, URL structure, schema, crawlability |
| Total Cost of Ownership | 20% | Subscription, transaction fees, required apps, themes |
| Catalog and Inventory Management | 15% | Variants, inventory tracking, bulk editing |
| Conversion and Checkout Friction | 15% | Checkout flow, payment options, cart recovery |
| Design and Frontend Flexibility | 10% | Themes, customization depth, code access |
| Extensibility and Integrations | 10% | App marketplace, APIs, third-party integrations |
| Logistics and Fulfillment | 5% | Shipping, carriers, fulfillment options |
| Customer Support Operations | 5% | Support quality, response times, documentation |
Scores are calculated from documented evidence gathered during testing, not from vendor marketing materials or self-reported platform data.
How We Calculate Overall Scores
Each category receives a score out of 10 based on documented testing results. That score is multiplied by the category’s weighting to produce a weighted contribution. The weighted contributions across all eight categories are added together to produce the final overall platform score shown in every review.
This ensures that categories with the greatest impact on merchants, such as technical performance and total cost, carry more weight than lower-weighted categories.
Understanding Our Scores
| Score | Meaning |
|---|---|
| 9.5 to 10 | Exceptional |
| 9.0 to 9.4 | Excellent |
| 8.0 to 8.9 | Very Good |
| 7.0 to 7.9 | Good |
| 6.0 to 6.9 | Average |
| Below 6.0 | Significant limitations |
What We Evaluate in Every Review
Technical Performance and SEO
We test page speed, Core Web Vitals, and the platform’s native SEO toolset. We verify URL structure control, XML sitemap configuration, schema markup support, redirect management, and mobile performance. Platforms that require paid apps to access basic SEO functions score lower than those that include them natively.
Total Cost of Ownership
We calculate the true annual cost at three monthly revenue levels: $1,000, $5,000, and $25,000. The calculation includes the subscription plan, required apps for standard store functionality, payment processing fees, transaction fees, and theme costs where applicable.
The monthly plan price alone does not reflect what you actually pay.
Catalog and Inventory Management
We evaluate how the platform handles product creation, variants, bulk editing, inventory tracking, collections, and category management. Scoring reflects both the depth of native features and the ease of daily management.
Conversion and Checkout Friction
We measure checkout steps, guest checkout availability, payment method options, cart abandonment recovery, and mobile checkout experience. Platforms with fewer checkout steps and more native payment options score higher.
Design and Frontend Flexibility
We assess theme quality, customization depth, code access, and the ability to build a store that does not look identical to every other store on the platform. This category covers both no-code customization and developer-level control.
Extensibility and Integrations
We evaluate the app marketplace, API quality, third-party integration support, and automation capabilities. A large app marketplace with overpriced or low-quality apps scores lower than a smaller ecosystem with well-integrated options.
Logistics and Fulfillment
We review native shipping options, carrier integrations, fulfillment center connections, print-on-demand support, and dropshipping compatibility.
Customer Support Operations
We evaluate support channel availability, response times based on documented merchant experience, help documentation quality, and community resources.
Our Testing Process
We test every platform through nine phases to gather the evidence our scoring is based on. The process covers research, hands-on setup, performance testing, and final scoring.
Phase 1: Platform Research
Before opening an account, we document what the platform officially claims: pricing, features, limitations, policies, and recent release notes. This creates a baseline we verify or contradict through hands-on testing.
What we review: official documentation, pricing pages, feature lists, acceptable use policies, changelog, and developer documentation.
Phase 2: Store Setup
We create a real account using the platform’s standard onboarding. We configure a working store from scratch, including domain connection, product catalog, collections, and store settings.
No pre-built demo stores. No vendor-provided test accounts. Setup starts where your store would start.
Phase 3: Commerce Configuration
We configure every major commerce function: payment processing, shipping rules, tax settings, checkout flow, discount codes, and inventory management.
This phase reveals complexity that pricing pages hide. How many steps does checkout require? Which payment processors are available without extra fees? Are tax rules automatic or manual?
Phase 4: Performance Testing
We test store speed and technical performance using Google PageSpeed Insights, Core Web Vitals measurements, and mobile and desktop benchmarks.
We evaluate: page load speed, Largest Contentful Paint (LCP), Cumulative Layout Shift (CLS), First Input Delay (FID), mobile performance, CDN quality, and hosting infrastructure.
Phase 5: SEO Evaluation
We audit the platform’s native SEO capabilities without relying on third-party SEO apps.
We test: URL structure control, XML sitemap generation, robots.txt configuration, canonical tag handling, 301 redirect management, schema markup support, metadata control, image optimization options, and crawlability.
Phase 6: Real-World Store Management
We run the store as a store owner would: managing products, processing test orders, updating inventory, handling customer records, and navigating the daily workflow.
This phase identifies friction that only appears in real use, not during initial setup.
Phase 7: Scalability and Ecosystem
We evaluate what the platform can do when your store grows: the app marketplace, API access, third-party integration support, automation options, headless commerce support, multi-store capabilities, and international selling features.
Phase 8: Comparison and Benchmarking
Every platform’s scores are measured against the same criteria. No platform is evaluated in isolation. Where relevant, comparison articles are updated when scores change to keep head-to-head matchups accurate.
Phase 9: Final Scoring
After testing is complete, evidence from all phases is consolidated and category scores are assigned using our published scoring framework. The weighted overall score is then calculated from the eight category scores. This is the score published in every platform review.
Evidence We Use
Our conclusions are based on multiple evidence sources, not on vendor marketing claims.
We use: hands-on testing results, official platform documentation, developer documentation, pricing pages verified at time of testing, technical audits, Core Web Vitals measurements, release notes, public platform announcements, established merchant feedback from verified community sources, and independent benchmarking studies where available.
Where a claim comes from a third-party source, it is cited with a link to the original.
Editorial Independence
Affiliate partnerships do not influence our scores. No platform receives special treatment, and no affiliate relationship changes how we test or score. Every platform is evaluated using the same criteria regardless of whether we earn a commission when you sign up.
Rankings cannot be purchased. No platform can pay for a higher score, a better placement, or a more favorable review. Our Affiliate Disclosure explains how we earn revenue and how we maintain separation between monetization and evaluation.
For how our content is written, reviewed, and approved before publication, see our Editorial Guidelines.
Keeping Reviews Current
eCommerce platforms change. Pricing changes. Features launch and are discontinued. Our reviews include two dates: Last Tested and Last Updated.
Last Tested is the date we most recently ran the platform through our full testing process. Last Updated is the date we most recently revised the published content, which may include a pricing correction or feature update without a complete retest.
Platform scores are not permanent. A pricing increase, a major feature release, a change in checkout functionality, or improvements to native SEO capabilities can increase or decrease a platform’s score when it is retested.
Reviews are updated when changes materially affect pricing, features, functionality, or our scoring.
Methodology Limitations
No methodology can perfectly represent every business.
Our scoring weights reflect the priorities of the readers this site primarily serves: solo founders and small business owners with stores generating up to $500K per year. A B2B wholesaler, an enterprise brand, or a creator selling digital products may weigh categories differently.
Where our overall score points in one direction but your business type suggests another, we say so in the review. Every platform page includes a section covering who the platform suits and who should consider an alternative, which accounts for use cases outside our standard scoring framework.