GP
Chord Lab

How We Review Products

The data-first method behind Chord Lab's recommendations — including what the AI is allowed to do, and what it is not.

The short version

I don't run a testing lab or a studio, and I won't pretend to. What this site does instead: build a catalog of real, verified product listings for each category, pick products from it with fixed rules weighted for the specific use-case each guide covers, and let an AI write the prose — without the ability to choose, re-rank, or re-price a single product. When the data behind a guide is too thin to defend, the guide doesn't ship.

Where things stand

This method is new, and I'm rolling it out one category at a time. Guides that haven't been rebuilt yet were drafted with AI assistance before it existed. Until a guide is rebuilt, it shows no prices, and its links open Amazon so you can see current prices and availability there.

Who's behind this

Chord Lab is run by Vin Falkiewicz, who has played guitar and drums since age 12 and is a Senior Manager in Technology & Transformation at EY, leading AI Mobilization for EY's Financial Services practice. That's where the approach comes from — data pipelines and tightly-constrained AI systems are the same patterns I work with in production for enterprise clients. This site applies them to the question of which music gear is actually worth buying.

When this site says “we,” it means me plus the software pipeline described below. There is no editorial team, no test studio, and no luthier on staff — I'd rather tell you that plainly than invent one.

Where the data comes from

Each rebuilt guide starts from a catalog of real products, and every product in it carries its provenance:

  1. Verified Amazon listing data — retrieved through a paid structured data service: the exact listing a recommendation links to, its availability, and its aggregated buyer ratings. A product without a current, verified listing doesn't get a purchase link.
  2. Manufacturer specifications — used for product identity and the specs that matter for each instrument: wattage and speaker size for amps, pickup configuration and scale length for guitars, key action and polyphony for keyboards. Specs are marketing until something independent confirms them, so they're presented as the manufacturer's claims.
  3. Independent sources, as they're added — published expert reviews and long-term owner feedback get onboarded only if they're free to access, attributable, and clear about their methods. Each rebuilt guide says which sources stand behind it.

How products get picked

Rankings come from fixed rules applied to the catalog — math over the data, not an AI's opinion:

  • Weighted per use-case. A guide for metal players weighs humbuckers, fast necks, and 24 frets; a blues guide weighs single-coils and a vintage voice. The same guitar can rank first in one guide and fourth in another — that's the system working, not a contradiction.
  • Cheap doesn't automatically win. Value is one factor among several, so a mediocre product can't take first place on price alone.
  • Budget limits are hard limits. A “best under $500” guide can't include a $700 product, and a $12 strap can never be ranked as a guitar.

What the AI actually does — and what it can't

In rebuilt guides, AI writes the prose and nothing else. A constrained writer turns the locked picks into readable text. It cannot add, drop, reorder, or rename products, and every price, spec, and link is filled in from the data, not generated by the model.

Automated checks run before anything publishes, on every guide: budget limits are enforced, cheap accessories are flagged when they turn up as instruments, and fabricated-authority claims (“we tested this in our studio”) are blocked outright. I read every rebuilt guide before it ships.

Our rating system

In rebuilt guides, each product's 1.0–10.0 score is computed from the catalog data and weighted by the guide's use-case. In guides that haven't been rebuilt yet, scores are Chord Lab estimates made when the guide was drafted — useful for comparing picks within one guide, not measurements.

When we don't publish

  • If fewer than three products clear the data bar, the guide is held until the data exists.
  • If the products in a guide don't match what it promises — say, computer keyboards turning up in a guide to musical keyboards — it comes down until it's fixed. One guide is already down for exactly that reason.

What we don't claim

  • We don't claim to have physically tested products. When a guide cites a measurement or a review, it credits the source.
  • We don't pretend any single source is gospel. Buyer reviews skew recent and emotional; manufacturer specs are marketing. Weighing several sources, with each claim attributed, is how those biases get contained.
  • We don't pretend the AI is infallible — which is exactly why it's kept out of every decision and checked by automated guards.
  • The rebuild doesn't cover every category yet. Older guides predate this method and are being replaced, not retrofitted.

Editorial independence

  • We do not accept payment for product placement or favorable coverage.
  • Commission rates play no part in how picks are chosen — price affects a ranking only through value, as described above.
  • Every pick lists real drawbacks. A recommendation that fits nobody in particular fits nobody.

How we make money

Chord Lab is reader-supported. As an Amazon Associate I earn from qualifying purchases: when you click a “See price on Amazon” link and buy something, I may earn a small commission at no additional cost to you. That revenue funds the data the method above depends on — product-data APIs and AI model usage.

Keeping guides current

Rebuilt guides re-check prices and availability against live listings, and when the data changes, the guide is re-run through the same pipeline — not hand-patched. Every guide shows a “Last updated” date so you know how current it is.

Spot an error? Question the method?

Reach me directly at contact@chord-lab.com. If a recommendation is wrong, I want to know. If the method doesn't hold up under scrutiny, I want to fix it. My LinkedIn is public.

— Vin