Don’t let a self-serving survey ruin your trip

Christopher Elliott Travel columnist • Profile • E-mail

Southwest Airlines is the top air carrier in the United States. No, wait, it’s American Airlines. Hang on — make that Virgin America.

The best hotel? The Peninsula Chicago.  No, no. It’s The Waldorf Astoria in New York.

That’s the consensus — if you can call it that  — of the latest round of travel polls and “readers choice” surveys. The results are all over the map — literally and figuratively. None of them seem to agree on anything, leading me to wonder if any of them are believable.

Here’s the problem: Travelers make important vacation decisions based on these questionable surveys. And with more media outlets jumping into the survey game every year, the chances you’ll be at confused or even misled are better than ever.

One new poll claims travel agents voted New York’s John F. Kennedy airport as their favorite. Nonsense, says another — people prefer Las Vegas’ McCarran International Airport. (The correct answer is Orlando International Airport, if I do say so myself.)

Why do these surveys contradict each other? The obvious explanation is audience and methodology. Although in some instances, calling it a “methodology” is generous. None of the travel polls are particularly forthcoming about how the sausage is made.

But there’s more. As someone who has practiced journalism for a little while, I know that the publications sponsoring these awards aren’t necessarily doing this as public service. Awards are marketing tools. Ads are sold around the final results. Award dinners and plaques can be big moneymakers. They also raise the publication’s profile.

More by Christopher Elliott 5 creative new car rental fees to avoid Now that’s a change fee 3 things travelers will lose and gain in recession Spring broke: 6 secrets for no-cost travels Deal or no deal? Spotting a real bargain Navigating the new world of airline tickets Post-fee carry-on bags you've gotta have 7 tips for blogging your way to a better trip Changing travel one tweet at a time Be a YouTube star on your next vacation The fall of green travel More Christopher Elliott columns

Put differently, these aren’t travel industry awards — they are an industry unto themselves. And it’s an industry that isn’t necessarily concerned about your next vacation.

Here’s how to spot a self-serving survey:

Beware of resorts that over-publicize their awards
I realize this isn’t going to make me any friends in the public relations community. But airlines, hotels and cruise lines that snag one of these dubious awards and then blast a press release about their accomplishment to every travel journalist on the planet are hurting themselves. They think they’re sending one message: “Stay with us — we won a five-star/best-of/readers-pick award!” In fact, they’re probably sending another one: “We’re insecure. We need someone else to validate our product. We don’t really believe in ourselves.” Never mind what it says about the award.

Some methodology is better than no methodology
Always look for a few details about how the poll was taken. How many readers were surveyed? What was the response rate? Did they use an independent company to compile the results? Most importantly, how did they determine who was on the ballot? Was it just a group of editors sitting in an office, adding their favorite hotels to the list? Or were the finalists the result of a popular vote? None of the major awards reveal all of these facts, as far as I can tell. The more reputable ones disclose some of their methodology. The bogus ones don’t publish any of it.

A ‘best-of’ list without a ‘worst-of’ list is pointless
Surveys that highlight only the positive aspects of travel are in serious denial. The most credible awards acknowledge both the winners and sinners. For example, SmarterTravel.com recently asked readers to name their least favorite airline and the carrier with the dirtiest cabin. Troubled US Airways won both honors. Handing out an award without having something to compare it to is meaningless. So if your favorite media organization only talks up travel, maybe it’s time to find another favorite media organization.

MORE FROM TIPS

Tips Section Front

7 ways to avoid checked baggage fees How to get fit on vacation The travel secrets of war reporters The best iPhone apps for travelers Great things to do in the airport Airline safety course teaches life-saving skills How to leverage social media for a better vacation Double trouble on my honeymoon The lowdown on low international airfares Money matters on the road Tips Section Front   Add Tips headlines to your news reader: