Usability Metrics Redux

There are a number of more thoughts about Heatmaps and Clickmap technology.  I was reading Avinash's latest blog post and stumbled across the new Google Analytics "In Page Analytics".  Wow, click maps right there!  Very cool.  This shows the clicks on my other web site and can give me some insight into where people are clicking.  The good part is the "below the fold" orange bar that shows only 10% of people are scrolling down and clicking.  This is very useful and more helpful than the pretty heat maps out there.

In my summary over the past month, these are the observations that I have with the whole click and heat map world.

• Heatmaps are focused on pages. They are not process or session based and do not focus as much on objectives ("Did they convert"?) Still, in some cases,  mainly experimental, I can leverage them for a short term project. In most blog purposes, heatmaps are not that useful. 
• Scalability is tricky.  Few click maps can handle large loads so they sample your customers. This is okay, but still, full analytic tools like GA or Tealeaf give more useful data. 
• Mouse tracking cool, but why? I just can't get my brain around it,  but do I really need to see all the mouse-over or follow the mouse replays?  Wouldn't a click map tell me more useful and quantitative stuff
• Click map replay. It is interesting, but how to you identify which one you want to view?  There are sites that allow you to replay your clicks and mouse events, but how do you select them? Randomly?  If you want replay, use Tealeaf or Coradiant that allow you to search, select and then replay end user sessions.
• Got AJAX? Well, none of this technology really works with dynamic sites yet.  They rely on static pages or slowly moving pages.  So blogs and content sites are fine, but if I'm selling or providing news, not so sure this will be valuable.

While heat and click maps are pretty cool, I think using conversion tools like web analytics or Tealeaf to determine pages of interest, perhaps a heat map or two then.  But then using A/B testing will be more useful. Which page will increase conversion or acquire more customers? 

Why Heatmaps?

More and more of my customers have the request for heatmaps and usability metrics. While my snide comments of "eye candy" were my own personal thoughts originally, I decided to think and study the use of heatmaps to help improve the customer experience.

What Do People Do with Heatmaps?
My first real thought was "what do you really do with a heatmap"? A lot of folks in the Search Engine Optimization space use them to check their ad effectiveness. As seen below, the hotter part of the screen (red) indicates where the majority of users clicked. You can see on the far left, some clicks in green, but most are around the top of the page, to the left.

Okay, if I'm placing ads, I get this.  In the end, what people want is some other way to visualize where people are navigating to make the page "better".

What are People Hoping to Gather?
I have asked my customers and most of the metrics and statistics they are looking for are as follows:

• % of people who click an item or menu
• % of people searching vs. browse the page
• People who are scrolling down
• Tracking mouse overs and movements
• Do people use all the fields presented?
• Do they click the call to actions
• Do they navigate with the sidebars or heading tabs
• Are the carousels or other widgets being used?

What are Good Questions to Ask?
While a bunch of metrics are great to have and save for analysis paralysis, this leads us to the place to begin, what questions do we really need answers to?

• Does traffic source influence which clicks do people make?  Do I need landing pages for every campaign or can I just use the home page and everyone gets what they want?
• Do people click on the image or text ads on the site?  Do people even click ads?
• Are people clicking on the main call-to-actions on the page?
• Are key components grouped together nicely?  This will help to prioritize the page layout.
• Are people finding what they want quick enough? Are they clicking on "About Us' to get to "Contact Us"

I realize a lot of marketing folks really like heatmaps since they convey a pretty picture, but like any tool, without the right context and questions, they tend to only generate red herrings (tangents that are a fun journey but not that useful).  The best use of heatmaps is to establish a process for usability metrics and a strategy to integrate with Multivariate Testing and Customer Experience Management systems.