So you’ve just been to The Domain Conference in Fort Lauderdale and a monetisation company convinces you that you should run a test with them. Is there any real point and what is the best way to do this?
If you’ve ever moved your domains between parking companies by changing the nameservers then you will very quickly realise that there are so many variables to consider that the test becomes meaningless. For example, by routing the traffic at different periods of time, traffic volumes and domain market verticals all contribute to distorting the results.
In addition, if you move all of your domains across to the new company then from the previous article in this series we now know the best case scenario is they will win 35% of the time. Remember this number is for a properly optimised domain portfolio. If they win more than that then it’s only because your portfolio has not been looked after.
All monetisation companies know that they will perform well on some domains and not so well on others. Their goal is to hope and pray that overall the total amount they pay you will be more than your current parking solution.
From the domain investors perspective this is a really silly way of looking at things. What you actually want is to leave all the domains that win with the new company with them and automatically move all the domains that do worse away. This then maximises your earnings.
The ideal solution would be to keep all of your domains where they are and then send a percentage of the traffic to the new company for testing. This process allows you to accurately benchmark the new deal with a greatly diminished risk, compared to sending all of the traffic for your domains to the new company.
Earlier this year, one of ParkLogic’s customers had just returned from NamesCon and they were approached by a couple of the parking companies to run a test. Rather than move all of the domains away from ParkLogic they had a chat with me and we then routed a portion of their traffic to special accounts setup for them at the new companies.
They then were able to assess down to the cent on each domain whether the new deals were any good or not. In the end they moved everything back to their ParkLogic controlled accounts as they performed better than the specially setup ones. I should say that we were very happy to facilitate this process for our client as we regard it as one of the services we provide.
This structured process provides domain investors and any of their investors the confidence that everything that can be done is being done to maximise earnings. There’s no “grass is greener on the other side of the fence” as we absolutely know what the grass looks like and tastes.
Ultimately what you need to assess is your stomach for risk or in other words, how big a percentage is good enough? We typically find that forcing around 20% of the traffic for each domain over a couple of weeks (time depends upon traffic levels) gives a good enough sample. If the new company wins then you should move 100% of the traffic across to them…..and this is what we do. If a few weeks later they don’t perform as well then we automatically migrate the traffic back to the winning solution.
So after going through this process, what constitutes a win for the new company? You can’t use revenue as the traffic will have varied for the domain and distort the result. The only measurement that you can use is the normalised RPM.
Remember, we discussed this in a previous article. A normalised RPM involves measuring exactly how much raw unfiltered traffic we have sent for a particular domain to a particular parking company. We then measure get the revenue generated from that traffic. For a domain, mathematically this looks like:
(revenue at a parking company) / (total traffic sent to the parking company) x 1000
This then means that for every domain we will typically have the normalised RPM for every monetisation solution at any point in time…..yes, that’s what we do. In fact, we collect around three hundred different metrics for every domain every single day.
So when we were assessing for a client whether the new companies were performing better we we’re not looking at the revenue. We are looking at the normalised RPM because this metric tells us if the grass is actually green or brown. Given the process we also know the colour of the grass for every solution at any point in time.
So let’s imagine you’re not with ParkLogic and you don’t have any baseline normalised RPMs. For many clients we typically integrate their current monetisation account into the system. They change the nameservers to ParkLogic and we then route 100% of the traffic back to their existing provider.
By going through this process there won’t be a drop in revenue and it allows us to establish a baseline normalised RPM that we can measure any new solutions against. We then test a portion of the traffic elsewhere to see if it will perform better at other solutions. The whole time we are keeping an eye on the normalised RPM. It isn’t long before we see an uplift in the overall revenue.
This is the proper way to conduct a traffic test as it provides definitive performance data that is accurate. I hate to say it but any other methodology will largely be guesswork which is likely to end up with a suboptimal result.