Skip to content

Book a call

Cold email metrics: why open rate is misleading and what to count instead.

Open rate is misleading because an open is counted when an email client downloads an image from the message, not when a person reads it; instead, it is worth counting replies and interested leads. The main measure is interested leads per 100 contacts, because they show how many conversations the contact list produces.

Published
Updated
Reading time
6 min
Category
Results
Author
DYNTRO team

How does a sending tool count an open?

A sending tool does not know whether anyone has read a message. It only knows whether someone has downloaded from its server a small, invisible image that it added to the body of the email. Each recipient gets the image at a different address, so the download can be attributed to a specific person. It is this download that the tool records as an open.

Apple describes this mechanism in its Mail privacy information. Remote content in a message lets the sender see when and how many times the recipient opened the email, and also learn their IP address.

The problem is that the image can be downloaded not only by a person opening the message. The email client can download it before anyone looks at the inbox.

Why is open rate misleading?

The best-known example is privacy protection in Apple Mail (Mail Privacy Protection). According to Apple, the feature hides the recipient's IP address and prevents the sender from seeing whether the message was opened. Apple also explains how it does this: with the protection turned on, Mail does not wait until the message is opened to download remote content, but downloads it in the background by default, regardless of whether the recipient engages with the message at all.

To the sender, this looks like an open. A message that nobody read ends up in the statistics alongside those that someone read carefully. Any automatic image download works the same way: an open is recorded although no person was involved.

The error also works the other way. A client that does not download images will not report an open, even when the recipient reads the message and forwards it. The open rate is therefore partly inflated and partly understated. The figure alone does not tell you how much of it comes from people.

That is why we do not report open rate in DYNTRO reports. A figure that cannot be verified should not be the basis for changing the subject line, the segment or the whole campaign.

Which cold email metrics should you count instead of opens?

Ones backed by a person's action or a confirmed fact. At DYNTRO we use fixed definitions:

MeasureDefinition
ContactA person from the campaign contact list to whom we delivered the first message, meaning a message that was sent and did not bounce.
ReplyA human reply to a campaign message. We do not count auto-replies, bounces or read receipts.
InterestedA reply from a company on the campaign contact list that opens a conversation. It does not have to come from the same person, but the company must be on the contact list.

An interested lead has two levels. “Ready to talk” means a request for details, a conversation or a meeting, or a specific question about the offer. “Needs review” means an open door without a clear request, e.g. pointing to the right person or department, or “please get in touch later”. We always show both levels separately. We do not count a polite decline, an objection without a request, a mere acknowledgement of receipt or an auto-reply as interest. The full wording of the definitions is in the How we measure results section.

A message that bounced does not create a contact. Bounces are counted separately, because they say something about the quality of the contact list and the state of the domain, not about interest. We explain how to read them in the article on email bounces.

Guides often mention reply rate, meaning replies divided by contacts. It is more honest than open rate, because there is a person behind every reply. But it lumps “please send details” and “no, thank you” together. A campaign to which many people replied with a decline can have a high reply rate and not a single conversation.

Why is the main measure interested leads per 100 contacts?

Because it answers the question the management board asks: how many conversations does this contact list produce? The measure has several features that neither opens nor replies alone have:

  • Calculated per 100 contacts rather than as a count, it lets you compare week with week, segment with segment and campaign with campaign, even though they have different numbers of contacts.
  • The denominator is the people to whom the first message was delivered, not emails sent. Later messages in the sequence do not increase it, and bounced addresses do not inflate it.
  • Interested leads are shown at two levels, so “needs review” does not artificially raise the number of conversations.

How does the positive reply rate differ from the per 100 contacts measure?

On the Selected results page we show campaign results as a positive reply rate. We define positive replies as follows: “These are replies in which a company asks for details, wants to talk or comes back with a specific question. We do not count automatic responses or neutral reactions.” We calculate the rate from all replies, not from emails sent.

This rate tells you what share of the people who replied at all want to talk. It is a measure of the quality of replies and of how well the message fits. The per 100 contacts measure tells you something else: how many conversations every 100 people reached by the first message produce. Both figures are true, but they answer different questions.

Example of two campaigns counted in two ways

Two example campaigns with example figures. For simplicity, every positive reply is an interested lead who is ready to talk.

MeasureCampaign ACampaign B
Contacts10001000
Replies10035
Positive replies126
Positive reply rate12%17.1%
Interested per 100 contacts1.20.6

Campaign B has a higher positive reply rate, but from the same number of contacts it produced half as many conversations. Fewer people replied to it, but more often positively. Campaign A reached more interested leads, even though more people replied “no” to it.

The conclusion is practical: for every percentage, check what it is calculated from. The positive reply rate should not be compared with measures calculated from contacts or from messages sent. In campaign reports, the main measure remains interested leads per 100 contacts.

Summary.

  • Open rate counts image downloads, not reads. Apple Mail with Mail Privacy Protection downloads remote content in the background, so there are more opens than readers.
  • Instead of opens, count replies and interested leads at two levels.
  • The main measure is interested leads per 100 contacts. A contact is a person to whom the first message was delivered.
  • The positive reply rate is calculated from all replies, so it tells you about the quality of replies, not about how many conversations the contact list produces.

We run email and LinkedIn campaigns to decision-makers, from data and domains to replies, while your salespeople focus only on conversations. See the service: B2B email campaigns.

Book a call

Questions and answers.

Does open rate still make sense?

Not as a measure of campaign results. An open is counted when the email client downloads an image from the message, and Apple Mail with Mail Privacy Protection downloads remote content in the background, even when nobody has looked at the email. Conversely, a client that does not download images will not report an open, even though someone has read the message. Replies and interested leads per 100 contacts are more reliable.

How does a reply differ from a positive reply?

A reply is any message written by a person in response to the campaign, including a polite decline. Auto-replies, bounces and read receipts do not count as replies. A positive reply is only one in which a company asks for details, wants to talk or comes back with a specific question. We calculate the positive reply rate from all replies, not from messages sent.

Sources.

Related articles.

All articles

Let's start talking to the right companies.

Leave your details.

Your answer helps us see which channels bring enquiries.

DYNTRO sp. z o.o. processes the data from this form to reply to your enquiry. More in our privacy policy.

What happens next.

  1. On the first call, we define your customer profile, market and exclusions.
  2. We choose the scope: email, LinkedIn or both channels, in one or several segments.
  3. If working together makes sense, you receive a proposal with terms for your company.

Prefer email? kontakt@dyntro.pl