ÃÞ»¨ÌÇÖ±²¥

Now that COVID-19 diagnostics are available in most of the United States, media reports are surfacing about false-negative test results and the possibility of reinfection. We break down some of the major challenges of SARS-CoV-2 testing, including issues of test performance and interpretation, to give these reports context. Caveat: evolving!

What Tests Are Available for COVID-19 and How Are They 'Approved' in the U.S.?

Generally, lab tests are classified as (IVD) by the Food and Drug Administration (FDA) and go through a rigorous approval process to gain FDA clearance. If a company wants to sell a new diagnostic testing platform, they normally have to endure a series of steps including test classification, applications and paying fees. If the test is innovative, to demonstrate adequate performance of the test. In the cases where a new diagnostic panel is developed but can be used on existing equipment (the Centers for Disease Control and Prevention's SARS-CoV-2 assay, for example), a relatively lengthy FDA review may still be required under normal conditions (e.g. no pandemic occurring). Since the test is new, its performance needs to be compared to the performance of a current "gold-standard" test, also known as the "reference standard." There currently is no gold-standard diagnostic test for SARS-CoV-2 since the virus is new to us.

On Feb. 4, 2020, the Human Health and Services (HHS) Secretary determined that there is a public health emergency, and therefore, circumstances justify the authorization (EUA) of in vitro diagnostics for the detection and/or diagnosis of SARS-CoV-2, the virus that causes COVID-19. Clinical and commercial laboratories, as well as test kit manufacturers, may therefore submit expedited submissions for FDA EUAs of their diagnostic devices and assays. The FDA's require analytic sensitivity and specificity analyses. Analytical sensitivity is the smallest amount of substance in a sample that can be reliably detected by an assay (limit of detection) and analytical specificity is the assay's ability to detect only the desired substance in a sample without cross reacting with other substances. However, these analyses  (the percentage of positive patients who test positive and negative patients who test negative, respectively) and a test with good analytical sensitivity and specificity does not necessarily have good clinical sensitivity and specificity. The overall performance of SARS-CoV-2 RT-PCR tests cannot be known until we understand who is truly infected and who isn't.

When we last checked (April 24th, 2020), there were 45 commercial COVID-19 test kits and 10 laboratory-developed tests (tests uniquely developed by the performing laboratory) that have . ÃÞ»¨ÌÇÖ±²¥ has published protocols for clinical laboratories to help them verify commercial SARS-CoV-2 kits. While these protocols do not overcome the test performance uncertainty explored below, they do enable labs to establish that tests work to the manufacturer's specifications within that specific testing environment.

What Factors Influence Test Performance & Could They Cause False-Negative Results?

'False-negative' test results refer to cases where someone who truly has the disease tests negative instead of positive. For RT-PCR tests, like those used to diagnose COVID-19, false negatives occur for a variety of reasons, such as the level of viral RNA being below the limit of detection of the test. We are learning something new every day about the best specimen types, collection methods and testing platforms for SARS2-CoV detection. These variables could help explain why some SARS-CoV-2 tests are negative when in fact, the patient has clinical disease.

Variables in Specimen Collection and Transport

ÃÞ»¨ÌÇÖ±²¥ dogma dictates that leads to accurate results from the lab, but we aren't even sure what "good specimen collection" means for COVID-19. Nasopharyngeal (NP) swabs are the , but this topic is rapidly evolving. CDC guidance has been revised in the past few weeks to allow for lower respiratory tract testing, oropharyngeal (OP) swab testing, self-collected swabs and nasal turbinate swabs. How well these specimens perform against each other is difficult to guess, as we have limited data on this topic. There are even debates and active research on the COVID-19 disease.

Several studies attempt to nail down when a patient has the highest SARS-CoV-2 viral load and where that occurs on the body, with sometimes contradictory results. demonstrates that viral load and rates of detection differ across areas of the body, as you would expect. Both nasopharyngeal (NP) and oropharyngeal (OP) swabs during the first 5 symptomatic days had the highest viral loads of all specimen types and gave positive results by RT-PCR, but detection dropped to 40% after day 5. A (n=213 patients) from China described that OP swabs detected virus less frequently than NP swabs, particularly 8 days after symptom onset. In , 17 COVID-19 patients, who were secondary infections from known cases, had sequential samples obtained after symptom onset and were found to have higher viral loads in NP swabs (samples taken from mid-turbinate to nasopharynx) in comparison to OP swabs. The published on detection of SARS-CoV-2 from different clinical specimens describes 205 hospital patients from 3 Chinese hospitals, with 1,070 specimens collected. Nasal swabs had the highest viral load, although the timing of collection into illness or associated clinical history was not available for many of these specimens.

The data on best specimen type is sparse, but we know that in early illness, NP swabs, and possibly OP swabs, are adequate specimens for detection of SARS-CoV-2 and have some of the highest viral loads of any sample types. Conversely, the evidence is pretty definitive that urine and serum samples are not appropriate specimens for COVID-19 testing. Several studies also corroborate that the later a specimen is collected after the day symptoms began, . Given current data, specimen collection from the wrong area of the body or at the wrong time is almost certainly contributing to false-negative test results.

Much of the current knowledge regarding specimen transport for respiratory viral testing . However, there is currently a nationwide shortage of universal transport medium, the supportive liquid swabs are transported in after collection. demonstrated that collecting a NP swab and placing it in any of 4 alternative liquid mediums is equally effective. Specific instructions for specimen handling will vary with the transport medium, but in general, if the specimen cannot be sent immediately, it should be refrigerated at 2-8°C for up to 72 hours. If transport is not possible within 72 hours, then the sample should be stored at -70°C or below. Without proper transport medium or storage, specimens degrade. This is especially true for the RNA that is detected by an RT-PCR test. RNA is less stable than DNA, so if a specimen is not transported or stored appropriately, the risk of a false-negative RT-PCR result increases.

Limit of Detection of COVID-19 Tests

In practical terms, the limit of detection (LOD) for an RT-PCR test tells you the minimum amount of RNA that the test will detect 95 out of 100 times. If the limit of detection (LOD) for a test is too high, patients who are infected with SARS-CoV-2 may not test positive, leading to a high rate of false-negative results. If the LOD for a test is too low, then contamination can become a major problem, as the test will detect the tiniest amounts of viral RNA, leading to false-positive test results (i.e., people who are not infected with SARS-CoV-2 will test positive instead of negative). The art of determining how much viral RNA detected in a person is clinically significant, and therefore the target LOD for an accurate test, is just that ... an art.

The LOD is available on . Below is a sampling of the LODs (in copies per milliliter, cp/mL) of tests from the largest commercial laboratories, the point-of-care Cepheid assay frequently mentioned in the press and the CDC test.

As you can see, there are a lot of nuances to consider. LOD, and therefore overall clinical sensitivity of the tests, varies depending on the commercial vendor, how the LOD estimate was determined (some companies used intact virus, which better simulates real samples, whereas others used just nucleotide sequence) and the specimen type submitted (some vendors only validated their assays for certain specimen types). On the bright side, the LOD of current diagnostics should allow them to detect at least early-infection (within 1 week), symptomatic COVID-19 patients if the mean viral loads reported thus far are representative. For example, the specimen studies cited earlier indicate that NP swabs have on the order of 10⁵ to 10⁶ cp/mL of viral RNA. Even the less sensitive tests have LODs in the range of 1000s of cp/mL, so the levels of RNA in clinical samples during acute infections should be easily detectable. also suggest that the viral load in the upper respiratory tract may be similar between people who have asymptomatic or pre-symptomatic infection, and those who are symptomatic, so being asymptomatic may not increase the chances of having a false-negative test.

How Likely Is It That SARS-CoV-2 Is Reinfecting Recovered Patients?

While research on immunity to SARS-CoV-2 after infection is ongoing, it is unlikely that patients are becoming reinfected shortly after their initial infection. performed in Zhejiang, China monitored 13 COVID-19 patients from home quarantine over a period of 4 weeks after being discharged from the hospital. Of these, 2 patients had SARS-CoV-2 RNA detected consistently in their stool for 14 and 15 days after discharge. Of the sputum samples collected from the quarantined patients during the 4 week period, the rate of a recurring positive test was 31%. Interestingly, these patients showed no other abnormal clinical signs or symptoms when testing positive after their initial discharge. A peer-reviewed study with a large cohort of patients from a group of researchers in Wuhan, China demonstrated that the virus was detectable by RT-PCR in patients who survived COVID-19 for up to 37 days, with a median time of 20 days. For comparison, virus have been shown to decrease greatly after 7 days, although this varies based on patient comorbidities and viral treatment. Lingering positive results are possibly explained if viral RNA remains in tissues for a considerable amount of time, even when the viral particles capable of causing infection have been cleared. In most cases, patients that have tested positive for SARS-CoV-2 after their original infection are at the time of retesting. If a patient is positive for the disease, then has a negative test followed by a positive test within a short period of time, this is most likely due to a false-negative test occurring between the positive tests (perhaps due to one of the factors described above).

As yet, there is no consensus on how accurate our testing is, and given the potential for asymptomatic carriage and prolonged viral shedding post-infection, we likely have a long road ahead and many lessons to learn. But understanding the limitations and pitfalls of our testing is incredibly important for both serving the public and patients. No test is perfect, and we are all learning together on this one.

Thank you to Rose Lee, M.D., Beth Israel Deaconess Medical Center, for her contributions to this article, including the table comparing tests.