Springer Nature is making SARS-CoV-2 and COVID-19 research free. View research | View latest news | Sign up for updates

Comparative multi-assay evaluation of Determine™ HIV-1/2 Ag/Ab Combo rapid diagnostic tests in acute and chronic HIV infection

  • 190 Accesses

Abstract

In resource-limited or point-of-care settings, rapid diagnostic tests (RDTs), that aim to simultaneously detect HIV antibodies and p24 capsid (p24CA) antigen with high sensitivity, can pose important alternatives to screen for early infections. We evaluated the performance of the antibody and antigen components of the old and novel version of the Determine™ HIV-1/2 Ag/Ab Combo RDTs in parallel to quantifications in a fourth-generation antigen/antibody immunoassay (4G-EIA), p24CA antigen immunoassay (p24CA-EIA), immunoblots, and nucleic acid quantification. We included plasma samples of acute, treatment-naïve HIV-1 infections (Fiebig stages I–VI, subtypes A1, B, C, F, CRF02_AG, CRF02_AE, URF) or chronic HIV-1 and HIV-2 infections. The tests’ antigen component was evaluated also for a panel of subtype B HIV-1 transmitted/founder (T/F) viruses, HIV-2 strains and HIV-2 primary isolates. Furthermore, we assessed the analytical sensitivity of the RDTs to detect p24CA using a highly purified HIV-1NL4-3 p24CA standard. We found that 77% of plasma samples from acutely infected, immunoblot-negative HIV-1 patients in Fiebig stages II–III were identified by the new RDT, while only 25% scored positive in the old RDT. Both RDTs reacted to all samples from chronically HIV-1-infected and acutely HIV-1-infected patients with positive immunoblots. All specimens from chronically infected HIV-2 patients scored positive in the new RDT. Of note, the sensitivity of the RDTs to detect recombinant p24CA from a subtype B virus ranged between 50 and 200 pg/mL, mirrored also by the detection of HIV-1 T/F viruses only at antigen concentrations tenfold higher than suggested by the manufacturer. The RTD failed to recognize any of the HIV-2 viruses tested. Our results indicate that the new version of the Determine™ HIV-1/2 Ag/Ab Combo displays an increased sensitivity to detect HIV-1 p24CA-positive, immunoblot-negative plasma samples compared to the precursor version. The sensitivity of 4G-EIA and p24CA-EIA to detect the major structural HIV antigen, and thus to diagnose acute infections prior to seroconversion, is still superior.

Introduction

Effective and timely surveillance of the HIV epidemic is critical for the prevention of virus transmission and a prerequisite for achieving high rates of early antiretroviral treatment. However, approximately 17 million of the 37 million people living with HIV are unaware of their HIV status [1, 2]. Boosting and expediting the identification of infected individuals is therefore a major challenge for the global health sector in the fight against HIV/AIDS [2].

Patients suffering from acute HIV infection are particularly difficult to diagnose [3]. These individuals typically suffer from rather non-specific symptoms, yet have viral loads that are about 20 times higher than in the untreated chronic phase of infection, which also correlates with a high risk of subsequent transmissions [4, 5]. Besides that, patients with primary HIV infection will likely directly benefit from early antiretroviral therapy by improving the overall clinical outcome [6], preserving the diversity of their immune response [7, 8], possibly reducing the size of the latent HIV reservoir [9, 10], and in some cases even achieving functional cure [11]. Consequently, there is a demand for diagnostic tests that are applicable for monitoring large groups of individuals and that are capable of rapidly identifying acute HIV infections with high sensitivity and specificity.

Today, the recommended laboratory-based screening tests are fourth-generation antigen/antibody immunoassays (4G-EIAs) [12, 13]. Because of their ability to simultaneously detect anti-HIV-1/2 antibodies (IgM, IgG) and the major structural HIV-1 protein, HIV-1 p24CA, with high sensitivity, 4G-EIAs are the current gold standard to screen for chronic as well as acute HIV infections. The efficiency of diagnostic tests to identify early acute virus infections is largely determined by their ability to detect HIV-1 p24CA. The limit of detection for HIV-1 p24CA in 4G-EIAs is below 20 pg/mL and thus comparable to those of standard p24CA-EIAs [14, 15]. 4G-EIAs generally score positive 4–7 days after the HIV-1 RNA is detectable by nucleic acid amplification in plasma [16, 17]. However, 4G-EIAs require well-equipped laboratories with trained personnel, total costs in resource-poor settings can be high or even unattainable and turn-around times may be too slow for effective patient management [18].

Consequently, over the last years, rapid diagnostic tests (RDTs) for HIV screening have been widely implemented. To perform a RDT typically takes less than 30 min even for inexperienced users and tests accept different patient samples, including serum, whole blood and/or other body fluids (urine, oral swaps). Besides their utility in developing countries, rapid tests are increasingly being used also as a consumer test for self-testing in Europe and the US [19, 20].

A concern for the widespread use of RDTs has been their diagnostic performance compared to laboratory-based assays [21]. One of the most frequently employed fourth-generation RDTs is the Determine™ HIV-1/2 Ag/Ab Combo (Alere) that works with either serum or whole blood samples. Several studies indicated a poor sensitivity for the detection of HIV-1 p24CA for the early version of this RDT [22,23,24,25,26,27,28], and therefore, Alere developed and released a modified version of this test. The sensitivity of this modified RDT to detect HIV-1/2 antibodies was shown to be high with low rates of false positive results [29,30,31]. However, its reported sensitivity for the detection of HIV p24CA antigen, the critical determinant for identifying acute HIV-1 infection, varied considerably: some studies found relatively high rates of p24CA detection (> 85%) in samples from infected individuals prior to seroconversion [29, 31, 32]. In contrast, other studies reported considerably lower p24CA detection rates (< 30%) in similar patient cohorts [30, 33]. Not surprisingly, the detection rates of the HIV antigen were particularly poor in samples from patients infected with the closely related HIV-2 [30].

The aim of this study was to evaluate the performance of the new compared to the old version of the Determine™ HIV-1/2 Combo to detect p24CA as well as anti-HIV antibodies in serum samples from patients with acute (prior to or post-seroconversion) or chronic HIV-1 and HIV-2 infection. Importantly, we compared the results obtained by these RDTs to those from multiple HIV detection assays including nucleic acid amplification (PCR), 4G-EIA and p24CA-EIA. Moreover, we evaluated the capability of the new RDT to detect p24CA from several clade B HIV-1 transmitted/founder (T/F) viruses that had been cloned using viral consensus sequences isolated from patients briefly after infection [34, 35]. The performance of the new RDT to detect capsid antigen was also tested for HIV-2 strains and HIV-2 primary isolates. Furthermore, we assessed the analytical sensitivity of the RDTs for p24CA using a well-characterized protein standard [36].

Materials and methods

HIV detection assays

RDT assays with novel and old versions of the Determine™ HIV-1/2 Combo (Alere) were performed according to the protocol in the package insert for frozen plasma specimens [37]. Results were read between 20 and 30 min after sample addition. By visual evaluation, positive test results were either defined as strong reactive or weak reactive. If not otherwise specified, specimens were tested in a single measurement.

For comparison, we tested the specimens in parallel with ARCHITECT HIV Ag/Ab Combo (Abbott, 4G-EIA), and INNOTEST® HIV Antigen mAb (Fujirebio, p24CA-EIA). Seroconversion in the plasma samples was evaluated by the New LAV Blot I Assay (Biorad) or the INNO-LIA HIV I/II Score (Fujirebio). In accordance with the manufacturers’ protocols, immunoblot results were interpreted as “positive” when showing at least two of the major bands (gp160/gp120, gp41, and p24). If HIV-1-specific bands were observed, but the criteria for positive interpretation were not met, results were termed “indeterminate”. Viral loads in HIV-1 specimens were measured using the COBAS Ampliprep/COBAS TaqMan HIV Test v2.0 (Roche, PCR). For staging of acute HIV-1 infections based on Fiebig criteria, we evaluated the presence of HIV-1 RNA (PCR) and p24CA antigen (p24CA-EIA), as well as the results of the 4G-EIA and immunoblotting: Fiebig stage I (RNA-positive, p24CA-EIA-negative, 4G-EIA-negative, immunoblot-negative), Fiebig stages II–III (RNA-positive, p24CA-EIA-positive, 4G-EIA-positive or negative, immunoblot-negative), Fiebig stage IV (RNA-positive, p24CA-EIA-positive or negative, 4G-EIA-positive, immunoblot-indeterminate), Fiebig stage V (RNA-positive, p24CA-EIA-negative or positive, 4G-EIA-positive, immunoblot-positive without p31 band), Fiebig stage VI (RNA-positive, p24CA-EIA-negative or positive, 4G-EIA-positive, immunoblot-positive with p31 band) [16, 38]. We determined the HIV-1 subtypes in positive samples by Sanger sequencing of specific parts of the pol/rt gene [39]. The NCBI HIV subtyping tool was used for data analysis (https://www.ncbi.nlm.nih.gov/projects/genotyping/formpagex.cgi). HIV-2 groups were identified by Sanger sequencing of specific parts of the pol/rt, pol/int and env genes. Obtained sequences were typed utilizing HIVAlign (Los Alamos National Laboratory sequencing database: https://www.hiv.lanl.gov/content/sequence/HIV/mainpage.html) and by applying COMET-HIV-2 (Luxembourg Institute of Health: https://comet.lih.lu/index.php?cat=hiv2) [40].

HIV specimens

All patient samples were remnants of specimens originally submitted for HIV testing. The testing panel included 23 acutely infected, treatment-naïve, immunoblot-negative specimens (Fiebig stages I–III), 27 specimens from acutely HIV-1-infected, treatment-naïve, recently seroconverted patients (Fiebig stages IV–VI), as well as 7 samples from chronically HIV-1-infected, ART-treated patients, and 11 specimens from chronically HIV-2-infected, ART-treated patients. Furthermore, five specimens from uninfected individuals were included in the study.

HIV-1 transmitted/founder viruses

Proviral plasmids of the following T/F viruses from subtype B were obtained from the NIH AIDS Reagent Program: WITO, CH040, CH058, CH077, CH106, RHPA, THRO, TRJO [34]. To generate T/F virus stocks, 150-mm cell culture dishes were seeded with 8 × 106 HEK293T cells per plate. Subsequently, cells were transiently transfected with proviral plasmids using the transfection reagent polyethylenimine (PolySciences). Culture supernatants were harvested 48 h following transfection and passed through 0.45 µM polyvinylidene fluoride filter units (Stericup®, Merck). For concentrating the virions, 28 mL of harvested cell culture supernatant was layered onto 6 mL of a 25% (wt/vol) sucrose solution (prepared in phosphate-buffered saline, PBS) in a 35 ml ultracentrifuge tube, and spun down for 1.5 h at 100,000×g and 4 °C. After discarding the supernatants, virus pellets were re-suspended in 100 µL PBS, and stored at − 80 °C until use. HIV-1 reverse transcriptase (RT) activity was assessed in the T/F virus stocks by SG-PERT assay [41]. In addition, the infectivity of stocks was determined by the TZM-bl X-gal staining assay [42, 43]: TZM-bl cells were seeded into the wells of a 96-well plate (seeding density: 5 × 103 cells/well) and subsequently treated with varying concentrations of the T/F virus stocks. 48 h post-infection, the supernatant was removed and cells were fixed with 4% paraformaldehyde in PBS for 10 min at room temperature. Afterwards, cells were stained in PBS-containing 200 μg/mL X-gal (5-bromo-4-chloro-3-indolyl-β-D-galactopyranoside, Fermentas), 1 mM MgCl2and 3 mM potassium ferricyanide for 4 h at 37 °C. Stained colonies were then visualized and counted under a microscope.

HIV-2 strains and primary isolates

Heat-inactivated HIV-2 strains and primary isolates were obtained from the “Stammsammlung” of the German National Reference Center for Retroviruses (http://www.mvp.uni-muenchen.de/nationales-referenzzentrum-fuer-retroviren/hiv-stammsammlung). If the viral load in these samples was above 1 × 106 c/mL, they were diluted with PBS to a calculated viral load of 1 × 106 c/mL prior to testing in the RDT assays.

HIV-1 p24CA standard

We evaluated the sensitivity of the RDTs for an HIV-1 p24CA protein standard kindly provided by Hans-Georg Kräusslich that had been bacterially expressed and purified in principle as reported [36]. The quantity of this standard was calibrated against bovine serum albumin using ultrasensitive silver staining. HIV-1 p24CA protein dissolved in the assay sample buffer of the INNOTEST® HIV Antigen mAb assay was prepared at different concentrations. 50 µL of the p24CA antigen dilutions was added to the novel and old versions of the Determine™ HIV-1/2 Combo (Alere). In parallel, we examined the protein dilutions via the INNOTEST® HIV Antigen mAb (Fujirebio Europe, p24CA antigen assay). Dilutions of the p24CA stock solution were prepared twice from different aliquots. The first protein preparation was tested in a single measurement. The second preparation was measured in duplicate for the RDTs and in triplicate for the p24CA-EIA (technical replicates).

Data analysis

The performance of the novel and old versions of the RDT to detect HIV-1 p24CA and HIV-1-specific antibodies was compared in each HIV-1 specimen group (1) acutely infected, immunoblot-negative (Fiebig stages I–III); (2) acutely infected, immunoblot-indeterminate/positive (Fiebig stages IV–VI); (3) chronically infected; (4) uninfected individuals with the results from PCR, 4G-IA, and p24CA-EIA. In case of 4G-EIA, the CMIA index was calculated. A sample cutoff > 1 was defined as positive. For p24CA-EIA, the p24CA concentrations in the specimens were estimated according to the protocol provided by the manufacturer. We compared the results from testing the new version of the RDT assay on HIV-1 T/F virus samples with the results from p24CA-EIA, SG-PERT and TZM-bl X-gal staining assay. For quantification of SG-PERT, RT activities of defined dilutions of a pCHIV 528 virus suspension were used for comparison. The threshold for detecting HIV-1 p24CA of the RDT was characterized by serial dilution of the well-characterized protein standard. As a control, dilutions of the p24CA stock solution were tested in parallel by p24CA-EIA. Arithmetic means and standard deviations from this assay were calculated using Prism 7 (GraphPad Software, Inc.).

Pearson correlations with two-tailed p values and 95% confidence intervals were calculated via Prism 7. Specimens with viral loads > 10,000,000 c/mL were excluded when calculating correlations.

Results

Assay performance in acutely HIV-1-infected, treatment-naïve, immunoblot-negative specimens (Fiebig stages I–III)

The novel version of the Determine™ HIV-1/2 Combo was reactive for 77.3% (17/22) of the specimens from acutely infected, treatment-naïve, immunoblot-negative patients in Fiebig stages II–III (8/22 strong reactive, Table 1). In 5/22 cases, the assay showed reactivity for both HIV-specific antibodies and p24CA. The novel RDT identified HIV antibodies, but was not reactive for p24CA antigen in 3/22 specimens. The one specimen from an acutely infected individual in Fiebig stage I was not reactive. In comparison, the old version of the Determine™ HIV-1/2 Combo was reactive for only 25% of the specimens (0/16 strong reactive). In 1/16 specimen, the old RDT was reactive for HIV antibodies, but did not detect p24CA.

Table 1 Detection of acute infections by the old and new versions of the Alere RDT in plasma specimens from immunoblot-negative, treatment-naïve, HIV-1-infected patients (Fiebig I–III) compared to quantitative PCR, 4G-EIA, and p24 Ag assay

In those samples for which we had determined the HIV-1 subtype, the old assay was reactive only for subtype B, whereas the novel RDT was reactive for samples containing subtypes B, C, as well as CRF01_AE, or F, but failed to identify anti-HIV antibodies as well as p24CA antigen in a patient specimen with subtype CRF02_AG (Table 1). All specimens from patients in Fiebig stages II–III were reactive when analyzed via 4G-EIA. The sample volume was not sufficient to perform the p24CA-EIA in 1/23 specimens. However, due to the fact that this particular specimen was PCR-positive, reactive in the 4G-EIA and immunoblot-negative, we classified it as Fiebig stages II–III. In case of the 4G-EIA, the CMIA index, and for the p24CA-EIA, the concentrations of p24CA present in the respective samples were calculated. Both parameters showed a positive correlation to the viral loads in the respective specimens (viral load in c/mL vs. CMIA index: r = 0.77; R2 = 0.60; p = 0.0003, viral load in c/mL vs. p24CA in pg/mL: r = 0.85; R2 = 0.73; p < 0.0001).

Assay performance in acutely HIV-1 infected, treatment-naïve, immunoblot-positive specimens (Fiebig stages IV–VI)

The HIV-1 subtypes of 26/27 specimens in this group could be classified and belong to the subtypes A1, B, C, CRF01_AE, CRF02_AG or had a unique recombinant form (URF, Table 2). Both versions of the Determine™ HIV-1/2 Combo identified HIV-1 infection in all specimens from these acutely infected, immunoblot-positive patients (new RDT: 27/27, old RDT: 8/8). The old RDT only detected HIV-1-specific antibodies, whereas the new version of the assay also detected p24CA antigen in 10/27 (37%) of the patient samples. These p24CA reactive samples were from the Fiebig stages IV as well as V and showed higher viral copy numbers (> 1,900,000 c/mL). The new RDT was tested with a specimen of HIV-1 subtype C (Fiebig stage IV) that showed weak immunoblot bands for p24 and p31, in which it failed to detect HIV-1-specific antibodies.

Table 2 Detection of acute infections by the old and new versions of the Alere RDT in plasma specimens from acutely HIV-1-infected, treatment-naïve, immunoblot-positive patients (Fiebig IV–VI) compared to quantitative PCR, 4G-EIA, and p24 Ag assay

As a reference, the 4G-EIA was reactive for all specimens in this group. The CMIA index correlated with the viral loads in the respective specimens (r = 0.54, R2 = 0.29; p = 0.0051). However, this correlation was weaker compared to the immunoblot-negative specimen group, likely due to a mixed detection of antibodies and p24CA by the 4G-EIA. The estimated concentrations of p24CA in these samples correlated strongly with the respective viral loads (r = 0.75, R2 = 0.57; p < 0.0001). However, three specimens with low viral loads (≤ 31,400 c/mL) were not identified as p24CA-positive.

Assay performance in specimens from chronically infected patients and uninfected control individuals

All specimens (7/7) from patients chronically infected with either HIV-1 subtype B or CRF01_AE were strong reactive in both versions of the Alere RDT (Table 3) with only HIV-1-specific antibodies being detected. In contrast, the p24CA-EIA scored positive for 2/7 samples. The 4G-EIA was highly reactive for all specimens in this group. 100% (11/11) of the specimens from chronically HIV-2-infected patients were reactive in the new version of the RDT (10/11 with strong reactivity, Table 4). All assays evaluated in this study were non-reactive for plasma specimen from uninfected individuals (Table 5).

Table 3 Detection of chronic HIV-1 infection by the old and new versions of the Alere RDT in plasma specimens from HIV-1-infected patients compared to quantitative PCR, 4G-EIA, and p24 Ag assay
Table 4 Detection of chronic HIV-2 infection in PCR-reactive plasma specimens by the new version of the Alere RDT
Table 5 Specificity validation of the old and new versions of the Alere RDT, quantitative PCR, 4G-EIA, and p24CA-EIA using plasma specimens from HIV-negative individuals

Analytical sensitivity of the RDTs to detect p24CA

We used a well-characterized p24CA antigen standard to evaluate the analytical sensitivity of the two versions of the Alere RDT to detect p24 antigen and compared the performance of this assay to the INNOTEST® HIV Antigen mAb (Fujirebio, p24CA-EIA) [36]. In the first assay run in single measurement, both versions of the Determine™ HIV-1/2 Combo showed a reactivity to p24CA of ≥ 50 pg/mL (Fig. 1). In the second assay, run in duplicates, the old version of the assay was reactive only at p24CA concentrations of ≥ 100 pg/mL, whereas the novel RDT in one case had a sensitivity of ≥ 100 pg/mL, in the other ≥ 200 pg/mL p24CA. Of note, in none of the experiments these RTDs showed reactivity at 25 pg/mL, which is the p24CA sensitivity threshold in serum samples stated by the manufacturer [37]. All dilutions of the p24CA standard were in parallel subjected to testing in the p24CA-EIA. This assay showed a sensitivity of p24CA of ≥ 6.25 pg/mL. We calculated the amount of p24CA antigen detected by the test according to the manufacturer’s recommendations. The actual p24CA concentrations determined by the p24CA-EIA correlated strongly with the calculated input p24CA of the dilutions (first experiment: r = 0.90; R2 = 0.81; p = 0.0023, second experiment: r = 0.93; R2 = 0.87; p = 0.0007).

Fig. 1
figure1

Comparative sensitivity evaluation of the old and new versions of the Alere RDT and p24CA-EIA to detect p24CA antigen. A well-characterized p24CA protein standard was used to assess the analytical sensitivity of the RDTs [32]. In parallel, reactivity of the samples was measured using the INNOTEST® HIV Antigen mAb (p24CA-EIA). Two independent sets of dilutions of the highly purified p24CA stock were prepared and run in two independent assays. The first assay constituted a single measurement (results shown in blue). The second assay was run in duplicate for the RDTs and in triplicate for the p24CA-EIA (technical replicates, results shown in green, depicted are means and SD). N/A not acquired

Assay performance for HIV-1 transmitted/founder viruses

The new version of the Alere RDT detected the capsid antigen of all (8/8) clade B HIV-1 T/F viruses tested at p24CA concentrations ranging from 220 to 450 pg/ml (Table 6). However, a tenfold dilution, still at or above the test’s sensitivity according to the manufacturer, rendered all samples negative. The other virological and diagnostic tests, SG-PERT, TZM-bl infectivity assay and p24CA-EIA, successfully detected virus in all samples. As a reference, cell culture supernatants from HEK293T as well as SupT1 cells were used as negative controls, and were non-reactive when applied to the new Determine™ HIV-1/2 Combo.

Table 6 Detection of HIV-1 transmitted founder virus strains from concentrated cell culture supernatants by the new version of the Alere RDT compared to SG-PERT, TZM-bl X-gal infectivity assay, and p24 Ag test

Assay performance for HIV-2 viruses

HIV-2 p27 capsid antigens in samples from four HIV-2 strains and two HIV-2 primary isolates from groups A and B were not detected by the new Alere RDT (0/6 reactive, Table 7).

Table 7 Lack of detection of four HIV-2 strains and two HIV-2 primary isolates by the new Alere RDT compared to quantitative PCR

Discussion

To our knowledge, this is the first study to analyze the performance of the novel and old RDT versions of the Determine™ HIV-1/2 Combo to detect acute (including T/F viruses) and chronic HIV infection in comparison with results from 4G-EIA, p24CA-EIA, immunoblotting, and quantitative nucleic acid amplification. Furthermore, we investigated the capabilities of the new RDT to detect chronic HIV-2 infection as well as p27CA from several HIV-2 strains and primary isolates.

The old version of the RDT reacted to only 25% (4/16) of the specimens from acutely infected, treatment-naïve, immunoblot-negative patients in Fiebig stages II–III. In only 18.8% (3/16) of the samples in this group, the old RDT identified the presence of HIV-1 p24CA. Even though the size of our cohort was limited, these data are in accordance with the results from other studies that reported poor HIV-1 p24CA sensitivity for the old RDT, ranging from 10.1 to 65.4% [22, 24, 26, 28]. Two studies conducted in sub-Saharan Africa concluded that the old version of the RDT had 0% sensitivity in specimens from acutely infected patients [44, 45]. In comparison, in our study, the novel version of the Determine™ HIV-1/2 Combo reacted to 77.3% (17/22) of the serum samples from patients in Fiebig stages II–III. This test identified the presence of p24CA in 63.6% (14/22) of the specimens from this study group. These results indicate an increased sensitivity of the new version of the RDT for detecting early HIV-1 infection prior to seroconversion. Several studies that have recently investigated the performance of the new RDT to detect infection in p24CA-positive, immunoblot-negative serum samples showed lower reactivity rates (< 30%) [30, 33], while other groups demonstrated higher reactivity rates of more than 85% in similar specimens [29, 31, 32].

All specimens from acutely HIV-1-infected, treatment-naïve, immunoblot-indeterminate/positive patients (Fiebig stages IV–VI) scored positive in both versions of the Determine™ HIV-1/2 Combo, confirming the high sensitivity of this type of RDT to detect HIV-1 infection in acute infection during or after seroconversion [29,30,31]. Of note, the novel RDT failed to detect HIV-1-specific antibodies in one specimen from an HIV-1 subtype C-infected patient in Fiebig stage IV. The performance of the Alere RDT to detect HIV-1 subtype C-specific antibodies in seroconverters should be studied more extensively in the future. Of note, cross-sectional data from patients with chronic HIV-1 infection in Malawi and Swaziland indicate that the Alere RDT has high sensitivity for detecting HIV-1-specific antibodies in sera from these predominantly subtype C-infected individuals [44, 45]. However, a comparison of RDT test results with immunoblot analyses and HIV-1 subtyping is missing in these studies and little is known about the performance of the RDT for detecting antibodies in immunoblot-indeterminate specimens from acutely HIV-1 subtype C-infected patients.

Of particular interest, the new version of the RDT showed HIV-1 antibody reactivity in 8/23 (34.8%) specimens from acutely infected, still immunoblot-negative patients (Fiebig stages I–III). These results indicate higher sensitivity for HIV-1-specific antibodies compared to the frequently used New LAV Blot I Assay and the INNO-LIA HIV I/II Score. This RDT may thus potentially be capable of detecting seroconversion in acute infection earlier than standard immunoblot assays, in line with recent reports [26, 46]. The old version of the RDT was reactive to HIV-specific antibodies in only 1/16 (6.3%) specimens from acutely infected seronegative patients.

Specimens from chronic HIV-1-infected patients were antibody-reactive in both versions of the Alere RDT (7/7 positive). In addition, we evaluated the performance of the novel RDT to detect chronic HIV-2 infection. Also here, the test reliably detected HIV-specific antibodies (11/11). Neither the new nor the old Determine™ HIV-1/2 Combo reacted to serum samples from uninfected individuals, underlining the already described low false positive rate of this assay [30,31,32].

Next, we wanted to determine the specificity of the new Alere RDT to detect p24CA antigen from clade B HIV-1 T/F viruses, originally created using viral consensus sequences from recently infected patients [34]. These strains likely resemble the genotype and phenotype of the earliest stages of HIV-1 infection better than classical laboratory strains, the latter, in specific cases, were shown to have altered capsid stability and function [47]. The capsid antigen of all T/F viruses tested (8/8) was detected by the novel RDT. However, this required p24CA concentrations ~ 10- to 20-fold higher than suggested by the test manufacturer, again raising concerns about the sensitivity of this assay component.

Due to its structural similarity to HIV-1 p24CA, HIV-2 capsid antigen can occasionally be detected by some 4G-EIAs, albeit with reduced sensitivity [48, 49]. In the current study, the new Determine™ HIV-1/2 Combo was not reactive with any of the six HIV-2 viruses tested at high viral titers, suggesting that it would be incapable of detecting acute HIV-2 infections prior to seroconversion.

The analytic sensitivity of the Determine™ HIV-1/2 Combo to detect HIV-1 p24CA antigen in serum is stated by the company to be at least 25 pg/mL [37]. In our experiments, both versions of the RDT assay failed to detect a well-characterized, highly purified p24CA antigen standard from a clade B virus strain at these concentrations [36], reaching sensitivities of only ≥ 50 pg/mL (first experiment) or even ≥ 100 pg/mL (second experiment). In one case, the novel version of the Alere RDT was reactive only at p24CA levels ≥ 200 pg/mL. In contrast, the quantitative p24CA-EIA used in this study detected the p24CA standard at concentrations ≥ 6.25 pg/mL illustrating the higher sensitivity of this type of antigen assay compared to current RDTs. Furthermore, we observed a correlation between the concentrations of p24 antigen measured by the p24CA-EIA and those that were prepared for the experiments indicating the capability of this assay to faithfully estimate the concentrations of HIV-1 p24CA antigen also in patient sera (Fig. 1). In line with the reduced sensitivity of the RDT assay for recombinant capsid antigen, detection of several clade B T/F viruses also required considerably higher p24CA antigen concentrations to score positive in the novel test version (Table 6).

The p24CA-EIA was reactive in all specimens from acutely infected, still non-seroconverted patients tested in Fiebig stages II–III. In serum samples from this study group, both versions of the Determine™ HIV-1/2 Combo were negative at p24CA concentrations ≤ 315 pg/mL. Moreover, the RDTs failed to detect the structural viral antigen also in several samples with higher p24CA concentrations (Table 1).

For acutely infected, immunoblot-indeterminate/positive specimens (Fiebig stages IV–VI), the p24CA-EIA was reactive in 23/27 (85.2%) cases. The old version of the RDT did not show reactivity to p24CA in this study group, even though 4/8 samples tested with this assay had estimated p24CA concentrations of ≥ 529 pg/mL. The new RDT detected the HIV-1 capsid antigen in 10/27 (37%) of all specimens, but all antigen-reactive specimens had estimated p24CA concentrations of ≥ 485 pg/mL. Taken together, these results strongly suggest that the sensitivity of the Determine™ HIV-1/2 Combo to detect HIV-1 p24CA antigen is considerably lower, in some cases more than 20-fold, than specified by the manufacturer [37].

The HIV-1 patient specimens evaluated in this study are mostly from subtype B, but also include the subtypes A1, C, CRF01_AE, CRF02_AG, F and URF. For future studies, it would be valuable to evaluate the performance of the RDTs with an even more diverse panel of HIV-1 specimens, especially since the old version of the RDT was shown to have impaired sensitivity to capsid antigen from non-B subtype HIV-1 [24].

Patient specimens from all HIV-1 study groups that showed positive nucleic acid amplification (except for the one Fiebig I sample) and/or positive HIV-1 immunoblot results were also reactive in the 4G-EIA, confirming that this assay has a high sensitivity to detect HIV-1 infections in plasma samples from both early acutely infected and chronically infected patients.

In samples from acutely infected patients (prior to or post-seroconversion), a larger fraction of strong reactive test results were observed using the new RDT compared to the old version of the test (Tables 1 and 2). As a consequence, positive results may be easier to spot with the new version of this rapid test, which is especially important for untrained users and self-testers.

In our study, both versions of the Determine™ HIV-1/2 Combo proved to be reactive to HIV-1-specific antibodies from several HIV-1 subtypes. Furthermore, the new RDT was reactive to antibodies from patients with HIV-2 groups A and B infection. Thus, this assay might pose a viable alternative to screen for chronic as well as acute HIV-1 and HIV-2 infections after or during seroconversion, with several advantages to other non-RDT assays, including fast turn-around times and independence from professional laboratories with trained personnel. However, even though the novel version of the RDT seems to have an improved capacity to detect also HIV-1 p24CA antigen compared to the old one, its sensitivity is markedly lower compared to p24CA-EIAs or 4G-EIAs. Moreover, based on the lack of detection of 6 HIV-2 viruses, the Determine™ HIV-1/2 Combo is likely unable to detect acute HIV-2 infection prior to seroconversion.

Taken together, the p24CA-EIA and 4G-EIA test systems should still be considered assays of choice to reliably screen for acute HIV infection. Even though the new version of the RDT shows enhanced performance, the manufacturer still needs to improve the sensitivity and likely also clade diversity of the Determine™ HIV-1/2 Combo for p24CA, to make this RDT a viable alternative to established laboratory tests for detecting acute HIV infection in immunoblot-negative patients.

References

  1. 1.

    UNAIDS (2016) Global AIDS Update 2016. http://www.unaids.org/en/resources/documents/2016/Global-AIDS-update-2016. Accessed 15 Dec 2019

  2. 2.

    WHO (2016) Global Health Sector Strategy on HIV, 2016–2021. http://www.who.int/hiv/strategy2016-2021/ghss-hiv/en/. Accessed 15 Dec 2019

  3. 3.

    Chu C, Selwyn PA (2010) Diagnosis and initial management of acute HIV infection. Am Fam Physician. 81:1239–1244

  4. 4.

    Pilcher CD, Joaki G, Hoffman IF, Martinson FE, Mapanje C, Stewart PW et al (2007) Amplified transmission of HIV-1: comparison of HIV-1 concentrations in semen and blood during acute and chronic infection. AIDS 21:1723–1730

  5. 5.

    Hollingsworth TD, Anderson RM, Fraser C (2008) HIV-1 transmission, by stage of infection. J Infect Dis 198:687–693

  6. 6.

    Le T, Wright EJ, Smith DM, He W, Catano G, Okulicz JF et al (2013) Enhanced CD4 + T-cell recovery with earlier HIV-1 antiretroviral therapy. N Engl J Med 368:218–230

  7. 7.

    Guillou-Guillemette HL, Renier G, Vielle B, Abgueguen P, Chennebault J-M, Lunel F et al (2006) Immune restoration under HAART in patients chronically infected with HIV-1: diversity of T, B, and NK immune responses. Viral Immunol 19:267–276

  8. 8.

    Baum PD, Young JJ, Schmidt D, Zhang Q, Hoh R, Busch M et al (2012) Blood T-cell receptor diversity decreases during the course of HIV infection, but the potential for a diverse repertoire persists. Blood 119:3469–3477

  9. 9.

    Buzon MJ, Martin-Gayo E, Pereyra F, Ouyang Z, Sun H, Li JZ et al (2014) Long-term antiretroviral treatment initiated at primary HIV-1 infection affects the size, composition, and decay kinetics of the reservoir of HIV-1-infected CD4 T cells. J Virol 88:10056–10065

  10. 10.

    Depincé-Berger A-E, Vergnon-Miszczycha D, Girard A, Frésard A, Botelho-Nevers E, Lambert C et al (2016) Major influence of CD4 count at the initiation of cART on viral and immunological reservoir constitution in HIV-1 infected patients. Retrovirology 13:44

  11. 11.

    Sáez-Cirión A, Bacchus C, Hocqueloux L, Avettand-Fenoel V, Girault I, Lecuroux C et al (2013) Post-treatment HIV-1 controllers with a long-term virological remission after the interruption of early initiated antiretroviral therapy ANRS VISCONTI study. PLoS Pathog 9:e1003211

  12. 12.

    CDC (2014) National HIV testing day and new testing recommendations. Morb Mortal Wkly Rep 63:537

  13. 13.

    WHO (2015) Consolidated guidelines on HIV testing services. ISBN 978 92 4 150892 6. http://who.int/hiv/pub/guidelines/hiv-testing-services/en/. Accessed 15 Dec 2019

  14. 14.

    Qiu X, Sokoll L, Yip P, Elliott DJ, Dua R, Mohr P et al (2017) Comparative evaluation of three FDA-approved HIV Ag/Ab combination tests using a genetically diverse HIV panel and diagnostic specimens. J Clin Virol 92:62–68

  15. 15.

    Vallefuoco L, Mazzarella C, Portella G (2016) Fourth generation assays for HIV testing. Expert Rev Mol Diagn 16:723–732

  16. 16.

    Fiebig EW, Wright DJ, Rawal BD, Garrett PE, Schumacher RT, Peddada L et al (2003) Dynamics of HIV viremia and antibody seroconversion in plasma donors: implications for diagnosis and staging of primary HIV infection. AIDS 17:1871–1879

  17. 17.

    Owen SM, Yang C, Spira T, Ou CY, Pau CP, Parekh BS et al (2008) Alternative algorithms for human immunodeficiency virus infection diagnosis using tests that are licensed in the United States. J Clin Microbiol 46:1588–1595

  18. 18.

    Wesolowski LG, Nasrullah M, Coombs RW, Rosenberg E, Ethridge SF, Hutchinson AB et al (2016) Acute infections, cost per infection and turnaround time in three united states hospital laboratories using fourth-generation antigen-antibody human immunodeficiency virus immunoassays. Open Forum Infect Dis 3:ofv188

  19. 19.

    Figueroa C, Johnson C, Ford N, Sands A, Dalal S, Meurant R et al (2018) Reliability of HIV rapid diagnostic tests for self-testing compared with testing by health-care workers: a systematic review and meta-analysis. Lancet HIV 5:e277–e290

  20. 20.

    Demorat H, Lopes A, Chopin D, Delcey V, Clevenbergh P, Simoneau G et al (2018) Acceptability and feasibility of HIV testing in general medicine by ELISA or rapid test from finger-stick whole blood. La Presse Médicale 47:e15–e23

  21. 21.

    Delaugerre C, Antoni G, Mahjoub N, Pialoux G, Cua E, Pasquet A et al (2017) Assessment of HIV screening tests for use in preexposure prophylaxis programs. J Infect Dis 216:382–386

  22. 22.

    Kilembe W, Keeling M, Karita E, Lakhi S, Chetty P, Price MA et al (2012) Failure of a novel, rapid antigen and antibody combination test to detect antigen-positive HIV infection in African adults with early HIV infection. PLoS One 7:e37154

  23. 23.

    Conway DP, Holt M, McNulty A, Couldwell DL, Smith DE, Davies SC et al (2014) Multi-centre evaluation of the determine HIV combo assay when used for point of care testing in a high risk clinic-based population. PLoS One 9:e94062

  24. 24.

    Vetter BN, Orlowski V, Fransen K, Niederhauser C, Aubert V, Brandenberger M et al (2014) Generation of a recombinant gag virus-like-particle panel for the evaluation of p24 antigen detection by diagnostic HIV tests. PLoS One 9:e111552

  25. 25.

    Faraoni S, Rocchetti A, Gotta F, Ruggiero T, Orofino G, Bonora S et al (2013) Evaluation of a rapid antigen and antibody combination test in acute HIV infection. J Clin Virol 57:84–87

  26. 26.

    Fox J, Dunn H, Shea S (2011) Low rates of p24 antigen detection using a fourth-generation point of care HIV test. Sex Transm Infect 87:178

  27. 27.

    Laperche S, Leballais L, Ly TD, Plantier JC (2012) Failures in the detection of HIV p24 antigen with the determine HIV-1/2 Ag/Ab Combo rapid test. J Infect Dis 206:1946–1947

  28. 28.

    Chetty V, Moodley D, Chuturgoon A (2012) Evaluation of a 4th generation rapid HIV test for earlier and reliable detection of HIV infection in pregnancy. J Clin Virol 54:180–184

  29. 29.

    Stafylis C, Klausner JD (2017) Evaluation of two 4th generation point-of-care assays for the detection of human immunodeficiency virus infection. PLoS One 12:e0183944

  30. 30.

    Masciotra S, Luo W, Youngpairoj AS, Kennedy MS, Wells S, Ambrose K et al (2013) Performance of the Alere Determine™ HIV-1/2 Ag/Ab Combo Rapid Test with specimens from HIV-1 seroconverters from the US and HIV-2 infected individuals from Ivory Coast. J Clin Virol 58:e54–e58

  31. 31.

    Ottiger CHR (2015) Comparison of the New Alere HIV Combe with Alere Determine HIV 1/2 Combo in acute primo and established HIV infections. Ann Clin Lab Res 3:22

  32. 32.

    Fitzgerald N, Cross M, Shea S, Fox J (2017) Diagnosing acute HIV infection at point of care: a retrospective analysis of the sensitivity and specificity of a fourth-generation point-of-care test for detection of HIV core protein p24. Sex Transm Infect 93:100

  33. 33.

    Livant E, Heaps A, Kelly C, Maharaj R, Samsunder N, Nhlangulela L et al (2017) The fourth generation Alere < sup > TM </sup > HIV Combo rapid test improves detection of acute infection in MTN-003 (VOICE) samples. J Clin Virol 94:15–21

  34. 34.

    Ochsenbauer C, Edmonds TG, Ding H, Keele BF, Decker J, Salazar MG et al (2012) Generation of transmitted/founder HIV-1 infectious molecular clones and characterization of their replication capacity in CD4 T lymphocytes and monocyte-derived macrophages. J Virol 86:2715–2728

  35. 35.

    Parrish NF, Gao F, Li H, Giorgi EE, Barbian HJ, Parrish EH et al (2013) Phenotypic properties of transmitted founder HIV-1. Proc Natl Acad Sci 110:6626–6633

  36. 36.

    Gross I, Hohenberg H, Wilk T, Wiegers K, Grättinger M, Müller B et al (2000) A conformational switch controlling HIV-1 morphogenesis. EMBO J 19:103–113

  37. 37.

    Alere Medical Co. (2016) Determine™ HIV-1/2 Combo Package insert

  38. 38.

    Dong KL, Moodley A, Kwon DS, Ghebremichael MS, Dong M, Ismail N et al (2018) Detection and treatment of Fiebig stage I HIV-1 infection in young at-risk women in South Africa: a prospective cohort study. Lancet HIV 5:e35–e44

  39. 39.

    Däumer M, Kaiser R (2003) Genotypische Resistenztestung. Oette, Kaiser, Häusinger: Resistenz in der HIV Therapie—Diagnostik und Management (ISSN: 3-89599-736-6)

  40. 40.

    Struck D, Lawyer G, Ternes A-M, Schmit J-C, Bercoff DP (2014) COMET: adaptive context-based modeling for ultrafast HIV-1 subtype identification. Nucleic Acids Res 42:e144

  41. 41.

    Pizzato M, Erlwein O, Bonsall D, Kaye S, Muir D, McClure MO (2009) A one-step SYBR Green I-based product-enhanced reverse transcriptase assay for the quantitation of retroviruses in cell culture supernatants. J Virol Methods 156:1–7

  42. 42.

    Wei X, Decker JM, Liu H, Zhang Z, Arani RB, Kilby JM et al (2002) Emergence of resistant human immunodeficiency virus type 1 in patients receiving fusion inhibitor (T-20) monotherapy. Antimicrob Agents Chemother 46:1896–1905

  43. 43.

    Xing L, Wang S, Hu Q, Li J, Zeng Y (2016) Comparison of three quantification methods for the TZM-bl pseudovirus assay for screening of anti-HIV-1 agents. J Virol Methods 233:56–61

  44. 44.

    Rosenberg NE, Kamanga G, Phiri S, Nsona D, Pettifor A, Rutstein SE et al (2011) Detection of acute HIV infection: a field evaluation of the Determine® HIV-1/2 Ag/Ab Combo Test. J Infect Dis 205:528–534

  45. 45.

    Duong YT, Mavengere Y, Patel H, Moore C, Manjengwa J, Sibandze D et al (2014) Poor performance of the determine HIV-1/2 Ag/Ab Combo fourth-generation rapid test for detection of acute Infections in a National Household Survey in Swaziland. J Clin Microbiol 52:3743–3748

  46. 46.

    van Tienen C, Rugebregt S, Scherbeijn S, Götz H, GeurtsvanKessel C (2017) The performance of the Alere HIV combo point-of-care test on stored serum samples; useful for detection of early HIV-1 infections? Sex Transm Infect 94:331–333

  47. 47.

    Siddiqui MA, Saito A, Halambage UD, Ferhadian D, Fischer DK, Francis AC et al (2019) A novel phenotype links HIV-1 capsid stability to cGAS-mediated DNA sensing. J Virol 93:e00706–e00719

  48. 48.

    Ly TD, Plantier JC, Leballais L, Gonzalo S, Lemée V, Laperche S (2012) The variable sensitivity of HIV Ag/Ab combination assays in the detection of p24Ag according to genotype could compromise the diagnosis of early HIV infection. J Clin Virol 55:121–127

  49. 49.

    ECBS Report Reference: WHO/BS/2018.2334 (2018) Geneva

Download references

Acknowledgements

Open Access funding provided by Projekt DEAL. We thank Cornelia Rühl for technical assistance. We are grateful to Hans-Georg Kräusslich and Bärbel Glass for purified p24CA standard. This study was supported by intramural funding from the Institute of Medical Virology, University Hospital Frankfurt, the Max von Pettenkofer Institute, LMU München, and the German Federal Ministry of Health supporting the National Reference Center for Retroviruses. P.R. Wratil is a MD/PhD stipendiary of the German Center for Infection Research (DZIF).

Author information

HR and OTK designed the study; PRW, HR, JE, MS, MM, MS, AB and OTK analyzed data; HR, SK-M, DM, AL, KM and NB provided characterized specimen and discussion; PRW, HR and OTK wrote the paper and all authors provided input and approved the final manuscript.

Correspondence to Holger F. Rabenau or Oliver T. Keppler.

Ethics declarations

Conflict of interest

The authors declare that they have no conflict of interest.

Ethical approval

Ethical approval was not required because all samples used were residual samples from individuals who had consented for an HIV test. Samples were identified in the laboratory and assigned a number without reference to patient or clinical details. Results from testing using the study assays did not impact on clinical care.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Edited by Matthias J. Reddehase.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.

Reprints and Permissions

About this article

Verify currency and authenticity via CrossMark

Cite this article

Wratil, P.R., Rabenau, H.F., Eberle, J. et al. Comparative multi-assay evaluation of Determine™ HIV-1/2 Ag/Ab Combo rapid diagnostic tests in acute and chronic HIV infection. Med Microbiol Immunol (2020). https://doi.org/10.1007/s00430-019-00655-0

Download citation

Keywords

  • Rapid diagnostic test
  • HIV
  • Seroconverter
  • Acute HIV infection