# Dynamic association rules for gene expression data analysis

- 2k Downloads
- 5 Citations

**Part of the following topical collections:**

## Abstract

### Background

The purpose of gene expression analysis is to look for the association between regulation of gene expression levels and phenotypic variations. This association based on gene expression profile has been used to determine whether the induction/repression of genes correspond to phenotypic variations including cell regulations, clinical diagnoses and drug development. Statistical analyses on microarray data have been developed to resolve gene selection issue. However, these methods do not inform us of causality between genes and phenotypes. In this paper, we propose the dynamic association rule algorithm (DAR algorithm) which helps ones to efficiently select a subset of significant genes for subsequent analysis. The DAR algorithm is based on association rules from market basket analysis in marketing. We first propose a statistical way, based on constructing a one-sided confidence interval and hypothesis testing, to determine if an association rule is meaningful. Based on the proposed statistical method, we then developed the DAR algorithm for gene expression data analysis. The method was applied to analyze four microarray datasets and one Next Generation Sequencing (NGS) dataset: the Mice Apo A1 dataset, the whole genome expression dataset of mouse embryonic stem cells, expression profiling of the bone marrow of Leukemia patients, Microarray Quality Control (MAQC) data set and the RNA-seq dataset of a mouse genomic imprinting study. A comparison of the proposed method with the *t*-test on the expression profiling of the bone marrow of Leukemia patients was conducted.

### Results

We developed a statistical way, based on the concept of confidence interval, to determine the minimum support and minimum confidence for mining association relationships among items. With the minimum support and minimum confidence, one can find significant rules in one single step. The DAR algorithm was then developed for gene expression data analysis. Four gene expression datasets showed that the proposed DAR algorithm not only was able to identify a set of differentially expressed genes that largely agreed with that of other methods, but also provided an efficient and accurate way to find influential genes of a disease.

### Conclusions

In the paper, the well-established association rule mining technique from marketing has been successfully modified to determine the minimum support and minimum confidence based on the concept of confidence interval and hypothesis testing. It can be applied to gene expression data to mine significant association rules between gene regulation and phenotype. The proposed DAR algorithm provides an efficient way to find influential genes that underlie the phenotypic variance.

### Keywords

Association rules Gene expression data Bioinformatics Data mining Transcriptome analysis### Abbreviations

- DAR
Dynamic association rule

- NGS
Next generation sequencing

- MAQC
Microarray quality control

- RPKM
Reads Per Kilobase per Million mapped reads

- FPKM
Fragments Per Kilobase per Million mapped fragments

- HDL
High-density lipoprotein

- ESC
Embryonic stem cells

- Apo A1
Apolipoprotein A1

- ESTs
Expressed Sequence Tags

- SC5D
Sterol C5 desaturase

- SPATA5L1
Spermatogenesis associated 5-like 1

- CASP6
Caspase 6

- oxLDLs
Oxidized LDLs

- DTNBP1
Dystrobrevin binding protein 1

- DPC
Dystrophin-associated protein complex

- BLOC-1
Lysosome-related organelles complex 1

- MAK
Male germ cell-associated kinase

- mESC
Mouse ESC

- Oct4+
Oct4 positive

- Oct4-
Low Oct4 expression

- RA
Retinoic acid

- ALL
Acute lymphoblastic leukemia

- AML
Acute myeloid leukemia

- TSD
Transitional State Discrimination

- GO
Gene Ontology

- PGCs
Primordial germ cells

- FC
Fold-change

- UHRR
Universal Human Reference RNA

- HBRR
Human Brain Reference RNA

- FDR
False discovery rate

- ABI
Applied Biosystems

- AFX
Affymetrix

- AG1
Agilent Technologies for one-color array

- GEH
GE Healthcare

- ILM
Illumina

- WAD
Weighted average difference

- AD
Average difference

- RP
Rank product

- modT
Moderated t statistic

- shrT
Shrinkage t statistic

- ibmT
Intensitybased moderated t statistic

## Background

Applications of the association rule have been made across multidisciplinary fields [1, 2]. In biological sciences, it has been applied to analyze gene expression data. For example, Becquet et al. [3] developed the Min-Ex algorithm which applied on human SAGE data. This algorithm can be used for mining rules in dense boolean matrices to eliminate redundant association rules. Since explore association rules is a huge computational work when boolean matrices is large, their algorithm also efficiently reduces the size of the search space. Creighton and Hanash [4] implemented a database application with the Apriori algorithm [5] which is often used to explore association rules. They applied this algorithm to mine association between genes. These two examples could identify rules that contained a set of proteins with potential interactions. Park et al. [6] applied fuzzy association rule mining techniques to handle continuous numerical values in time series microarray data. It successfully discovered several gene expression patterns over times that were supported by yeast cell cycle data.

The goal of association rules mining is to establish the relationship between a set of input variables and a set of output variables. Some packages have been developed for computational purpose. For example, Hahsler et al. [7] developed an R package, called ‘arules’, to manipulate input data sets and analyze the resultant item sets and rules. Palanisamy [8] modified a well-known association rule mining algorithm, Apriori, to deal with input constraints. Two important indices for an association rule are *support* and *confidence*. For any association rule to be meaningful, it is critical to have sufficiently high values of support and confidence.

In data mining, currently the thresholds for the support and the confidence are set arbitrarily by users, so that different sets of support and confidence will lead to different results. Users have to try different settings in order to have a better result. Therefore, the results are difficult to interpret. How to determine the thresholds remains an important issue in association rules mining.

In this paper, we propose a statistical way based on the concept of confidence interval and hypothesis testing to determine the minimum support and the minimum confidence for an association rule. We also show how to estimate the minimal support and the minimal confidence for a given set of data. A rule is meaningful only if the support and the confidence are both significantly greater than the minimal thresholds. We then apply the method to gene expression data analysis.

Gene expression analysis is a common way to characterize gene expression profiles and to identify a specific expression profile(s) associated with a disease or trait. DNA microarrays were commonly used in gene expression analysis before the Next Generation Sequencing era. A DNA microarray is a collection of DNA probes which are orderly attached on a solid surface [9]. Each probe represents a detector for a gene with a distinct sequence. Therefore, a whole-genome expression microarray can measure the expression level of every gene on the chip at once [10]. The Next Generation Sequencing (NGS) technology has advanced rapidly since the first RNA-seq paper was published in 2006 [11] and has almost completely replaced the microarray approach. Instead of studying expression profiles by hybridizing with known probes on microarrays, one can acquire the actual RNA sequences expressed in cells using a NGS platform [12, 13]. For RNA-seq data, the expression level of a gene can be expressed in terms of Reads Per Kilobase per Million mapped reads (RPKM) [12] or Fragments Per Kilobase per Million mapped fragments (FPKM) [14]. To take account of differences in the coverage/depth of reads in different samples or experiments, normalization and bias correction methods have been developed [15]. The differential expression of a gene between experimental conditions could then be assessed using statistical tests, e.g., the t-statistics or the likelihood ratio test based on a generalized linear model.

*dynamic association rule algorithm*(described in Fig. 3), called DAR algorithm, which preserves the causality of genes and symptoms.

This rule indicates that if gene A is over-expressed, labeled as +1geneA, then it implies a disease group. Here “imply” means “causation”. It gives us information in biological sense. Support and confidence are used to measure the strength of an association rule. Here support measures the joint probability of +1geneA and the phenotype, while confidence measures the conditional probability of observing the phenotype given +1geneA.

Second, we apply the minimum support and minimum confidence concept to find “significant rules”.

Third, we screen out those impossible (ambiguous) rules. For example, if both rules, “-1geneA, 1gene B → disease group” and “-1geneA, 1gene B → non disease group”, are significant, we consider them *ambiguous rules* because the two rules are conflicting.

Finally, we construct the final rules and determine the final significant genes

With the proposed DAR algorithm, we can find a set of genes that are related to the phenotypic difference between groups. We demonstrate the approach using microarray datasets for High-density lipoprotein (HDL)-Deficient mice [19], mouse embryonic stem cells (ESC) [20], and the bone marrow of Leukemia patients [21], and the RNA-seq data from a mouse genomic imprinting study [22]. In all four applications, our proposed method can capture the influential genes and the underlying biological functions known in literature, and can provide additional influential genes that other methods failed to identify. In addition, a comparison with *t*-test is made, using the expression data from the bone marrow of Leukemia patients [21].

## Methods

### Model

Let I = (i_{1}, …, i_{k}) be a set of k elements, called items. A basket dataset B = (b_{1}, …, b_{n}) is any collection of n subsets of I and each subset b_{i} ⊆ I is called a basket of items. Given support s and confidence c, we say there is an established association rule [2]

A (called antecedent) → B (called consequent) if

a. A and B occur together in at least s · 100 % of the n baskets.

b. Among those baskets containing A, at least c · 100 % also contain B.

_{A}be the total number of items in A, and n

_{AB}be the total number of items in both A and B. Then numerically the support and the conference are estimated as follows:

Currently, the thresholds of the support and the confidence are set arbitrarily by users and it is very difficult to interpret the result. If the thresholds of the support and the confidence are set too low, many rules will be established. On the other hand, if the thresholds are set too high, no rules may be established. Therefore, how to determine the thresholds of the support and the confidence becomes an important issue in the study of the association rules mining. The idea behind our proposed algorithm is as follows. When the antecedent follows a specific distribution, we can first compute the distributions of the support and the confidence, and then determine the thresholds of the support and the confidence by the concept of confidence interval. All rules have to meet the minimal support and the minimal confidence in order to be meaningful.

_{A}~ Bernoulli (p

_{1}) and I

_{B}~ Bernoulli (p

_{2}). Under the independence assumption, we have the indicator function I

_{AB}~ Bernoulli (p

_{1· }p

_{2}

_{.}). Let n, n

_{A}, n

_{B}and n

_{AB}be the total number of items in the population, the total number of items in A, the total number of items in B, and the total number of items in both A and B, respectively. We can derive the distribution of the support (s) as follows.

Here Bin(n, p_{12}) stands for the Binomial distribution with parameters n and p_{12}, and \( \mathrm{N}\left({\mathrm{np}}_{12},\ \sqrt{{\mathrm{np}}_{12}\left(1-{\mathrm{p}}_{12}\right)}\right) \) stands for the Normal distribution with mean np_{12} and standard deviation \( \sqrt{{\mathrm{np}}_{12}\left(1-{\mathrm{p}}_{12}\right)} \). Note that, such an approximation is in general appropriate because we are dealing with a large n (even though p may be small). See, for example, Arnold (1990, p. 143) [23]. Therefore, the theoretical minimal support under the assumption of independence (p_{12} = p_{1} · p_{2}) is its (1 − α) · 100 % upper bound, with α being the statistical significant level.

For the distribution of confidence, suppose X is the number of A ∩ B, then X ∼ Bin (n, p_{12}), which is the Binomial distribution with parameters n and p_{12}. Let Z be the number of A, then Z ∼ Bin (n, p_{1}). The confidence, c, then becomes C = X/Z. Technically, C is a defective random variable, as the event Z = 0 is ignored here. Because the probability P (Z = 0) is rather small, the truncated distribution is nearly identical to the un-truncated distribution. It is known that the distribution of X given Z = z is a Binomial distribution with parameters z and p_{2|1}, where p_{2|1} is the conditional probability of B given A.

_{2}) = \( \left(\begin{array}{c}\hfill \mathrm{z}\hfill \\ {}\hfill \mathrm{c}\mathrm{z}\hfill \end{array}\right){\mathrm{p}}_2^{\mathrm{cz}}{\left(1-{\mathrm{p}}_2\right)}^{\mathrm{z}-\mathrm{c}\mathrm{z}} \) and Bin (n, z, p

_{1}) = \( \left(\begin{array}{c}\hfill \mathrm{n}\hfill \\ {}\hfill \mathrm{z}\hfill \end{array}\right){\mathrm{p}}_1^{\mathrm{z}}{\left(1-{\mathrm{p}}_1\right)}^{\mathrm{n}-\mathrm{z}} \).

Unlike the distribution for the support, the minimum confidence does not have a direct formula like (1); however, numerical results are always possible and will be illustrated below.

_{1}= (0.1, 0.3, 0.5, 0.7, 0.9) and p

_{2}= (0.1, 0.3, 0.5, 0.7, 0.9) when

*n*= 50. It is clear that the distribution is symmetric in p

_{1}. That is, given a fixed p

_{1=}p

_{0}, the distribution of the confidence when p

_{2}= p

^{*}is the same with the distribution of (1-confidence) when p

_{2}= (1-p

^{*}). For example, as in Fig. 1, given p

_{1}= 0.1 (first row), the distribution of confidence for p

_{2}= 0.1 is identical to the distribution of confidence for p

_{2}= 0.9. Likewise, the distribution of confidence for p

_{2}= 0.3 is symmetric of confidence for p

_{2}= 0.7. Furthermore, for larger n, the distribution is approximately normal as can be seen in Fig. 2.

_{2}(1-p

_{2})E(1/Z). When n is large enough, \( Z\sim N\left(n{p}_1,\ \sqrt{n{p}_1\left(1-{p}_1\right)}\right). \) It can be shown that E(1/Z) does not exist, and thus Var (X/Z) does not exist. Therefore, we can only resolve the problem numerically. For example, the minimum confidences are tabulated in Table 1 for

*n*= 1000. For large n (>1000), the values given in Table 1 can be a good approximation.

Critical value when *n* = 1000

p | |||||||

0.1 | 0.3 | 0.5 | 0.7 | 0.9 | |||

0.1 | 80 % | 0.1245 | 0.1135 | 0.1105 | 0.1095 | 0.1075 | |

90 % | 0.1395 | 0.1225 | 0.1165 | 0.1145 | 0.1125 | ||

95 % | 0.1515 | 0.1285 | 0.1225 | 0.1185 | 0.1165 | ||

99 % | 0.1755 | 0.1415 | 0.1315 | 0.1265 | 0.1235 | ||

0.3 | 80 % | 0.3385 | 0.3215 | 0.3165 | 0.3145 | 0.3125 | |

90 % | 0.3585 | 0.3335 | 0.3255 | 0.3215 | 0.3195 | ||

95 % | 0.3755 | 0.3435 | 0.3335 | 0.3285 | 0.3245 | ||

99 % | 0.4095 | 0.3625 | 0.3475 | 0.3405 | 0.3355 | ||

p | 0.5 | 80 % | 0.5415 | 0.5235 | 0.5185 | 0.5155 | 0.5135 |

90 % | 0.5635 | 0.5365 | 0.5285 | 0.5235 | 0.5205 | ||

95 % | 0.5825 | 0.5475 | 0.5365 | 0.5305 | 0.5265 | ||

99 % | 0.6165 | 0.5665 | 0.5515 | 0.5435 | 0.5385 | ||

0.7 | 80 % | 0.7385 | 0.7215 | 0.7165 | 0.7145 | 0.7125 | |

90 % | 0.7585 | 0.7335 | 0.7255 | 0.7215 | 0.7195 | ||

95 % | 0.7745 | 0.7425 | 0.7325 | 0.7275 | 0.7245 | ||

99 % | 0.8035 | 0.7605 | 0.7465 | 0.7395 | 0.7345 | ||

0.9 | 80 % | 0.9255 | 0.9145 | 0.9105 | 0.9095 | 0.9075 | |

90 % | 0.9375 | 0.9215 | 0.9165 | 0.9135 | 0.9125 | ||

95 % | 0.9465 | 0.9275 | 0.9215 | 0.9175 | 0.9155 | ||

99 % | 0.9635 | 0.9375 | 0.9295 | 0.9255 | 0.9225 |

### Example

*n*, to verify any association rule of “if A then B”, in general, we first obtain the following estimates

*n*

_{ A }is the number of records that belongs to the Event A. Likewise,

*n*

_{ B }is the number of records that containing Event B. The minimum support is then

and the minimal confidence can be obtained from Table 1.

For example, a dataset of size *n* = 1000 with *n* _{ A } = 300 and *n* _{ B } = 700. We will have

\( {\widehat{p}}_A=\frac{300}{1000}=0.3 \) and \( {\widehat{p}}_B=\frac{700}{1000}=0.7 \).

and from Table 1, the *minimum confidence* = 0.7425.

Any association rule must beat these minimal support and minimal confidence values to be meaningful.

## Results and discussion

### Analysis of the ApoA1-knockout mice data [19]

_{2}R/G vs. A.

The second step is to discretize the data. If the normalized log value is ≧1, we label it as 1; if it is ≦ − 1, we label it as −1; and if it is between −1 and 1, we label it as 0. If the expression level is labeled as 1, we classify the gene as “over expressed” in this sample; if the expression level is labeled as −1, we classify the gene as “under expressed”; all other genes are “not differentially expressed”.

The results of the single antecedent rules mining when the DAR algorithm is applied to the data of Callow et al. [19]

Support/Confidence | Meaningful rules | Screen rules | Final genes |
---|---|---|---|

10/80 | 216 | 198 | 198 |

10/85 | 216 | 198 | 198 |

10/90 | 215 | 197 | 197 |

20/80 | 20 | 14 | 14 |

20/85 | 20 | 14 | 14 |

20/90 | 19 | 13 | 13 |

30/80 | 14 | 9 | 9 |

30/85 | 14 | 9 | 9 |

30/90 | 13 | 8 | 8 |

Dynamic Support and Confidence | 14 | 9 | 9 |

The results of the double antecedent rules mining when the DAR algorithm was applied to the data of Callow et al. [19]

Support/ Confidence | Meaningful rules | Screen rules | Final genes |
---|---|---|---|

10/80 | 1,298,658 | 23,076 | 454 |

10/85 | 1,298,224 | 23,075 | 454 |

10/90 | 1,298,010 | 23,074 | 454 |

20/80 | 120,241 | 312 | 52 |

20/85 | 119,807 | 311 | 52 |

20/90 | 113,393 | 310 | 52 |

30/80 | 83,228 | 65 | 14 |

30/85 | 82,794 | 64 | 14 |

30/90 | 76,830 | 63 | 14 |

Dynamic Support and Confidence | 82,361 | 64 | 14 |

Next, we applied our method to compute all possible rules that passed the estimated theoretical minimal support and minimal confidence. Some rules are not meaningful in biology, so we classified them as ambiguous and removed them. For example, if one rule tells us “highly expressed gene A implies disease significantly”, but another rule tells us “highly expressed gene A implies control significantly”, then they are conflicting and ambiguous for biological interpretation. We screened out such ambiguous rules.

Figure 3 shows the flowchart from normalizing the microarray data, discretizing the raw data, applying the DAR method to obtain the meaningful rules, and then screening out the ambiguous rules. The results of applying our method to the DHL-deficient mice data are given in Table 2. It shows that the number of meaningful rules changes due to the different combinations of the cutoff points of support and confidence. With the dynamic support and confidence, however, it gives the number of meaningful rules to be 14, which can be found when the cutoff points were set to be *s* = 30/*c* = 85. The number of the final significant genes is 9.

The influential genes found when the DAR algorithm was applied to the data in Callow et al. [19]

Rule type | ID | Gene | Expression level | Influential in S. Dudoit 2002 | Multiple |
---|---|---|---|---|---|

Single Antecedent | 540 | Apo AI | −1 | Yes | 4.00E−04 |

1496 | SPATA5L1 | −1 | Yes | 0.0156 | |

1739 | Apo CIII | −1 | Yes | 4.00E−04 | |

2149 | Apo AI | −1 | Yes | 4.00E−04 | |

2537 | Apo CIII | −1 | Yes | 7.00E−04 | |

4139 | SC5D | −1 | Yes | 5.00E−04 | |

4941 | SC5D | −1 | Yes | 0.0086 | |

5356 | Apo AI | −1 | Yes | 7.00E−04 | |

2296 | CASP6 | −1 | New | 0.4745 | |

Additional in Double antecedent | 5053 | BLANK | 1 | New | 1 |

5419 | DTNBP1 | 1 | New | 1 | |

6215 | MAK | 1 | New | 1 | |

6245 | BLANK | 1 | New | 1 | |

6379 | CAS1 | 1 | New | 1 |

The results of the double antecedent association rules mining can be found in Table 3. It shows that 82,361 rules had passed the threshold of the DAR algorithm. After screening out those ambiguous rules, only 14 final rules remained and they included all 9 influential ESTs in the result of the single antecedent rules mining. The result of the double antecedent rules mining enhances the significance of the dynamic association rules mining in biological meaning. Two of the five additional ESTs were “BLANK” in the hybridized microarrays, implying no expression sequence (Table 4). There were 840 BLANK cells in each array. These cells would also be detected and transferred into intensities as background signals. In our normalization, there is still a chance to be significantly different in very low intensity but in a large ratio between knockouts and controls stochastically. One interesting additional EST is EST ID 6379, which represents catalase (CAS1) and plays a major role as antioxidant enzyme against oxidative stress. Catalase converts the hydrogen peroxide to water and oxygen for alleviating the toxicity in cells. It was noticed that HDL prevented the increase of intracellular reactive oxygen through catalase activity, decreasing EGFR activation triggered by oxidized low-density lipoprotein (oxLDL) and H_{2}O_{2} [27]. It implies that catalase is regulated by HDL. When the HDL level decreases, the expression of catalase should be up-regulated to compensate the antioxidant activity and also lose the control by HDL regulation. We also apply multiple t test with adjusted p-value. The results are listed in Table 4. In Table 4, dystrobrevin binding protein 1 (DTNBP1), known as dysbindin, is a protein of dystrophin-associated protein complex (DPC) in skeletal muscle cells. It is also a part of lysosome-related organelles complex 1 (BLOC-1) and plays a role in intracellular vesicle trafficking, neurotransmitter release [28]. Male germ cell-associated kinase (MAK) is a serine/threonine protein kinase involved in the cell cycle. It expresses primarily in germ cells. However, the function of DTNBP1 and MAK involved in liver cells of HDL deficiency needs to be studied further.

### Analysis of the data of Mouse Embryonic Stem Cells [20]

Zhou et al. [20] conducted the whole genome expression to identify the gene network in mouse embryonic stem cells (ESC). Two major properties of ESC are pluripotency and capability of propagating indefinitely [29]. ESC cells form the inner embryo mass of blastocyst by proliferation and have the potential to differentiate into specific cell type for the development of embryo under an extremely strict control [30]. The regulation of transcription factors and the interaction with epigenetic factors form a gene regulatory network to control the pluripotency and differentiation of ESC cells. Four transcription factors (TFs), Oct4, Sox2, Klf4 and c-Myc, play an important role of maintaining ESC cells at the pluripotent state [31]. Additional TFs are also involved in the regulation of ESC [32]. An ESC cell is also capable of proliferating and self-renewal [29]. Thus, ESC cells are widely used in developmental biology and stem cell research [33].

In Zhou et al. [20], the status of mouse ESC was assessed by sorting the expression level of Oct4-GFP mouse ESC (mESC) using flow cytometry. With a non-GFP mESC line as a negative control, they studied the status of mESC by the expression level of the Oct4 gene. The total RNA samples were extracted from 16 sorted cell samples to study the expression profiles on Genome 430 V.2 Affymetrix microarrays. Eight profiles were marked as Oct4 positive (Oct4+), implying that the cells retained the attributes of ESC. Other 8 profiles were sorted with low Oct4 expression (Oct4-). The analysis was performed by dChip, a microarray analysis tool developed by Li and Wong [34]. The fold change was calculated by the expression level in Oct4+ samples over that in Oct4- samples, and noted as the ratio R. The *p*-value of the average difference between two groups was calculated by the Welch modified two-sample *t*-test. The Oct4-sorted + subset was defined as the ones with R > 2 and p-value <0.05, while the Oct4-sorted- subset as the ones with R <0.5 and *p*-value <0.05.

With the DAR algorithm, we first transformed and discretized the data to 1, 0, and −1, with the same criterion (R >2 or R < 0.5) as in Zhou et al. [20]. The average probe hybridization intensity of the 8 Oct4- samples served as the baseline for each gene. Next, every data point was divided by the baseline in that probe. If the ratio R was larger than 2, the data point was labeled as ‘1’; if it was smaller than 0.5, it was labeled as ‘-1’; all other data points were labeled as ‘0’. All gene symbols and RefSeq annotation were obtained from the supplement data of Zhou et al. [20]. The aim of this analysis was to figure out the significantly different genes in expression level between Oct4+ and Oct4-. Since the normalization is based on the average expression level of Oct4- for discretization, the significant association rule in ‘1 to Oct4+’ is sufficient to signify that the expression level of Oct4+ is significantly larger than that of Oct4-, and it can be considered as the genes in the Oct4-sorted + subset in Zhou et al. [20]. Similarly the significant rule ‘-1 to Oct4+’ means that the expression level of Oct4+ is significantly lower than that of Oct4-.

*t*test with adjusted p-value. The results are listed in Table 5. As shown in Table 5, six out of the seven chosen genes were significant in the subset of ‘1 to Oct4+’. The confidence level of Sox2 failed to pass the minimum support and minimum confidence under the 95 % confidence interval. For the differentiation markers, all seven genes were listed in the subset of “Oct4-sorted-” and expressed higher than 10 fold changes in the negative direction. However, the test of Tgfbr3 (0.5 in term of support) does not pass the minimum of support (0.5031) in association rule ‘−1 to Oct4+’ under the 95 % confidence interval because high variation of expression level among the eight Oct4- samples gave rise to a low support level in the ‘−1 to Oct4+’ rule. In terms of confidence, Tgfbr3 (0.8) did pass the minimum confidence (0.7735) at the 95 % confidence level. If we adjusted the criterion to the 90 % confidence level, reducing the minimum support to 0.461 and the minimum confidence to 0.707, Tgfbr3 would be significant. This indicates that the criteria should be chosen properly depending on the type and the property of the dataset. Moreover, Zhou et al. [20] listed 15 regulators that were involved in the states of ESC (Table 6). Eleven of the 15 genes are significant in both gene subsets. Out of the four insignificant genes, Stat3 and Sall4, that were not significant in all association rules, were also excluded from significant subsets in the original paper. Otx2 was as insignificant as Sox2 in the rule of ‘1 to Oct4+’ with the 95 % confidence level.

The results of the marker genes of ESC or differentiation from the dataset of Zhou et al. [20]

Marker genes of ESC | RefSeq ID | Sig. in Oct4-sorted+ | Sig. in’1 to Oct4 + ’ | Multiple |
---|---|---|---|---|

Oct4 | NM_013633 | + | + | 4.00E−04 |

Sox2 | NM_011443 | + | - | 6.00E−04 |

Nanog | NM_024865 | + | + | 0.0038 |

Esrrb | NM_011934 | + | + | 6.00E−04 |

Tcl1 | NM_009337 | + | + | 4.00E−04 |

Dppa5 | NM_025274 | + | + | 4.00E−04 |

Utf1 | NM_009482 | + | + | 4.00E−04 |

Marker genes of differentiation | Sig. in Oct4-sorted- | Sig. in ‘-1 to Oct4 + ’ | ||

Tcf7l2 | NM_009333 | + | + | 0.1526 |

Gata4 | NM_008092 | + | + | 6.00E−04 |

Gata6 | NM_010258 | + | + | 0.0032 |

Tgfbr3 | NM_011578 | + | - | 1 |

Foxa2 | NM_010446 | + | + | 4.00E−04 |

Bmp2 | NM_007553 | + | + | 0.017 |

Cited2 | NM_010828 | + | + | 4.00E-04 |

The results of the identified core regulators from the dataset of Zhou et al. study [20]

Gene name | RefSeq ID | Sig. in Oct4+ sorted | Sig. in ‘1 to Oct4+’ |
---|---|---|---|

Oct4 | NM_013633 | + | + |

Sox2 | NM_011443 | + | - |

Nanog | NM_024865 | + | + |

Stat3 | NM_213659 | - | - |

Esrrb | NM_011934 | + | + |

Sall4 | NM_201395 | - | - |

Nr5a2 | NM_030676 | + | + |

Otx2 | NM_144841 | + | - |

Tcf7 | NM_009331 | + | + |

Etv5 | NM_023794 | + | + |

Utf1 | NM_009482 | + | + |

Tcfap2c | NM_009335 | + | + |

Mtf2 | NM_013827 | + | + |

Rest | NM_011263 | + | + |

Rbpsuh | NM_009035 | + | + |

### Analysis of the Expression Profiles among the Cohort of Leukemia Patients [21]

The classification of tumor types has been a challenge for pathologists to decide a specific cancer treatment for patients. The knowledge-based molecular markers are critical for the clinical treatment. Acute leukemia has been classified into acute lymphoblastic leukemia (ALL) and acute myeloid leukemia (AML) by enzyme-based histochemical diagnosis [39, 40]. In 1999, Golub et al. introduced gene expression profiling as an approach to validate the outcome of clinical diagnosis [21]. Thirty-eight acute leukemia cases from diagnosed patients (27 ALL, 11AML) were acquired in that study. Thirty-eight total RNA samples extracted from acute leukemia patients’ bone marrow were hybridized to Affymetrix microarrays with probes for 6817 human genes.

Identifying differentially expressed genes with statistical significance has been a crucial step of microarray analysis. Since a large number of replicates in one treatment group of acute leukemia was conducted [21], the gene expression data set has been used as a good training set for statistical method development. Many statistical methods have been published for identifying differential gene expression in microarray [41]. Here we compare the DAR algorithm to one of the methods listed in Kim et al.’s paper. The lists of significant genes were obtained by the *t*-test and by our proposed association rule approach.

The normalization of the raw data was conducted for each sample by subtracting its median and dividing it by its quartile range. The *t*-statistic is provided in Pan [42], which is used to identify differently expressed genes between two groups with a 95 % confidence level. For the association rule method, after normalization, the discretization step follows the Transitional State Discrimination method (TSD) in Pati and Das [43]. For each gene, we subtracted its mean and divided it by its standard deviation. If the normalized value was ≧1, we labeled it as 1; if it was ≦ − 1, we labeled it as −1; otherwise, we label it as 0. Based on these labeled data, the proposed procedure can be applied to find out the significant rules with a 95 % confidence level.

In order to mine the biological information in the final gene list, pathway analysis was conducted to map these genes to known pathways (using Gene Ontology terms as proxy). If the genes set is too small, some potential significant pathways may not be discovered. Therefore, unlike Pan [42], we did not apply the *p*-value adjustment in the multiple comparisons when selecting significant genes.

*t*-test with α = .05 had 97 probes in AML > ALL and 672 probes in ALL > AML (Table 7). For the significant gene in AML > ALL, our association rule had 41 out of the 86 non-redundant genes in common with the gene list selected from t-test. As for ALL > AML, 201 out of 615 non-redundant genes were reported by both statistical methods. The fixed number of degree of freedom in t-test could be the factor to the agreement of acquiring genes between association rule and t-test. Table 8 listed over-represented pathways in Gene Ontology (GO). Although a low proportion of common genes were reported by both methods, the gene list from association rule in ALL > AML and those from t-test have a strong agreement in pathway analysis. Among 19 significant GO pathways (

*p*-value <0.05) in the over-representation test by using the significant gene list from the association rule, 16 pathways were also reported as over-representation pathways from the t-test significant gene list (Table 8). This indicates that the pool of genes in both methods play similar roles in the biological functions even though the number of common genes was low. That is, most of the genes in these two subsets, even the common set is small, involve in similar pathways in the cells. The significant pathways in both gene lists of AML > ALL did not have many overlaps simply due to the limited gene list selected by the t-test, giving rise to only one significant pathway found in pathway analysis. Furthermore, the significant biological processes, e.g., hemopoiesis and developmental process indicate the fundamental differences of cell regulation between myeloid and lymphoid cells according to the overrepresentation test of gene list that was identified by the association rule approach. Nevertheless, it is worth noticing that this comparison had relatively minor input to the biology and clinic since there is lack of a cohort of baseline to calibrate the expression profile between AML and ALL samples.

Number of significant probes and non-redundant genes under tested methods

Association rule | | Common gene | |
---|---|---|---|

| 576 (683) | 86 (97) | 41 |

| 396 (467) | 615 (672) | 201 |

Significant pathway in term of biological process of GO database

ALL > AML (−1 to AML) in association rule | ALL > AML in | ||
---|---|---|---|

Biological Process | | Biological Process | |

| 5.05E–25 | | 8.38E–25 |

| 1.65E–21 | | 2.80E–23 |

| 2.20E–13 | | 3.20E-21 |

| 5.27E–07 | | 3.23E–16 |

| 1.30E–06 | | 1.41E–13 |

| 3.88E–06 | | 7.06E–10 |

| 1.59E–04 | | 6.09E–08 |

| 2.00E–04 | | 1.10E–07 |

| 7.37E–04 | | 4.00E–07 |

| 1.01E–03 | Response to stimulus | 4.04E–07 |

| 3.10E–03 | mRNA processing | 2.10E–06 |

| 5.49E–03 | | 2.70E–06 |

| 7.40E–03 | | 5.52E–06 |

Protein complex biogenesis | 1.61E–02 | response to stress | 6.65E–05 |

Protein complex assembly | 1.61E–02 | | 1.73E–04 |

| 3.09E–02 | | 2.75E–04 |

| 3.10E–02 | | 3.43E–04 |

Transcription from RNA polymerase II promoter | 4.21E–02 | Purine nucleobase metabolic process | 8.90E–04 |

| 4.84E–02 | Protein phosphorylation | 1.03E–03 |

mRNA splicing, via spliceosome | 1.40E–03 | ||

Meiosis | 3.33E–03 | ||

| 4.12E–03 | ||

RNA splicing | 8.94E–03 | ||

RNA splicing, via transesterification reactions | 8.94E–03 | ||

Cellular defense response | 2.28E–02 | ||

Cell proliferation | 3.93E–02 | ||

Nitrogen compound metabolic process | 4.54E–02 | ||

| 4.63E–02 | ||

Regulation of carbohydrate metabolic process | 4.66E–02 | ||

AML > ALL (+1 to AML) in association rule | AML > ALL in | ||

Biological Process | | Biological Process | |

Metabolic process | 1.20E-10 | | 1.14E-02 |

Cell communication | 8.26E-10 | ||

Developmental process | 3.19E-09 | ||

| 5.32E-09 | ||

Immune response | 6.40E-09 | ||

Immune system process | 4.00E-08 | ||

Primary metabolic process | 5.37E-08 | ||

Macrophage activation | 1.43E-07 | ||

Response to stimulus | 1.71E-07 | ||

System development | 8.39E-06 | ||

Cell death | 6.55E–05 | ||

Apoptotic process | 6.55E–05 | ||

Death | 7.05E–05 | ||

Proteolysis | 2.85E–04 | ||

Hemopoiesis | 6.24E–04 | ||

Protein metabolic process | 1.30E–03 | ||

Negative regulation of apoptotic process | 1.51E–03 | ||

Transport | 4.90E–03 | ||

Localization | 8.73E–03 | ||

Biological regulation | 9.95E–03 | ||

Angiogenesis | 1.46E–02 | ||

Regulation of biological process | 2.34E–02 | ||

B cell mediated immunity | 7.41E–02 | ||

Skeletal system development | 8.16E–02 | ||

Cellular defense response | 8.65E–02 | ||

Mesoderm development | 9.51E–02 |

### An Application to the RNA-seq Data of Genomic Imprinting Study [22]

Genomic imprinting is an epigenetic system that is inheritable from parents in diploid organisms. It is important for mammalian development and embryonic growth. The epigenetic tags on imprinted genes of a one-cell embryo were fully established during the paternal and maternal germ cell developmental process [44,45]. Dynamic reprogramming, such as active and passive demethylation of both parental genomes, is crucial for imprint maintenance throughout development [46, 47, 48]. During the formation of gonads in the embryo, primordial germ cells (PGCs) undergo epigenetic erasure to recover pluripotency [49]. According to previous studies, gene Tet1 may be involved in the erasure of genomic imprinting in the PGCs in E11.5- E13.5 mouse embryos [50, 51]. Yamaguchi et al. [51] found that the paternal^{KO} (Tet1^{−/−} male x wild-type female) mice had significantly fetal and postnatal growth defects. To link the phenotypic changes to the dysregulated erasure of imprinted genes on paternal alleles, Yamaguchi et al. [22] performed the RNA-seq analysis of E9.5 embryonic PGCs on 10 Tet1 paternal^{KO} and three control mice. The normalized expression level was calculated in terms of FPKM and was log2 transformed. The cutoff of significantly altered genes of the paternal^{KO} compared with the average expression level of the control samples was the fold-change of 1.5. We followed the criteria of Yamaguchi, et al. [22] to discretize the data. If the expression level of the gene was more than 1.5 times over the average expression level of control samples, it was labeled as 1, whereas if the expression level was less than two-third of the average expression level of the control samples, it was labeled as −1. Otherwise, it was labelled as 0.

^{KO}”, representing the significantly up-regulated genes in paternal

^{KO}mice. Four hundred and fifty-six meaningful rules were found in “-1 geneA implies paternal

^{KO}”, which represent significantly down-regulated genes (Table 9). In Yamaguchi et al. [22], 905 up-regulated and 635 down-regulated genes were identified. The percentages of overlaps in up-regulated and down-regulated genes between the two studies are 27.48 % and 28.29 %, respectively. In Yamaguchi et al. [22], genes were identified as significant as long as at least two of the ten paternal

^{KO}embryos analyzed had a fold-change (FC) larger than 1.5 times to the average of the control embryos. The stringency of selecting rule from the original paper was relatively relaxed than it was in our method. This may be the reason why the overlaps of the resulting genes from two methods are small.

Number of significant DAR rules using five different confidence levels

Association rules | New method | ||||
---|---|---|---|---|---|

70 % | 75 % | 80 % | 85 % | 90 % | |

Confidence | Confidence | Confidence | Confidence | Confidence | |

Expression of rules | Number of rule (number of overlapping genes in Yamaguchi et al.’s study) | ||||

1 geneA - > case | 1055 (267) | 575 (158) | 168 (38) | 34 (6) | 9 (0) |

−1 geneA - > case | 869 (255) | 456 (129) | 117 (30) | 11 (2) | 5 (1) |

1 geneA - > control | 609 (9) | 581 (9) | 304 (5) | 304 (5) | 282 (5) |

−1 geneA - > control | 737 (8) | 732 (8) | 332 (3) | 332 (3) | 320 (3) |

0 geneA - > case | 236 (2) | 125 (2) | 36 (36) | 2 (0) | 0 |

0 geneA - > control | 2478 (701) | 2370 (696) | 1474 (444) | 876 (238) | 454 (132) |

^{KO}mice (Table 10). Applying our proposed method, we found 8 out of the 39 genes to be marked as significant association rules either in “1 geneA implies paternal

^{KO}” or “−1 geneA implies paternal

^{KO}”. The number of genes shared by the two methods is low. The criteria to select the genes in Yamaguchi et al.’s study [22] did not have statistical support and only considered if two individuals had a FC larger than 1.5. The loose criterion may explain the low overlaps. Furthermore, some of the genomic imprinting related genes were assigned as activated and inhibited significantly at the same time (e.g., Peg3, Airn, Begain, Sfmbt2 in Table 10) based on the criteria of the paper of Yamaguchi et al. [22]. Such genes were considered as ambiguous if one only mines significant single antecedent rules. However, in theory they can be captured if we consider higher leveled antecedent rules mining when the genes have significant interaction with the other significant genes. The multiple

*t*test with adjusted

*p*-value has been applied to analyze as well. The results has been listed in Table 10.

Expressed imprinted genes in the RNA-seq data of Yamaguchi et al. [22]

Gene symbol | Expressing allele | at least two out of ten FC > 1.5 | ||
---|---|---|---|---|

Significant (up, down) or not | Intersect with significant association rules | Multiple t-test (adj. p-value) | ||

Mest | P | Down | 1 | |

H19 | M | Up | 1 | |

Meg3 | M | Down | 1 | |

Grb10 | M | Up | 1 geneA - > paternal | 1 |

Rian | M | Down | 1 | |

Peg10 | P | Down | −1 geneA - > paternal | 1 |

Cdkn1c | M | Up | 1 | |

Peg3 | P | up/down | 1 | |

Sgce | P | Down | −1 geneA - > paternal | 1 |

Asb4 | M | Up | 1 geneA - > paternal | 1 |

Cmah | M | Down | 1 | |

Impact | P | Down | 1 | |

Pon2 | M | Down | 1 | |

Ube3a | M | Up | 1 | |

Peg13 | P | Down | 1 | |

Phlda2 | M | Down | 1 | |

Dcn | M | Up | 1 | |

Airn | P | up/down | 1 | |

Ddc | P | Down | 1 | |

Zim1 | M | Up | 1 | |

Magel2 | P | Down | 1 | |

Begain | P | up/down | 1 | |

Tspan32 | M | Down | −1 geneA - > paternal | 1 |

Art5 | M | Down | 1 | |

Wt1 | M | Up | 0.818182 | |

Qpct | M | Down | 1 | |

Atp10a | M | Down | 1 | |

Nespas | P | Down | −1 geneA - > paternal | 1 |

Tnfrsf23 | M | Down | 1 | |

Tfpi2 | M | Down | 1 | |

Sfmbt2 | P | up/down | 1 | |

Nap1l5 | P | Up | 1 geneA - > paternal | 1 |

Slc22a18 | M | Down | 1 | |

Th | M | Up | 1 geneA - > paternal | 1 |

Usp29 | P | Down | 1 | |

Cntn3 | M | Down | 1 | |

Mst1r | M | Down | 1 | |

Calcr | M | Down | 1 | |

Kcnq1 | M | Down | 1 |

### Microarray Quality Control (MAQC) data sets [52]

In 2006, MicroArray Quality Control (MAQC) consortium launched a series of analyses across different platforms of microarrays [52]. They used four defined samples to acquire the expression profiles from eight commercialized microarray platforms. The overall objective of this project is to evaluate the sensitivity and reproducibility among microarray platforms. Those samples include 100 % Universal Human Reference RNA (UHRR, sample A), 100 % Human Brain Reference RNA (HBRR, sample B), 75 % UHRR: 25 % HBRR (sample C) and 25 % UHRR: 75 % HBRR (sample D). Five replicates of every sample were tested on one chip in one platform and three chips of every platform were conducted in this project. This resulted in 15 replicates for every sample in one microarray platform. In the same project, they also used three qPCR assays to validate 1297 genes selected from the common probes among microarray platforms. According to the single gene quantification study [53], the expression level qPCR can serve as great standard to evaluate the sensitivity and accuracy of microarray platforms. In total, they quantified 997 genes with TaqMan Gene Expression Assays (TAQ), 205 genes with Standardized RT (Sta) RT-PCR assays (GEX) and 244 genes with QuantiGene assays (QGN). The number of genes is 1297 in union [53].

In order to compare different statistical methods for determining differentially expressed genes (DEGs), Kadota and Shimizu [54] selected TAQ and GEX assay data to compare the DEG determined by *t*-test and Average Difference (AD, as known as log-fold-change) methods. They further used Benjamini and Hochberg approach to calculate the false discovery rate (FDR) for the p-value from the *t*-test [55]. They selected five microarray platforms from MAQC project [52] including Applied Biosystems (ABI), Affymetrix (AFX), Agilent Technologies for one-color array (AG1), GE Healthcare (GEH) and Illumina (ILM). Among these platforms, they compared the specificity and sensitivity of gene ranking methods for analyzing two-class data: weighted average difference (WAD), average difference (AD), fold change (FC), rank product (RP), moderated t statistic (modT), significance analysis of microarrays (samT), shrinkage t statistic (shrT), and intensitybased moderated t statistic (ibmT) [56].

*t*-test when the FDR is smaller than 0.05. To select the significant DARs from TAQ data, we discretize the TAQ data by dividing gene expression level of each replicate by the average expression level of sample A that is similar to the calculation of AD method. The genes in TAQ data were assigned as up-regulated gene if the average expression level of sample B is larger than that of sample A, and labeled as down-regulated gene if the average expression level of sample A is larger than that of sample B. 70 % and 90 % confidence level were used to carry out the lists of DEG by DAR method. The result shows that almost all genes that listed as DEG by DAR method with 90 % confidence level were included in the lists of DEG by AD and

*t*-test method (Fig. 5). The lists of DEG by DAR method with 70 % confidence level covered all genes listed in AD method and had several unique genes against the lists of DEG by

*t*-test method in up-regulated DEGs and down-regulated DEGs.

The normalized ILM microarray data set that had 47,293 detecting probes was obtained from the published work of Kadota and Shimizu [54]. It left 23,080 probes after excluding non-detectable probes, which determined by all 30 detections having flag detection value less than 0.99. The WAD and FC statistic were re-calculated following the description in Kadota et. al’s study [56]. In brief, the FC for each gene was calculated as average non-log expression value for 15 replicates of sample B divided by the average expression value for 15 replicates of sample A. The WAD statistic was calculated as average log value of sample B divided by that of sample A, and weighted by the range of average log value for 30 detections value across all ILM detectable probes [56]. The discretization for DAR method was calculated as the log expression value of each replicate divided by the average log expression value of sample A. The cutoff of absolute value larger than 1 was used for categorization. Among 23,080 probes, 2775 DARs were found to pass the minimum support and minimum confidence in rule’1 geneA implies to sample B’ under 99 % confidence level, which could also be inferred as up-regulated genes. There were 3339 DARs were found in rule’-1 geneA implies to sample B’, and interpreted as down-regulated genes.

Since the WAD and FC statistic were used only for ranking, it did not assign a cutoff for DEG in Kadota et al.’s work [54]. Here we simply selected top 2775 probes and bottom 3339 probes for comparison after ranked with WAD and FC statistic. The intersection number of up-regulated and down-regulated probes between DAR and FC was 2668 (96.14 %) and 3139 (94.01 %). The intersection number of up-regulated and down-regulated probes between DAR and WAD was 2173 (78.31 %) and 2596 (77.75 %).

## Conclusions

Our association rules can be applied to gene expression data analysis with high confidence and reproducibility. We took advantage of the well-established association rule mining technique from marketing to develop an improved method and algorithm, the DAR algorithm, to mine significant association rules between gene regulation and trait. In particular, we derived the distributions of support and confidence for the association rule “if A then B” under the assumption of independence between A and B. Based on these distributions, we could then determine the minimal support and the minimal confidence. That is, for any association rule to be meaningful, their minimal support and minimal confidence must be higher than the theoretical upper limits under the independency assumption. While finding important association rules remains a challenging problem, we provided a formal procedure for testing whether a rule is meaningful. Certainly, when other sources of information is possible (from knowledge domain, for example), it is possible that an association rule is meaningful, even without beating this minimal value. Our conclusion here is purely data driven.

_{1}), we have

where *p* = p_{1} · p_{2} .

Suppose p∗ is the root for the above equation, then p_{2} must be larger than p∗ / p_{1} for the rule to be meaningful. Thus, we can ignore all events B whose p_{2} is smaller than p∗ / p_{1}.

The analysis results from the four datasets used above show the power of assessing gene regulation by the DAR algorithm. The influential genes relative to HDL deficiency are distinguished from EST-based microarrays. The regulatory network of ESC including a few crucial transcription factors is also revealed by well-defined mouse microarrays. The agreement of the pathway analysis is evident between the association rule algorithm and the *t*-test in the leukemia dataset, although the proportion of intersected genes is small between the two lists of significant genes. The association rule approach that applies to the RNA-seq data also identifies a set of significant gene lists that has a moderate agreement with the results from the source study [22]. In this analysis, we extended the established data mining technique of association rules borrowed from market basket analysis to transcriptome analysis. A method was developed to normalize, transform, discretize, and add identification techniques to the data. A computer program produces many association rules. Having the originally produced rules that numbered in the hundreds, the theoretical minimum support and theoretical minimum confidence were used to trim rules. The resulting rules were found to be statistically significant and left to the investigator to determine whether they are significant biologically. Traditional statistical techniques were employed to validate the finding of the association rules with mixed results mostly stemming from the unique makeup of the data. Association rules mining is an alternative approach to hypothesis development and can facilitate researchers to consider alternative genes and relationships that would otherwise be ignored in gene expression data analysis.

### Availability of supporting data

The code and dataset can be downloaded from www.mixturetree.net.

## Notes

### Acknowledgements

We are grateful for the constructive comments from the referees. We also thank Dr. Michael Thomas, Professor at Idaho State University, for his valuable feedback when we prepared the manuscript. In addition, we acknowledge the support of National Center for Theoretical Sciences (South), Taiwan.

### References

- 1.Agrawal R, Imielinski T, Swami A. Mining association rules between sets of items in large databases. ACM SIGMOD. 1993;22(2):207–16.CrossRefGoogle Scholar
- 2.Berry MJ, Linoff GS. Data mining techniques: for marketing, sales, and customer support. New York: Wiley; 1997.Google Scholar
- 3.Becquet C, Blachon S, Jeudy B, Boulicaut JF, Gandrillon O. Strong-association-rule mining for large-scale gene-expression data analysis: a case study on human SAGE data. Genome Biol. 2002. doi: 10.1186/gb-2002-3-12-research0067.PubMedCentralPubMedGoogle Scholar
- 4.Creighton C, Hanash S. Mining gene expression databases for association rules. Bioinformatics. 2003;19(1):79–86.CrossRefPubMedGoogle Scholar
- 5.Ramakrishnan R, Gehrke J. Database management systems. New York: McGraw-Hill; 2000.Google Scholar
- 6.Park I, Lee D, Lee KH. Fuzzy association rule mining for microarray time series analysis. Proc of ISIS. 2007;9:560–3.Google Scholar
- 7.Hahsler M, Grun B, Hornik K. Arules - a computational environment for mining association rules and frequent item sets. J Stat Softw. 2005;14(15):1–25.CrossRefGoogle Scholar
- 8.Palanisamy SK. Association rule based classification. M. S. Worcester Polytechnic Institute, MA. USA: Thesis; 2006.Google Scholar
- 9.Augenlicht LH, Kobrin D. Cloning and screening of sequences expressed in a mouse colon tumor. Cancer Res. 1982;42(3):1088–93.PubMedGoogle Scholar
- 10.Yuen T, Wurmbach E, Pfeffer RL, Ebersole BJ, Sealfon SC. Accuracy and calibration of commercial oligonucleotide and custom cDNA microarrays. Nucleic Acids Res. 2002;30(10), e48.PubMedCentralCrossRefPubMedGoogle Scholar
- 11.Bainbridge MN, Warren RL, Hirst M, Romanuik T, Zeng T, Go A, et al. Analysis of the prostate cancer cell line LNCaP transcriptome using a sequencing-by-synthesis approach. BMC Genomics. 2006. doi: 10.1186/1471-2164-7-246.PubMedCentralPubMedGoogle Scholar
- 12.Mortazavi A, Williams BA, McCue K, Schaeffer L, Wold B. Mapping and quantifying mammalian transcriptomes by RNA-Seq. Nat Methods. 2008;5(7):621–8. doi: 10.1038/nmeth.1226.CrossRefPubMedGoogle Scholar
- 13.Sultan M, Schulz MH, Richard H, Magen A, Klingenhoff A, Scherf M, et al. A global view of gene activity and alternative splicing by deep sequencing of the human transcriptome. Science. 2008;321(5891):956–60. doi: 10.1126/science.1160342.CrossRefPubMedGoogle Scholar
- 14.Trapnell C, Williams BA, Pertea G, Mortazavi A, Kwan G, van Baren MJ, et al. Transcript assembly and quantification by RNA-Seq reveals unannotated transcripts and isoform switching during cell differentiation. Nat Biotechnol. 2010;28(5):511–5. doi: 10.1038/nbt.1621.PubMedCentralCrossRefPubMedGoogle Scholar
- 15.Bullard JH, Purdom E, Hansen KD, Dudoit S. Evaluation of statistical methods for normalization and differential expression in mRNA-Seq experiments. BMC Bioinformatics. 2010;11:94. doi: 10.1186/1471-2105-11-94.PubMedCentralCrossRefPubMedGoogle Scholar
- 16.Dupuy A, Simon RM. Critical review of published microarray studies for cancer outcome and guidelines on statistical analysis and reporting. J Natl Cancer Inst. 2007;99(2):147–57. doi: 10.1093/jnci/djk018.CrossRefPubMedGoogle Scholar
- 17.Quackenbush J. Computational approaches to analysis of DNA microarray data. Yearb Med Inform. 2006;91–103.Google Scholar
- 18.Saeys Y, Inza I, Larranaga P. A review of feature selection techniques in bioinformatics. Bioinformatics. 2007;23(19):2507–17. doi: 10.1093/bioinformatics/btm344.CrossRefPubMedGoogle Scholar
- 19.Callow MJ, Dudoit S, Gong EL, Speed TP, Rubin EM. Microarray expression profiling identifies genes with altered expression in HDL-deficient mice. Genome Res. 2000;10(12):2022–9.PubMedCentralCrossRefPubMedGoogle Scholar
- 20.Zhou Q, Chipperfield H, Melton DA, Wong WH. A gene regulatory network in mouse embryonic stem cells. Proc Natl Acad Sci U S A. 2007;104(42):16438–43. doi: 10.1073/pnas.0701014104.PubMedCentralCrossRefPubMedGoogle Scholar
- 21.Golub TR, Slonim DK, Tamayo P, Huard C, Gaasenbeek M, Mesirov JP, et al. Molecular classification of cancer: class discovery and class prediction by gene expression monitoring. Science. 1999;286(5439):531–7.CrossRefPubMedGoogle Scholar
- 22.Yamaguchi S, Shen L, Liu Y, Sendler D, Zhang Y. Role of Tet1 in erasure of genomic imprinting. Nature. 2013;504(7480):460–4. doi: 10.1038/nature12805.PubMedCentralCrossRefPubMedGoogle Scholar
- 23.Arnold SF. Mathematical Statistics. New Jersey: Prentice Hall; 1990.Google Scholar
- 24.Dudoit S, Yang YH, Callow MJ, Speed TP. Statistical methods for identifying differentially expressed genes in replicated cDNA microarray experiments. Stat Sinica. 2002;12(1):111–39.Google Scholar
- 25.Nishi S, Nishino H, Ishibashi T. cDNA cloning of the mammalian sterol C5-desaturase and the expression in yeast mutant. Biochim Biophys Acta. 2000;1490(1–2):106–8.CrossRefPubMedGoogle Scholar
- 26.Muller C, Salvayre R, Negre-Salvayre A, Vindis C. HDLs inhibit endoplasmic reticulum stress and autophagic response induced by oxidized LDLs. Cell Death Differ. 2011;18(5):817–28. doi: 10.1038/cdd.2010.149.PubMedCentralCrossRefPubMedGoogle Scholar
- 27.Robbesyn F, Auge N, Vindis C, Cantero AV, Barbaras R, Negre-Salvayre A, et al. High-density lipoproteins prevent the oxidized low-density lipoprotein-induced epidermal [corrected] growth factor receptor activation and subsequent matrix metalloproteinase-2 upregulation. Arterioscler Thromb Vasc Biol. 2005;25(6):1206–12. doi: 10.1161/01.ATV.0000164805.73558.80.CrossRefPubMedGoogle Scholar
- 28.Benson MA, Newey SE, Martin-Rendon E, Hawkes R, Blake DJ. Dysbindin, a novel coiled-coil-containing protein that interacts with the dystrobrevins in muscle and brain. J Biol Chem. 2001;276(26):24232–41. doi: 10.1074/jbc.M010418200.CrossRefPubMedGoogle Scholar
- 29.Ying QL, Nichols J, Chambers I, Smith A. BMP induction of Id proteins suppresses differentiation and sustains embryonic stem cell self-renewal in collaboration with STAT3. Cell. 2003;115(3):281–92.CrossRefPubMedGoogle Scholar
- 30.Thomson JA, Itskovitz-Eldor J, Shapiro SS, Waknitz MA, Swiergiel JJ, Marshall VS, et al. Embryonic stem cell lines derived from human blastocysts. Science. 1998;282(5391):1145–7.CrossRefPubMedGoogle Scholar
- 31.Ivanova N, Dobrin R, Lu R, Kotenko I, Levorse J, DeCoste C, et al. Dissecting self-renewal in stem cells with RNA interference. Nature. 2006;442(7102):533–8. doi: 10.1038/Nature04915.CrossRefPubMedGoogle Scholar
- 32.Takahashi K, Yamanaka S. Induction of pluripotent stem cells from mouse embryonic and adult fibroblast cultures by defined factors. Cell. 2006;126(4):663–76. doi: 10.1016/j.cell.2006.07.024.CrossRefPubMedGoogle Scholar
- 33.Young RA. Control of the embryonic stem cell state. Cell. 2011;144(6):940–54. doi: 10.1016/j.cell.2011.01.032.PubMedCentralCrossRefPubMedGoogle Scholar
- 34.Li C, Wong WH. Model-based analysis of oligonucleotide arrays: Expression index computation and outlier detection. Proc Natl Acad Sci U S A. 2001;98(1):31–6. doi: 10.1073/pnas.011404098.PubMedCentralCrossRefPubMedGoogle Scholar
- 35.Tighe AP, Gudas LJ. Retinoic acid inhibits leukemia inhibitory factor signaling pathways in mouse embryonic stem cells. J Cell Physiol. 2004;198(2):223–9. doi: 10.1002/jcp.10424.CrossRefPubMedGoogle Scholar
- 36.Kim TG, Chen J, Sadoshima J, Lee Y. Jumonji represses atrial natriuretic factor gene expression by inhibiting transcriptional activities of cardiac transcription factors. J Mol Cell Biol. 2004;24(23):10151–60. doi: 10.1128/MCB.24.23.10151-10160.2004.CrossRefGoogle Scholar
- 37.Pasini D, Cloos PA, Walfridsson J, Olsson L, Bukowski JP, Johansen JV, et al. JARID2 regulates binding of the Polycomb repressive complex 2 to target genes in ES cells. Nature. 2010;464(7286):306–10. doi: 10.1038/nature08788.CrossRefPubMedGoogle Scholar
- 38.Schwartz YB, Pirrotta V. Polycomb silencing mechanisms and the management of genomic programmes. Nat Rev Genet. 2007;8(1):9–22. doi: 10.1038/nrg1981.CrossRefPubMedGoogle Scholar
- 39.Bennett JM, Dutcher TF. The cytochemistry of acute leukemia: observations on glycogen and neutral fat in bone marrow aspirates. Blood. 1969;33(2):341–7.PubMedGoogle Scholar
- 40.Quaglino D, Hayhoe FG. Observations on the periodic acid-Schiff reaction in lymphoproliferative diseases. Indian J Pathol Bacteriol. 1959;78:521–32.CrossRefGoogle Scholar
- 41.Kim SY, Lee JW, Sohn IS. Comparison of various statistical methods for identifying differential gene expression in replicated microarray data. Stat Methods Med Res. 2006;15(1):3–20. doi: 10.1191/0962280206sm423oa.CrossRefPubMedGoogle Scholar
- 42.Pan W, Lin J, Le CT. A mixture model approach to detecting differentially expressed genes with microarray data. Funct Integr Genomics. 2003;3(3):117–24. doi: 10.1007/s10142-003-0085-7.CrossRefPubMedGoogle Scholar
- 43.Pati SK, Das AK. Optimal samples selection from gene expression microarray data using relational algebra and clustering technique. Adv in Intel and Soft Comp. 2012;132:507–14.CrossRefGoogle Scholar
- 44.Hiura H, Obata Y, Komiyama J, Shirai M, Kono T. Oocyte growth-dependent progression of maternal imprinting in mice. Genes Cells: Devoted Molecular Cellular Mechanisms. 2006;11(4):353–61. doi: 10.1111/j.1365-2443.2006.00943.x.CrossRefGoogle Scholar
- 45.Li JY, Lees-Murdock DJ, Xu GL, Walsh CP. Timing of establishment of paternal methylation imprints in the mouse. Genomics. 2004;84(6):952–60. doi: 10.1016/j.ygeno.2004.08.012.CrossRefPubMedGoogle Scholar
- 46.Oswald J, Engemann S, Lane N, Mayer W, Olek A, Fundele R, et al. Active demethylation of the paternal genome in the mouse zygote. Curr Biol. 2000;10(8):475–8.CrossRefPubMedGoogle Scholar
- 47.Rougier N, Bourc’his D, Gomes DM, Niveleau A, Plachot M, Paldi A, et al. Chromosome methylation patterns during mammalian preimplantation development. Genes Dev. 1998;12(14):2108–13.PubMedCentralCrossRefPubMedGoogle Scholar
- 48.Santos F, Hendrich B, Reik W, Dean W. Dynamic reprogramming of DNA methylation in the early mouse embryo. Dev Biol. 2002;241(1):172–82. doi: 10.1006/dbio.2001.0501.CrossRefPubMedGoogle Scholar
- 49.Surani MA, Hayashi K, Hajkova P. Genetic and epigenetic regulators of pluripotency. Cell. 2007;128(4):747–62. doi: 10.1016/j.cell.2007.02.010.CrossRefPubMedGoogle Scholar
- 50.Hajkova P, Jeffries SJ, Lee C, Miller N, Jackson SP, Surani MA. Genome-wide reprogramming in the mouse germ line entails the base excision repair pathway. Science. 2010;329(5987):78–82. doi: 10.1126/science.1187945.CrossRefPubMedGoogle Scholar
- 51.Yamaguchi S, Hong K, Liu R, Shen L, Inoue A, Diep D, et al. Tet1 controls meiosis by regulating meiotic gene expression. Nature. 2012;492(7429):443–7. doi: 10.1038/nature11709.PubMedCentralCrossRefPubMedGoogle Scholar
- 52.Shi L, Reid LH, Jones WD, Shippy R, Warrington JA, Baker SC, et al. The MicroArray Quality Control (MAQC) project shows inter- and intraplatform reproducibility of gene expression measurements. Nat Biotechnol. 2006;24(9):1151–61. doi: 10.1038/nbt1239.CrossRefPubMedGoogle Scholar
- 53.Canales RD, Luo Y, Willey JC, Austermiller B, Barbacioru CC, Boysen C, et al. Evaluation of DNA microarray results with quantitative gene expression platforms. Nat Biotechnol. 2006;24(9):1115–22. doi: 10.1038/nbt1236.CrossRefPubMedGoogle Scholar
- 54.Kadota K, Shimizu K. Evaluating methods for ranking differentially expressed genes applied to microArray quality control data. BMC Bioinformatics. 2011;12:227. doi: 10.1186/1471-2105-12-227.PubMedCentralCrossRefPubMedGoogle Scholar
- 55.Benjamini Y, Hochberg Y. Controlling the false discovery rate - a practical and powerful approach to multiple testing. J Roy Stat Soc B Met. 1995;57(1):289–300.Google Scholar
- 56.Kadota K, Nakai Y, Shimizu K. A weighted average difference method for detecting differentially expressed genes from microarray data. Algorithms Mol Biol. 2008;3:8. doi: 10.1186/1748-7188-3-8.PubMedCentralCrossRefPubMedGoogle Scholar

## Copyright information

**Open Access**This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.