Skip to contents

In this tutorial, we will demonstrate LIGER’s ability to jointly define cell types by leveraging multiple single-cell modalities. For example, the integration of single-cell RNA-seq and single-cell ATAC-seq enables cell type definitions that incorporate both gene expression and chromatin accessibility data. Such joint analysis allows not only the taxonomic categorization of cell types, but also a deeper understanding of their underlying regulatory networks. The pipeline for jointly analyzing scRNA-seq and scATAC-seq is similar to that for integrating multiple scRNA-seq datasets in that both rely on joint matrix factorization and quantile normalization. The main differences are: (1) scATAC-seq data needs to be processed into gene-level values; (2) gene selection is performed on the scRNA-seq data only; and (3) downstream analyses can use both gene-level and intergenic information.

Stage I: Preprocessing and Normalization

1. Loading data

In order to jointly analyze scRNA and scATAC-seq data, we first need to transform the scATAC-seq data–a genome-wide epigenomic measurement–into gene-level counts which are comparable to gene expression data from scRNA-seq. Most previous single-cell studies have used an approach inspired by traditional bulk ATAC-seq analysis: identifying chromatin accessibility peaks, then summing together all peaks that overlap each gene. This strategy is also appealing because the 10X CellRanger pipeline, a commonly used commercial package, automatically outputs such peak counts. However, we find this strategy less desirable because: (1) peak calling is performed using all cells, which biases against rare cell populations; (2) gene body accessibility is often more diffuse than that of specific regulatory elements, and thus may be missed by peak calling algorithms; and (3) information from reads outside of peaks is discarded, further reducing the amount of data in the already sparse measurements. Instead of summing peak counts, we find that the simplest possible strategy seems to work well: counting the total number of ATAC-seq reads within the gene body and promoter region (typically 3 kb upstream) of each gene in each cell.

For convenience, we have prepared the pre-processed data which are ready to use, provided by GreenleafLab.

library(rliger)
if (!file.exists("liger_BMMC_rna_D1T1.rds"))
    download.file("https://figshare.com/ndownloader/files/40054858",
                  destfile = "liger_BMMC_rna_D1T1.rds")
D1T1 <- readRDS("liger_BMMC_rna_D1T1.rds")

if (!file.exists("liger_BMMC_rna_D1T2.rds"))
    download.file("https://figshare.com/ndownloader/files/40054861",
                  destfile = "liger_BMMC_rna_D1T2.rds")
D1T2 <- readRDS("liger_BMMC_rna_D1T2.rds")

if (!file.exists("liger_BMMC_atac_D5T1.rds"))
    download.file("https://figshare.com/ndownloader/files/40054891",
                  destfile = "liger_BMMC_atac_D5T1.rds")
D5T1 <- readRDS("liger_BMMC_atac_D5T1.rds")

Start from CellRanger output

You can also follow the following tutorial if you would like to start from the very beginning. Note that in this part, we included the details of running this preprocessing workflow for only one sample. Users should re-run this counting step multiple times if for more than one scATAC-seq sample.

Note also that several commands need to be run through the Command Line Interface instead of the R Console or IDE (RStudio). We also employ the bedmap command from the BEDOPS tool to make a list of cell barcodes that overlap each gene and promoter. The gene body and promoter indexes are .bed files, which indicate gene and promoter coordinates. Since bedmap expects sorted inputs, the fragment output from CellRanger, gene body and promoter indexes should all be sorted.

We show below how to perform these steps for scATAC data generated by the 10X Chromium system, the most widely used scATAC-seq protocol. The starting input for this process is the file fragments.tsv output by CellRanger, which contains all ATAC reads that passed filtering steps.

Detailed CellRanger output preprocessing

Note: 1. We don’t provide actual example input data for the demonstration in this block. Users will need to try with their own data. 2. Part of the preprocessing steps are carried out through command-line interface (cmd/terminal). 3. Please pay attention that there are file and directory paths left as placeholders. Users should replace them with their own paths.

1. We must first sort fragments.tsv by chromosome, start, and end position using the sort command line utility. The -k option lets the user sort the file on a certain column; including multiple -k options allows sorting by multiple columns simultaneously. The n behind -k stands for “numeric ordering”. Here the sorted BED file order is defined first by lexicographic chromosome order (using the parameter -k1,1), then by ascending integer start coordinate order (using parameter -k2,2n), and finally by ascending integer end coordinate order (using parameter -k3,3n). Note that this step may take a while, since the input fragment file is usually very large (for example, a typical fragment file of 4-5 GB can take about 40 minutes).

# shell
sort -k1,1 -k2,2n -k3,3n GSM4138888_scATAC_BMMC_D5T1.fragments.tsv > atac_fragments.sort.bed

Gene body and promoter indexes should also be sorted using the same strategy for sorting fragments output files:

# shell
sort -k 1,1 -k2,2n -k3,3n hg19_genes.bed > hg19_genes.sort.bed
sort -k 1,1 -k2,2n -k3,3n hg19_promoters.bed > hg19_promoters.sort.bed

2. Use bedmap command to calculate overlapping elements between indexes and fragment output files:

# shell
bedmap --ec --delim "\t" --echo --echo-map-id hg19_promoters.sort.bed atac_fragments.sort.bed > atac_promoters_bc.bed
bedmap --ec --delim "\t" --echo --echo-map-id hg19_genes.sort.bed atac_fragments.sort.bed > atac_genes_bc.bed

Important flags of bedmap command are as follows:

  • --delim. This changes output delimiter from ‘|’ to indicated delimiter between columns, which in our case is “\t”.
  • --ec. Adding this will check all problematic input files.
  • --echo. Adding this will print each line from reference file in output. The reference file in our case is gene or promoter index.
  • --echo-map-id. Adding this will list IDs of all overlapping elements from mapping files, which in our case are cell barcodes from fragment files.

3. We then import the bedmap outputs into the R Console or RStudio. Note that the as.is option in read.table() is specified to prevent the conversion of character columns to factor columns:

# R
genes.bc <- read.table(file = "atac_genes_bc.bed", sep = "\t", as.is = c(4,7), header = FALSE)
promoters.bc <- read.table(file = "atac_promoters_bc.bed", sep = "\t", as.is = c(4,7), header = FALSE)

Cell barcodes are then split and extracted from the outputs. We recommend the user to filter out those barcodes which have a total number of reads lower than a certain threshold, for example, 1500. This threshold can be adjusted according to the size and quality of the samples.

# R
bc <- genes.bc[,7]
bc_split <- strsplit(bc,";")
bc_split_vec <- unlist(bc_split)
bc_unique <- unique(bc_split_vec)
bc_counts <- table(bc_split_vec)
bc_filt <- names(bc_counts)[bc_counts > 1500]
barcodes <- bc_filt

4. We can then use LIGER’s makeFeatureMatrix() function to calculate accessibility counts for gene body and promoter individually. This function takes the output from bedmap and efficiently counts the number of fragments overlapping each gene and promoter. We could count the genes and promoters in a single step, but choose to calculate them separately in case it is necessary to look at gene or promoter accessibility individually in downstream analyses.

# R
library(rliger)
gene.counts <- makeFeatureMatrix(genes.bc, barcodes)
promoter.counts <- makeFeatureMatrix(promoters.bc, barcodes)

Next, these two count matrices need to be re-sorted by gene symbol. We then add the matrices together, yielding a single matrix of gene accessibility counts in each cell.

# R
gene.counts <- gene.counts[order(rownames(gene.counts)),]
promoter.counts <- promoter.counts[order(rownames(promoter.counts)),]
D5T1 <- gene.counts + promoter.counts
colnames(D5T1)=paste0("D5T1_",colnames(D5T1))

5. Once the gene-level scATAC-seq counts are generated, the read10X() function from LIGER can be used to read scRNA-seq count matrices output by CellRanger. You can pass in a directory (or a list of directories) containing raw outputs (for example, "/Sample_1/outs/filtered_feature_bc_matrix") to the parameter sample.dirs. Next, a vector of names to use for the sample (or samples, corresponding to sample.dirs) should be passed to parameter sample.names as well. LIGER can also use data from any other protocol, as long as it is provided in a genes x cells R matrix format.

# R
bmmc.rna <- read10X(path = "/path_to/filtered_feature_barcode_matrix", sampleNames = "rna")

2. preprocessing

We can now create a LIGER object with the createLiger() function. We also remove unneeded variables to conserve memory. Additionally, we merge the two RNA datasets into one.

bmmc.rna <- cbind(D1T1, D1T2)
bmmcLiger <- createLiger(list(atac = D5T1, rna = bmmc.rna),
                        modal = c("atac", "rna"))

Preprocessing steps are needed before running iNMF. Each dataset is normalized to account for differences in total gene-level counts across cells using the normalize function. Next, highly variable genes from each dataset are identified and combined for use in downstream analysis. Note that by setting the parameter useDataset = "rna", genes will be selected only from the scRNA-seq dataset (the second dataset) by the selectGenes() function. We recommend not using the ATAC-seq data for variable gene selection because the statistical properties of the ATAC-seq data are very different from scRNA-seq, violating the assumptions made by the statistical model we developed for selecting genes from RNA data. Finally, the scaleNotCenter() function scales normalized datasets without centering by the mean, giving the non-negative input data required by iNMF.

bmmcLiger <- bmmcLiger %>%
    normalize() %>%
    selectGenes(useDatasets = "rna") %>%
    scaleNotCenter()

Stage II: Joint Matrix Factorization

3. Determine parameters and perform iNMF integration

We next perform joint matrix factorization (iNMF) on the normalized and scaled RNA and ATAC data. This step calculates metagenes–sets of co-expressed genes that distinguish cell populations–containing both shared and dataset-specific signals. The cells are then represented in terms of the “expression level” of each metagene, providing a low-dimensional representation that can be used for joint clustering and visualization. To run iNMF on the scaled datasets, we use the runIntegration() function with proper hyperparameter settings.

bmmcLiger <- runIntegration(bmmcLiger, k = 20)

Stage III: Quantile Normalization and Joint Clustering

4. Align the factors

Using the metagene factors calculated by iNMF, we then assign each cell to the factor on which it has the highest loading, giving joint clusters that correspond across datasets. We then perform quantile normalization by dataset, factor, and cluster to fully integrate the datasets. To perform this analysis, typing in:

bmmcLiger <- quantileNorm(bmmcLiger)

5. Clustering

The quantileNorm() function gives joint clusters that correspond across datasets, which are often completely satisfactory and sufficient for downstream analyses. However, if desired, after quantile normalization, users can additionally run the Leiden algorithm for community detection, which is widely used in single-cell analysis and excels at merging small clusters into broad cell classes. This can be achieved by running the runCluster() function. Several tuning parameters, including resolution, nNeighbors, and prune control the number of clusters produced by this function. For this dataset, we use a resolution of 0.2.

bmmcLiger <- runCluster(bmmcLiger, nNeighbors = 30, resolution = 0.2)

Starting from rliger 2.0.0, cluster labeling will be stored in cell metadata, which can be accessed with cellMeta(bmmcLiger). Use argument clusterName to specify unique variable names for the result can enable storing multiple cluster labeling variables at the same time.

Stage IV: Visualization and Downstream Analysis

6. Generate dimensionality reduced embedding

In order to visualize the clustering results, the user can use two dimensionality reduction methods supported by LIGER: t-SNE and UMAP. We find that often for datasets containing continuous variation such as cell differentiation, UMAP better preserves global relationships, whereas t-SNE works well for displaying discrete cell types, such as those in the brain. The UMAP algorithm (called by the runUMAP() function) scales readily to large datasets. The runTSNE() function also includes an option to use “FFtSNE”, a highly scalable implementation of t-SNE that can efficiently process huge datasets. For the BMMC dataset, we expect to see continuous lineage transitions among the differentiating cells, so we use UMAP to visualize the data in two dimensions:

bmmcLiger <- runUMAP(bmmcLiger, nNeighbors = 30, minDist = 0.3)

Starting from rliger 2.0.0, dimensionality reduction matrices will be stored in cell metadata, which can be accessed with cellMeta(bmmcLiger). Use argument dimredName to specify unique variable names for the result can enable storing multiple low-dimensional representation matrices as variables at the same time.

7. Create plots

We provide a variety of utilities for visualization and analysis of clustering, gene expression across datasets, and comparisons of cluster assignments. Here we demonstrate several commonly used examples.

plotByDatasetAndCluster() returns two graphs, generated by t-SNE or UMAP in the previous step. The first colors cells by dataset of origin, and the second by cluster as determined by previous clustering step. The plots provide visual confirmation that the datasets are well aligned and the clusters are consistent with the shape of the data as revealed by UMAP.

The two subplots can individually be generated with plotDatasetDimRed() and plotClusterDimRed(), respectively.

options(ligerDotSize = 0.5)
plotByDatasetAndCluster(bmmcLiger)

8. Differential expression

LIGER employs the Wilcoxon rank-sum test to identify marker genes that are differentially expressed in each cell type using the following settings. We provide parameters that allow the user to select which datasets to use (useDatasets) and whether to compare across clusters or across datasets within each cluster (method with options "clusters" or "datasets"). To identify marker genes for each cluster combining scATAC and scRNA profiles, typing in:

marker.cluster <- runMarkerDEG(bmmcLiger)

The number of significant genes identified by runMarkerDEG() varies and depends on the datasets used. And the raw output of the function contains the statistics of all tested genes in all groups (clusters). In order to pick out the top markers for each cluster, we strongly suggest using package “dplyr”, which provides a user-friendly interface for data table manipulation. The following code chunk first filters the markers which are statistically and biologically significant. For example, we filter the output by taking markers which have padj (Benjamini-Hochberg adjusted p-value) less than 0.05 and logFC (log fold change between observations in group versus out) larger than 3. Then for each cluster, we sort the markers primarily by its padj value in ascending order. Given that mathematically, the lowest padj values are rounded to 0 as they are too small, for genes tying on this metric, we then sort the markers by logFC in descending order. Finally, we select the top 20 markers for each cluster.

library(dplyr)
marker.cluster <- marker.cluster %>%
    filter(padj < 0.05, logFC > 3) %>%
    group_by(group) %>%
    arrange(padj, -logFC, .by_group = TRUE) %>%
    top_n(20)

We can then view the selected top 20 markers for cluster 1 by:

marker.cluster %>% filter(group == 3)
## # A tibble: 11 × 7
## # Groups:   group [1]
##    feature   group logFC     pval     padj pct_in pct_out
##    <chr>     <fct> <dbl>    <dbl>    <dbl>  <dbl>   <dbl>
##  1 PRTN3     3      9.39 1.42e-13 4.00e-10  45.2     1.89
##  2 ELANE     3      8.85 1.51e-12 2.85e- 9  56.5     2.05
##  3 AZU1      3      7.44 3.02e- 9 2.84e- 6  76.4     4.32
##  4 CTSG      3      6.77 1.54e- 8 1.04e- 5  61.3     3.17
##  5 SERPINB10 3      3.71 3.41e- 8 1.99e- 5  23.6     1.87
##  6 MPO       3      6.85 4.10e- 7 1.31e- 4  70.9     7.57
##  7 RNASE3    3      5.15 1.17e- 6 3.01e- 4  41.6     1.33
##  8 MS4A3     3      4.99 2.37e- 6 4.90e- 4  53.5     1.45
##  9 CLEC10A   3      3.57 4.43e- 5 4.70e- 3   7.87    1.78
## 10 CLEC11A   3      3.60 5.12e- 4 2.74e- 2  57.6    11.7 
## 11 RNASE2    3      3.66 1.03e- 3 4.47e- 2  90.6    13.5

We also provide functions to check these markers by visualizing their expression and gene loadings across datasets. You can use the plotGeneDimRed() to visualize the expression or accessibility of a marker gene, which is helpful for visually confirming putative marker genes or investigating the distribution of known markers across the cell sequenced. Such plots can also confirm that divergent datasets are properly aligned.

For instance, we can plot S100A9, which the Wilcoxon test identified as a marker for Cluster 1, and MS4A1, a marker for Cluster 4:

plots <- plotGeneDimRed(bmmcLiger, c("S100A9", "MS4A1"), splitBy = "dataset",
                        titles = c(names(bmmcLiger), names(bmmcLiger)))
cowplot::plot_grid(plotlist = plots, nrow = 2)

These plots indicate that S100A9 and MS4A1 are indeed specific markers for Cluster 1 and Cluster 4, respectively, with high values in these cell groups and low values elsewhere. Furthermore, we can see that the distributions are strikingly similar between the RNA and ATAC datasets, indicating that LIGER has properly aligned the two data types.

9. Interpret the factors

A key advantage of using iNMF instead of other dimensionality reduction approaches such as PCA is that the dimensions (factors) are individually interpretable. For example, a particular cell type is often captured by a single dimension of the space. Furthermore, iNMF identifies both shared and dataset-specific features along each dimension, giving insight into exactly how corresponding cells across datasets are both similar and different. Too visualize this information, users need to run getFactorMarkers() first in order to have the statistics prepared for ranking the factor loading. The function plotGeneLoadings() then creates visualization for the exploration. For example, we can visualize the factor loading of Factor 7 typing in:

factorMarker <- getFactorMarkers(bmmcLiger, dataset1 = "atac", dataset2 = "rna")
plotGeneLoadings(bmmcLiger, markerTable = factorMarker, useFactor = 12, nLabel = 15)

plots <- plotGeneDimRed(bmmcLiger, c("CCR6", "NCF1"), splitBy = "dataset",
                        titles = c(names(bmmcLiger), names(bmmcLiger)))
cowplot::plot_grid(plotlist = plots, nrow = 2)

These plots confirm that the expression and accessibility of these genes show clear differences. CCR6 shows nearly ubiquitous chromatin accessibility but is expressed only in clusters 2 and 4. The accessibility is highest in these clusters, but the ubiquitous accessibility suggests that the expression of CCR6 is somewhat decoupled from its accessibility, likely regulated by other factors. Conversely, NCF1 shows high expression in clusters 1, 6, 9, 10, 12, 14 and 16, despite no clear enrichment in chromatin accessibility within these clusters. This may again indicate decoupling between the expression and chromatin accessibility of NCF1. Another possibility is that the difference is due to technical effects–the gene body of NCF1 is short (~15KB), and short genes are more difficult to capture in scATAC-seq than in scRNA-seq because there are few sites for the ATAC-seq transposon to insert.

10. Inferring linkage between ATAC and RNA data

Single-cell measurements of chromatin accessibility and gene expression provide an unprecedented opportunity to investigate epigenetic regulation of gene expression. Ideally, such investigation would leverage paired ATAC-seq and RNA-seq from the same cells, but such simultaneous measurements are not generally available. However, using LIGER, it is possible to computationally infer “pseudo-multi-omic” profiles by linking scRNA-seq profiles–using the jointly inferred iNMF factors–to the most similar scATAC-seq profiles. After this imputation step, we can perform downstream analyses as if we had true single-cell multi-omic profiles. For example, we can identify putative enhancers by correlating the expression of a gene with the accessibility of neighboring intergenic peaks across the whole set of single cells.

You can also expand the following tutorial to start from the beginning.

Detailed CellRanger peak count preprocessing

To achieve this, we first need a matrix of accessibility counts within intergenic peaks. The CellRanger pipeline for scATAC-seq outputs such a matrix by default, so we will use this as our starting point. The count matrix, peak genomic coordinates, and source cell barcodes output by CellRanger are stored in a folder named filtered_peak_matrix/ in the output directory. The user can load these and convert them into a peak-level count matrix by typing these commands:

peak <- read10XATAC("/path/to/filtered_peak_barcode_matrix", sampleNames = "atac")

The peak-level count matrix is usually large, containing hundreds of thousands of peaks. We next filter this set of peaks to identify those showing cell-type-specific accessibility. To do this, we perform the Wilcoxon rank-sum test and pick those peaks which are differentially accessible within a specific cluster. Before running the test, however, we need to make sure:

  1. The peak-level count matrix includes the same cells as the gene-level counts matrix
  2. Peak count matrix is normalized to sum to 1 within each cell.
if (!file.exists("liger_BMMC_atac_D5T1_peak.rds"))
    download.file("https://figshare.com/ndownloader/files/40054864",
                  destfile = "liger_BMMC_atac_D5T1_peak.rds")
D5T1.peak <- readRDS("liger_BMMC_atac_D5T1_peak.rds")

rawPeak(bmmcLiger, "atac") <- D5T1.peak
bmmcLiger <- normalizePeak(bmmcLiger)

Recall that we set modal argument when intiating the object with createLiger(). This creates “ligerATACDataset” class object as the dataset-specific container for the scATAC data. Only in this way can we insert the peak count matrix to its designated slot with rawPeak<-() method.

Now we can perform the Wilcoxon test on the peak counts with setting usePeak = TRUE:

peak.wilcoxon <- runMarkerDEG(bmmcLiger, useDatasets = "atac", usePeak = TRUE)

We can now use the results of the Wilcoxon test to retain only peaks showing differential accessibility across our set of joint clusters. Here we kept peaks with Benjamini-Hochberg adjusted p-value < 0.05 and log fold change > 2.

peak.wilcoxon <- peak.wilcoxon %>% filter(padj < 0.05, logFC > 2)
peaks.sel <- unique(peak.wilcoxon$feature)
rawPeak(bmmcLiger, "atac") <- rawPeak(bmmcLiger, "atac")[peaks.sel,]
bmmcLiger <- normalizePeak(bmmcLiger)

Using this set of differentially accessible peaks, we now impute a set of “pseudo-multi-omic” profiles by inferring the intergenic peak accessibility for scRNA-seq profiles based on their nearest neighbors in the joint LIGER space. LIGER provides a function named imputeKNN() that performs this task, yielding a set of profiles containing both gene expression and chromatin accessibility measurements for the same single cells:

bmmcLiger <- imputeKNN(bmmcLiger, reference = 'atac', queries = "rna")

Under the hook, imputeKNN() converts the dataset-specific container object for scRNA-seq data to “ligerATACDataset” class, which allows storing the predicted chromatin accessibility values while retaining the gene expression.

Old versions of LIGER worked in a way that the predicted accessibility value occupies the space where the original gene expression is stored. This usually led to the creation of a new object when running the imputation. Now both types of features are allowed to exist together, so users do not need to create a new object anymore.

Now that we have both the (imputed) peak-level counts matrix and the (observed) gene expression counts matrix for the same cells, we can evaluate the relationships between pairs of genes and peaks, linking genes to putative regulatory elements. We use a simple strategy to identify such gene-peak links: Calculate correlation between gene expression and peak accessibility of all peaks within 500 KB of a gene, then retain all peaks showing statistically significant correlation with the gene. The linkGenesAndPeaks() function performs this analysis:

if (!file.exists("hg19_genes.bed"))
    download.file("https://figshare.com/ndownloader/files/40054870",
                  destfile = "hg19_genes.bed")

regnet <- linkGenesAndPeaks(bmmcLiger, useDataset = "rna", pathToCoords = "hg19_genes.bed", method = "spearman", alpha = 0.05)

The output of this function is a sparse matrix with peak names as rows and gene symbols as columns, with each element indicating the correlation between peak i and gene j. The value would be 0 if the corresponding gene and peak are not significantly linked. For example, we can subset the results for marker gene S100A9, which is highly expressed in cluster 6, 8, 9, 10 and 12:

S100A9 <- regnet[, 'S100A9']
S100A9 <- S100A9[abs(S100A9) > 0]
S100A9[order(abs(S100A9), decreasing = TRUE)]

We also provide a function to transform the peaks-gene correlation matrix into an Interact Track supported by UCSC Genome Browser for visualizing the calculated linkage between genes and correlated peaks. To do this, tying in:

exportInteractTrack(regnet, useGenes = "S100A9", pathToCoords = "hg19_genes.bed")

The output of this function will be a UCSC Interact Track file named ‘Interact_Track.bed’ containing linkage information of the specified genes and correlated peaks stored in given directory. The user can then upload this file as a custom track using this page https://genome.ucsc.edu/cgi-bin/hgCustom and display it in the UCSC Genome browser.

As an example, the three peaks most correlated to S100A9 expression are shown below in the UCSC genome browser. One of the peaks overlaps with the TSS of S100A8, a neighboring gene that is co-expressed with S100A9, while another peak overlaps with the TSS of S100A9 itself. The last peak, chr1:153358896-153359396, does not overlap with a gene body and shows strong H3K27 acetylation across ENCODE cell lines, indicating that this is likely an intergenic regulatory element.

If we plot the accessibility of this peak and the expression of S100A9, we can see that the two are indeed very correlated and show strong enrichment in clusters 1 and 3. Thus, the intergenic peak likely serves as a cell-type-specific regulator of S100A9.

S100A9 <- plotGeneDimRed(bmmcLiger, "S100A9", splitBy = "dataset")
peak1 <- plotPeakDimRed(bmmcLiger, "chr1:153358896-153359396")
cowplot::plot_grid(peak1, S100A9$S100A9.rna, nrow = 2, align = "v", axis = "lr")