Publication

*co-first authors, **co-corresponding authors

Preprints

P2. IMPASTO: Multiplexed cyclic imaging without signal removal via self-supervised neural unmixing

H. Kim*, S. Bae*, J. Cho, H.-Y. Nam, J. Seo, S. Han, E. Yi, E. Kim, Y.-G. Yoon**, J.-B. Chang**

bioRxiv, 2022. 

with Prof. Jae-Byum Chang's group @ KAIST
[Publisher Link] ​​​[bioRxiv Link]


TL;DR: We report a strategy that enables ultra-multiplexed imaging of biomolecules through erasureless cyclic imaging and blind neural unmixing.

Abstract

Spatially resolved proteomics requires a highly multiplexed imaging modality. Cyclic imaging techniques, which repeat staining, imaging, and signal erasure, have been adopted for this purpose. However, due to tissue distortion, it is challenging to obtain high fluorescent signal intensities and complete signal erasure in thick tissue with cyclic imaging techniques. Here, we propose an erasureless cyclic imaging method named IMPASTO. In IMPASTO, specimens are iteratively stained and imaged without signal erasure. Then, images from two consecutive rounds are unmixed to retrieve the images of single proteins through self-supervised machine learning without any prior training. Using IMPASTO, we demonstrate 30-plex imaging from brain slices in 10 rounds, and when used in combination with spectral unmixing, in five rounds. We show that IMPASTO causes negligible tissue distortion and demonstrate 3D multiplexed imaging of brain slices. Further, we show that IMPASTO can shorten the signal removal processes of existing cyclic imaging techniques.

P1. Nanoscale resolution imaging of the whole mouse embryos and larval zebrafish using expansion microscopy

J. Sim*, C. E Park*, I. Cho*, K. Min, M. Eom, S. Han, H. Jeon, H.-J. Cho, E.-S. Cho, A. Kumar, Y. Chong, J. S. Kang, K. D. Piatkevich, E. E. Jung, D.-S. Kang, S.-K. Kwon, J. Kim, K.-J. Yoon, J.-S. Lee, E. S. Boyden, Y.-G. Yoon**, J.-B. Chang**

bioRxiv, 2022. 

with Prof. Jae-Byum Chang's group @ KAIST
[Publisher Link] ​​​[bioRxiv Link]


TL;DR: We report an expansion miscroscopy method that enables super-resolution imaging of entire vertebrate bodies through decalcification and digestion kinetic matching.

Abstract

Nanoscale resolution imaging of whole vertebrates is required for a systematic understanding of human diseases, but this has yet to be realized. Expansion microscopy (ExM) is an attractive option for achieving this goal, but the expansion of whole vertebrates has not been demonstrated due to the difficulty of expanding hard body components. Here, we demonstrate whole-body ExM, which enables nanoscale resolution imaging of anatomical structures, proteins, and endogenous fluorescent proteins (FPs) of whole zebrafish larvae and mouse embryos by expanding them fourfold. We first show that post-digestion decalcification and digestion kinetics matching are critical steps in the expansion of whole vertebrates. Then, whole-body ExM is combined with the improved pan-protein labeling approach to demonstrate the three-dimensional super-resolution imaging of antibody- or FP-labeled structures and all major anatomical structures surrounding them. We also show that whole-body ExM enables visualization of the nanoscale details of neuronal structures across the entire body.

Journal & Conference

J7. Statistically unbiased prediction enables accurate denoising of voltage imaging data

M. Eom*, S. Han*, P. Park*, G. Kim, E.-S. Cho, J. Sim, K.-H. Lee, S. Kim, H. Tian, U. L. Böhm, E. Lowet, H. Tseng, J. Choi, S. E. Lucia, S. H. Ryu, M. Rózsa, S. Chang, P. Kim, X. Han, K. D. Piatkevich, M. Choi, C.-H. Kim, A. E. Cohen, J.-B. Chang, Y.-G. Yoon

Nature Methods, 2023

with Prof. Jae-Byum Chang's group @ KAIST, Prof. Adam Cohen's group @ Havard University, Prof. Cheol-Hee Kim's group @ CNU, Prof. Myunghwan Choi's group @ SNU, Prof. Kiryl Piatkevich's group @ Westlake University, Prof. Xue Han's group @ Boston University, Prof. Pilhan Kim's group @ KAIST, Prof. Sunghoe Chang's group @ SNU
[Publisher Link] ​​​[bioRxiv Link] [Github Link] [Nature Communities] [Peer Review] [KAIST News] [KAIST Breakthrough Article


TL;DR: We report a self-supervised learning algorithm that learns and utilizes spatiotemporal dependence among pixel values for denoising voltage imaging data as well as a wide-range of microscopy images.

Abstract

Here we report SUPPORT (Statistically Unbiased Prediction utilizing sPatiOtempoRal information in imaging daTa), a self-supervised learning method for removing Poisson-Gaussian noise in voltage imaging data. SUPPORT is based on the insight that a pixel value in voltage imaging data is highly dependent on its spatially neighboring pixels in the same time frame, even when its temporally adjacent frames do not provide useful information for statistical prediction. Such spatiotemporal dependency is captured and utilized to accurately denoise voltage imaging data in which the existence of the action potential in a time frame cannot be inferred by the information in other frames. Through simulation and experiments, we show that SUPPORT enables precise denoising of voltage imaging data while preserving the underlying dynamics in the scene.

J6. In vivo whole-brain imaging of zebrafish larvae using three-dimensional fluorescence microscopy

E.-S. Cho, S. Han, G. Kim, M. Eom, K.-H. Lee, C.-H. Kim, Y.-G. Yoon

Journal of Visualized Experiments (JoVE), 2023. 

with Prof. Cheol-Hee Kim's group @ CNU
[Publisher Link] [Video Protocol] [Github Link]


TL;DR: We report an effective and reproducible video protocol for whole-brain imaging of larval zebrafish using three-dimensional fluorescence microscopy.

Abstract

As a vertebrate model animal, larval zebrafish are widely used in neuroscience and provide a unique opportunity to monitor whole-brain activity at the cellular resolution. Here, we provide an optimized protocol for performing whole-brain imaging of larval zebrafish using three-dimensional fluorescence microscopy, including sample preparation and immobilization, sample embedding, image acquisition, and visualization after imaging. The current protocol enables in vivo imaging of the structure and neuronal activity of a larval zebrafish brain at a cellular resolution for over 1 h using confocal microscopy and custom-designed fluorescence microscopy. The critical steps in the protocol are also discussed, including sample mounting and positioning, preventing bubble formation and dust in the agarose gel, and avoiding motion in images caused by incomplete solidification of the agarose gel and paralyzation of the fish. The protocol has been validated and confirmed in multiple settings. This protocol can be easily adapted for imaging other organs of a larval zebrafish.

C4. Robust and efficient alignment of calcium imaging data through simultaneous low rank and sparse decomposition

J. Cho*, S. Han*, E.-S. Cho, K. Shin, Y.-G. Yoon

IEEE/CVF Winter Conference on Applications of Computer Vision (WACV), 2023. 

with Prof. Kijung Shin's group @ KAIST
[Publisher Link] [Github Link]


TL;DR: We report a batch image alignment algorithm with robustness to the difference among the images based on differentiable low rank and sparse decomposition.

Abstract

Accurate alignment of calcium imaging data, which is critical for the extraction of neuronal activity signals, is often hindered by the image noise and the neuronal activity itself. To address the problem, we propose an algorithm named REALS for robust and efficient batch image alignment through simultaneous transformation and low rank and sparse decomposition. REALS is constructed upon our finding that the low rank subspace can be recovered via linear projection, which allows us to perform simultaneous image alignment and decomposition with gradient-based updates. REALS achieves orders-of-magnitude improvement in terms of accuracy and speed compared to the state-of-the-art robust image alignment algorithms.

C3. Inducing functions through reinforcement learning without task specification

J. Cho, D.-H. Lee, Y.-G. Yoon

Neural Information Processing Systems Workshop (NeurIPS Workshop) on Deep Reinforcement Learning, 2022.

with Prof. Dong-Hwan Lee's group @ KAIST
[Publisher Link] ​[arXiv Link] [Github Link]


TL;DR: We report a bio-inspired framework for training a neural network via reinforcement learning to induce high level functions within the network without task specification.

Abstract

We report a bio-inspired approach for training a neural network through reinforcement learning to induce high level functions within the network. Based on the interpretation that animals have gained their cognitive functions such as object recognition — without ever being specifically trained for — as a result of maximizing their fitness to the environment, we place our agent in a custom environment where developing certain functions may facilitate decision making; the custom environment is designed as a partially observable Markov decision process in which an input image and the initial value of hidden variables are given to the agent at each time step. We show that our agent, which consists of a convolutional neural network, a recurrent neural network, and a multilayer perceptron, learns to classify the input image and to predict the hidden variables. The experimental results show that high level functions, such as image classification and hidden variable estimation, can be naturally and simultaneously induced without any pre-training or specifying them.

J5. Three-dimensional fluorescence microscopy through virtual refocusing using a recursive light propagation network

C. Shin*, H. Ryu*, E.-S. Cho, S. Han, K.-H. Lee, C.-H. Kim, Y.-G. Yoon 

Medical Image Analysis, 2022.

with Prof. Cheol-Hee Kim's group @ CNU

[Publisher Link] [Github Link]


TL;DR: We report a fast 3-D microscopy method that employs a virtual refocusinig network and a self-supervised denoising method. Training the virtual refocusing network is facilitated by architecturally enforcing it to follow the law of physics.

Abstract

Three-dimensional fluorescence microscopy has an intrinsic performance limit set by the number of photons that can be collected from the sample in a given time interval. Here, we extend our earlier work – a recursive light propagation network (RLP-Net) – which is a computational microscopy technique that overcomes such limitations through virtual refocusing that enables volume reconstruction from two adjacent 2-D wide-field fluorescence images. RLP-Net employs a recursive inference scheme in which the network progressively predicts the subsequent planes along the axial direction. This recursive inference scheme reflects that the law of physics for the light propagation remains spatially invariant and therefore a fixed function (i.e., a neural network) for a short distance light propagation can be recursively applied for a longer distance light propagation. In addition, we employ a self-supervised denoising method to enable accurate virtual light propagation over a long distance. We demonstrate the capability of our method through high-speed volumetric imaging of neuronal activity of a live zebrafish brain. The source code used in the paper is available at https://github.com/NICALab/rlpnet.

J4. PICASSO allows ultra-multiplexed fluorescence imaging of spatially overlapping proteins without reference spectra measurements

J. Seo*, Y. Sim*, J. W. Kim*, H. Kim, I. Cho, H. Nam, Y.-G. Yoon**, J.-B. Chang** 

Nature Communications, 2022. 

with Prof. Jae-Byum Chang's group @ KAIST
[Publisher Link] ​[bioRxiv Link] [Github Link] [Supplementary Software] [Nature Portfolio] [Nature Communications Comments] [KAIST Breakthrough Article]  [KAIST News]


TL;DR: We report a strategy for ultra-multiplexed imaging of biomolecules based on our blind unmixing algorithm that minimizes the mutual information between the images.

Abstract

Ultra-multiplexed fluorescence imaging requires the use of spectrally overlapping fluorophores to label proteins and then to unmix the images of the fluorophores. However, doing this remains a challenge, especially in highly heterogeneous specimens, such as the brain, owing to the high degree of variation in the emission spectra of fluorophores in such specimens. Here, we propose PICASSO, which enables more than 15-color imaging of spatially overlapping proteins in a single imaging round without using any reference emission spectra. PICASSO requires an equal number of images and fluorophores, which enables such advanced multiplexed imaging, even with bandpass filter-based microscopy. We show that PICASSO can be used to achieve strong multiplexing capability in diverse applications. By combining PICASSO with cyclic immunofluorescence staining, we achieve 45-color imaging of the mouse brain in three cycles. PICASSO provides a tool for multiplexed imaging with high accessibility and accuracy for a broad range of researchers.

J3. 3DM: Deep decomposition and deconvolution microscopy for rapid neural activity imaging

E.-S. Cho*, S. Han*, K.-H. Lee, C.-H. Kim, Y.-G. Yoon 

Optics Express, 2021. (highlighted as Editors' Pick, featured as Image of the Week on the main webpage of Optica publishing group)

with Prof. Cheol-Hee Kim's group @ CNU
[Publisher Link] [Github Link]


TL;DR: We report a fast 3-D microscopy method for imaging neuronal activity by combining a fast axial scanning method, a self-supervised network that performs robust PCA, and a deconvolution network.

Abstract

We report the development of deep decomposition and deconvolution microscopy (3DM), a computational microscopy method for the volumetric imaging of neural activity. 3DM overcomes the major challenge of deconvolution microscopy, the ill-posed inverse problem. We take advantage of the temporal sparsity of neural activity to reformulate and solve the inverse problem using two neural networks which perform sparse decomposition and deconvolution. We demonstrate the capability of 3DM via in vivo imaging of the neural activity of a whole larval zebrafish brain with a field of view of 1040 µm × 400 µm × 235 µm and with estimated lateral and axial resolutions of 1.7 µm and 5.4 µm, respectively, at imaging rates of up to 4.2 volumes per second.

C2. Efficient neural network approximation of robust PCA for automated analysis of calcium imaging data

S. Han, E.-S. Cho, I. Park, K. Shin, Y.-G. Yoon

International Conference on Medical Image Computing and Computer Assisted Intervention (MICCAI), 2021. 

with Prof. Kijung Shin's group @ KAIST
[Publisher Link] ​[arXiv Link] [Github Link]


TL;DR: We report a robust PCA algorithm that is orders of magnitude faster than existing alternatives. 

Abstract

Calcium imaging is an essential tool to study the activity of neuronal populations. However, the high level of background fluorescence in images hinders the accurate identification of neurons and the extraction of neuronal activities. While robust principal component analysis (RPCA) is a promising method that can decompose the foreground and background in such images, its computational complexity and memory requirement are prohibitively high to process large-scale calcium imaging data. Here, we propose BEAR, a simple bilinear neural network for the efficient approximation of RPCA which achieves an order of magnitude speed improvement with GPU acceleration compared to the conventional RPCA algorithms. In addition, we show that BEAR can perform foreground-background separation of calcium imaging data as large as tens of gigabytes. We also demonstrate that two BEARs can be cascaded to perform simultaneous RPCA and non-negative matrix factorization for the automated extraction of spatial and temporal footprints from calcium imaging data. The source code used in the paper is available at https://github.com/NICALab/BEAR.

C1. RLP-Net: A recursive light propagation network for 3-D virtual refocusing

C. Shin*, H. Ryu*, E.-S. Cho, Y.-G. Yoon 

International Conference on Medical Image Computing and Computer Assisted Intervention (MICCAI), 2021. (selected for MICCAI Young Scientist Award, MICCAI Student Travel Award, and oral presentation)
[Publisher Link] [Github Link]


TL;DR: We report a learning-based algorithm that allows us to change the focus of microscopy images posterior to image acquisition. The network architecture ensures that it follows the law of physics which enables accurate refocusing.

Abstract

High-speed optical 3-D fluorescence microscopy is an essential tool for capturing the rapid dynamics of biological systems such as cellular signaling and complex movements. Designing such an optical system is constrained by the inherent trade-off among resolution, speed, and noise which comes from the limited number of photons that can be collected. In this paper, we propose a recursive light propagation network (RLP-Net) that infers the 3-D volume from two adjacent 2-D wide-field fluorescence images via virtual refocusing. Specifically, we propose a recursive inference scheme in which the network progressively predicts the subsequent planes along the axial direction. This recursive inference scheme reflects that the law of physics for the light propagation remains spatially invariant and therefore a fixed function (i.e., a neural network) for a short distance light propagation can be recursively applied for a longer distance light propagation. Experimental results show that the proposed method can faithfully reconstruct the 3-D volume from two planes in terms of both quantitative measures and visual quality. The source code used in the paper is available at https://github.com/NICALab/rlpnet.

J2. Sparse decomposition light-field microscopy for high speed imaging of neuronal activity

Y-.G. Yoon*, Z. Wang*, N. Pak, D. Park, P. Dai, J. S. Kang, H-.J. Suk, P. Symvoulidis, B. Guner-Ataman, K. Wang**, E. S. Boyden**

Optica, 2020. 

with Prof. Ed Boyden's group @ MIT

[Publisher Link]


TL;DR: We report a microscopy method for high-resolution light-field imaging of neuronal activity, which is enabled by sparsifying the data through low rank and sparse decomposition prior to the volume reconstruction. 

Abstract

One of the major challenges in large scale optical imaging of neuronal activity is to simultaneously achieve sufficient temporal and spatial resolution across a large volume. Here, we introduce sparse decomposition light-field microscopy (SDLFM), a computational imaging technique based on light-field microscopy (LFM) that takes algorithmic advantage of the high temporal resolution of LFM and the inherent temporal sparsity of spikes to improve effective spatial resolution and signal-to-noise ratios (SNRs). With increased effective spatial resolution and SNRs, neuronal activity at the single-cell level can be recovered over a large volume. We demonstrate the single-cell imaging capability of SDLFM with in vivo imaging of neuronal activity of whole brains of larval zebrafish with estimated lateral and axial resolutions of ∼3.5µm and ∼7.4µm, respectively, acquired at volumetric imaging rates up to 50 Hz. We also show that SDLFM increases the quality of neural imaging in adult fruit flies.

J1. Precision calcium imaging of dense neural populations via a cell-body-targeted calcium indicator

O. A. Shemesh, C. Linghu, K. D. Piatkevich, D. Goodwin, O. T. Celiker, H. J. Gritton, M. F. Romano, R. Gao, C-.C Yu, H-.A. Tseng, S. Bensussen, S. Narayan, C-.T. Yang, L. Freifeld, C. A. Siciliano, I. Gupta, J. Wang, N. Pak, Y-.G. Yoon, J. F.P. Yllmann, B. Guner-Ataman, H. Noamany, Z. R. Sheinkopf, W. M. Park, S. Asano, A. E. Keating, J. S. Trimmer, J. Reimer, A. S. Tolias, M. F. Bear, K. M. Tye, X. Han, M. B. Ahrens, E. S. Boyden

Neuron, 2020.

with Prof. Ed Boyden's group @ MIT

[Publisher Link]


TL;DR: We report a method that enables targeted expression of calcium indicators in the cell body for reducing neuropil crosstalk.

Abstract

Methods for one-photon fluorescent imaging of calcium dynamics can capture the activity of hundreds of neurons across large fields of view at a low equipment complexity and cost. In contrast to two-photon methods, however, one-photon methods suffer from higher levels of crosstalk from neuropil, resulting in a decreased signal-to-noise ratio and artifactual correlations of neural activity. We address this problem by engineering cell-body-targeted variants of the fluorescent calcium indicators GCaMP6f and GCaMP7f. We screened fusions of GCaMP to natural, as well as artificial, peptides and identified fusions that localized GCaMP to within 50 μm of the cell body of neurons in mice and larval zebrafish. One-photon imaging of soma-targeted GCaMP in dense neural circuits reported fewer artifactual spikes from neuropil, an increased signal-to-noise ratio, and decreased artifactual correlation across neurons. Thus, soma-targeting of fluorescent calcium indicators facilitates usage of simple, powerful, one-photon methods for imaging neural calcium dynamics.

Journal (before joining KAIST)

7. Robotic multidimensional directed evolution of proteins: development and application to fluorescent voltage reporters

K. D. Piatkevich, E. E. Jung, C. Straub, C. Linghu, D. Park, H.-J. Suk, D. R. Hochbaum, D. Goodwin, E. Pnevmatikakis, N. Pak, C.-T. Yang, J. L. Rhoades, O. Shemesh, S. Asano, Y.-G. Yoon, L. Freifeld, J. Saulnier, C. Riegler, F. Engert, T. Hughes, M. Drobizhev, B. Szabo, M. B. Ahrens, S. W. Flavell, B. L. Sabatini, E. S. Boyden

Nature Chemical Biology, 2018.

[Publisher Link]


TL;DR: We report a strategy for designing a fluorescence protein with desired properties through directed evolution. The resulting voltage indicator Archon achieves high brightness and sensitivity.

Abstract

We developed a new way to engineer complex proteins toward multidimensional specifications using a simple, yet scalable, directed evolution strategy. By robotically picking mammalian cells that were identified, under a microscope, as expressing proteins that simultaneously exhibit several specific properties, we can screen hundreds of thousands of proteins in a library in just a few hours, evaluating each along multiple performance axes. To demonstrate the power of this approach, we created a genetically encoded fluorescent voltage indicator, simultaneously optimizing its brightness and membrane localization using our microscopy-guided cell-picking strategy. We produced the high-performance opsin-based fluorescent voltage reporter Archon1 and demonstrated its utility by imaging spiking and millivolt-scale subthreshold and synaptic activity in acute mouse brain slices and in larval zebrafish in vivo. We also measured postsynaptic responses downstream of optogenetically controlled neurons in C. elegans.

6. Feasibility of 3D reconstruction of neural circuits using expansion microscopy and barcode-guided agglomeration

Y.-G. Yoon, P. Dai, J. Wohlwend, J.-B. Chang, A. H. Marblestone**, E. S. Boyden**

Front. Comput. Neurosci., 2017

[Publisher Link]


TL;DR: We report a simulation study on an automated approach to algorithmic reconstruction of dense neural morphology utilizing expansion microscopy, RNA barcoding, and machine learning.

Abstract

We here introduce and study the properties, via computer simulation, of a candidate automated approach to algorithmic reconstruction of dense neural morphology, based on simulated data of the kind that would be obtained via two emerging molecular technologies—expansion microscopy (ExM) and in-situmolecular barcoding. We utilize a convolutional neural network to detect neuronal boundaries from protein-tagged plasma membrane images obtained via ExM, as well as a subsequent supervoxel-merging pipeline guided by optical readout of information-rich, cell-specific nucleic acid barcodes. We attempt to use conservative imaging and labeling parameters, with the goal of establishing a baseline case that points to the potential feasibility of optical circuit reconstruction, leaving open the possibility of higher-performance labeling technologies and algorithms. We find that, even with these conservative assumptions, an all-optical approach to dense neural morphology reconstruction may be possible via the proposed algorithmic framework. Future work should explore both the design-space of chemical labels and barcodes, as well as algorithms, to ultimately enable routine, high-performance optical circuit reconstruction.

5. Iterative expansion microscopy

J.-B. Chang, F. Chen, Y.-G. Yoon, E. E. Jung, H. Babcock, J. S. Kang, S. Asano, H.-J. Suk, N. Pak, P. W. Tillberg, A. Wassie, D. Cai, E. S. Boyden

Nature Methods, 2017.

[Publisher Link] [Resource website]


TL;DR: We report a super-resolution microscopy method that achieves 20 nm of resolution through iterative expansion of biological specimen.

Abstract

We recently developed a method called expansion microscopy, in which preserved biological specimens are physically magnified by embedding them in a densely crosslinked polyelectrolyte gel, anchoring key labels or biomolecules to the gel, mechanically homogenizing the specimen, and then swelling the gel–specimen composite by ∼4.5× in linear dimension. Here we describe iterative expansion microscopy (iExM), in which a sample is expanded ∼20×. After preliminary expansion a second swellable polymer mesh is formed in the space newly opened up by the first expansion, and the sample is expanded again. iExM expands biological specimens ∼4.5 × 4.5, or ∼20×, and enables ∼25-nm-resolution imaging of cells and tissues on conventional microscopes. We used iExM to visualize synaptic proteins, as well as the detailed architecture of dendritic spines, in mouse brain circuitry.

4. Simultaneous whole-animal 3D imaging of neuronal activity using light-field microscopy

R. Prevedel*, Y.-G. Yoon*, M. Hoffmann, N. Pak, G. Wetzstein, S. Kato, T. Schrödel, R. Raskar, M. Zimmer, E.S. Boyden**, A. Vaziri** 

Nature Methods, 2014.

[Publisher Link] [Resource website] [Supplementary Software]


TL;DR: We report light-field deconvolution microscopy that enbles ultra-fast 3-D imaging of neuronal activity of a whole animal and a whole brain.

Abstract

High-speed, large-scale three-dimensional (3D) imaging of neuronal activity poses a major challenge in neuroscience. Here we demonstrate simultaneous functional imaging of neuronal activity at single-neuron resolution in an entire Caenorhabditis elegans and in larval zebrafish brain. Our technique captures the dynamics of spiking neurons in volumes of ∼700 μm × 700 μm × 200 μm at 20 Hz. Its simplicity makes it an attractive tool for high-speed volumetric calcium imaging.

3. A highly-digital VCO-based analog-to-digital converter using phase interpolator and digital calibration

T.-K. Jang, J. Kim, Y.-G. Yoon, S.H. Cho

IEEE Trans. VLSI, 2012.

[Publisher Link]


TL;DR: We report a time-based ADC architecture with improved resolution that exploits phase-interpolated VCO outputs.

Abstract

A first-order time-based ΔΣ modulator using voltage-controlled oscillator (VCO) is presented. The proposed modulator employs phase interpolation technique to enhance the time resolution of the VCO and digital calibration to improve the linearity of the VCO tuning curve. The proposed modulator, implemented in 0.13 μm CMOS process, achieves 55 dB peak signal-to-noise ratio and 52.5 dB peak signal-to-noise-and-distortion ratio at 600 MHz sampling frequency for 20 MHz input bandwidth and consumes 14.3 mW.

2. Design and analysis of voltage-controlled oscillator-based analog-to-digital converter

J. Kim, T.-K. Jang, Y.-G. Yoon, S.H. Cho

IEEE Trans. Circuits Syst. I, 2010.

[Publisher Link]


TL;DR: We report a theorical study on the performance VCO-based ADC along with the design guideline. 

Abstract

A voltage-controlled oscillator (VCO) based analog-to-digital converter (ADC) is a time-based architecture with a first-order noise-shaping property, which can be implemented using a VCO and digital circuits. This paper analyzes the performance of VCO-based ADCs in the presence of nonidealities such as jitter, nonlinearity, mismatch, and the metastability of D flip-flops. Based on this analysis, design criteria for determining parameters for VCO-based ADCs are described. In addition, a digital calibration technique to enhance the spurious-free dynamic range degraded by the nonlinearity is also introduced. To verify the theoretical analysis, a prototype chip is implemented in a 0.13-μm CMOS process. With a 500-MHz sampling frequency, the prototype achieves a signal-to-noise ratio ranging from 71.8 to 21.3 dB for an input bandwidth of 100 kHz-247 MHz, while dissipating 12.6 mW and occupying an area of 0.078 mm2 .

1. A time-based bandpass ADC using time-interleaved voltage-controlled oscillators

Y.-G. Yoon, J. Kim, T.-K. Jang, S.H. Cho

IEEE Trans. Circuits Syst. I, 2008. (received 2009 IEEE Circuits and Systems Society Guillemon-Cauer Best Paper Award)

[Publisher Link]


TL;DR: We report a time-based ADC architecture that has a band-stop noise shaping property which is ideal for direct RF sampling.

Abstract

In this paper, a bandpass analog-to-digital converter (ADC) based on time-interleaved oversampled ADC is introduced. Unlike previous delta-sigma bandpass ADCs that require accurate digital-to-analog converters and high-speed analog circuits, the proposed architecture provides bandpass function by time-interleaving first-order voltage-controlled-oscillator (VCO)-based ADCs. The use of VCO-based ADC has the advantage that its resolution is determined by the time resolution rather than the voltage resolution, thus making it attractive for future low-voltage CMOS processes. The performance of the proposed ADC is theoretically analyzed and simulated in ideal condition, as well as in nonideal condition, in the presence of nonlinearity, sampling clock jitter, and mismatch.

Conference (before joining KAIST)

14. Sparse decomposition light-field microscopy for high speed 3-D imaging of neuronal activity

Y.-G. Yoon*, Z. Wang*, D. Park, N. Pak, J. Kang, H.-J. Suk, P. Dai, K. Wang, E. S. Boyden 

Society for Neuroscience (SfN), 2018. 

[Abstract Link]


TL;DR: We report a method for high-speed light-field imaging of neuronal activity, which is enabled by sparsifying the data through low rank and sparse decomposition prior to the volume reconstruction. 

Abstract

Light-field microscopy (LFM) can support imaging of the entire C. elegans nervous system and the entire larval zebrafish (Danio rerio) brain at high speeds (Nature Methods (2014) 11:727-730), but the spatial resolution obtained was insufficient to yield single-cell resolution imaging in many contexts, such as in behaving zebrafish larvae. More recently, eXtended field of view LFM (XLFM) (eLife (2017) 6:e28158), which simultaneously optimizes imaging volume and spatial resolution, and avoids square-shaped artifacts near the focal plane by placing the micro-lens array on the pupil plane of the system, was developed to offer better spatial resolution, but separating signals from nearby neurons is still a challenge. Here we introduce sparse decomposition light-field microscopy (SDLFM), a computational imaging technique that further improves the ability of XLFM, and that allows for the imaging of neuronal activity with very high spatiotemporal resolution. With this technique, the spatial resolution can be improved and hence neuronal activity can be accurately recovered, even from nearby neurons. We show the power of SDLFM by demonstrating in vivo imaging of neuronal activity of whole brains of larval zebrafish and adult fruit flies (Drosophila melanogaster) with high volume rates up to 50 Hz. 

13. Robust, millivolt-resolution, high-speed neural voltage imaging in multiple species

K. D. Piatkevich, E. E. Jung, C. Straub, C. Linghu, D. Park, H.-J. Suk, D. R. Hochbaum, D. Goodwin, E. Pnevmatikakis, N. Pak, C.-T. Yang, J. L. Rhoades, O. Shemesh, S. Asano, Y.-G. Yoon, L. Freifeld, J. Saulnier, C. Riegler, F. Engert, T. Hughes, M. Drobizhev, B. Szabo, M. B. Ahrens, S. W. Flavell, B. L. Sabatini, E. S. Boyden

Society for Neuroscience (SfN), 2018. 

[Abstract Link]


TL;DR: We report a strategy for designing a fluorescence protein with desired properties through directed evolution. The resulting voltage indicator Archon achieves high brightness and sensitivity.

Abstract

We developed a new way to engineer complex proteins toward multidimensional specifications using a simple, yet scalable, directed evolution strategy. By robotically picking mammalian cells that were identified, under a microscope, as expressing proteins that simultaneously exhibit several specific properties, we can screen hundreds of thousands of proteins in a library in just a few hours, evaluating each along multiple performance axes. To demonstrate the power of this approach, we created a genetically encoded fluorescent voltage indicator, simultaneously optimizing its brightness and membrane localization using our microscopy-guided cell-picking strategy. We produced the high-performance opsin-based fluorescent voltage reporter Archon1 and demonstrated its utility by imaging spiking and millivolt-scale subthreshold and synaptic activity in acute mouse brain slices and in larval zebrafish in vivo. We also measured postsynaptic responses downstream of optogenetically controlled neurons in C. elegans.

12. Precision calcium imaging of dense neural populations via a cell body-targeted calcium indicator

O. A. Shemesh, C. Linghu, K. D. Piatkevich, D. Goodwin, H. J. Gritton, M. F. Romano, H. Tseng, S. Bensussen, S. Narayan, C.-T. Yang, L. Freifeld, C. Siciliano, I. Gupta, N. Pak, Y.-G. Yoon, J. Ullmann, Z. R. Sheinkopf, W. M. Park, K. Tye, A. E. Keating, J. Reimer, A. Tolias, X. Han, M. B. Ahrens, E. S. Boyden

Society for Neuroscience (SfN), 2018. 

[Abstract Link]


TL;DR: We report a method that enables targeted expression of calcium indicators in the cell body for reducing neuropil crosstalk.

Abstract

Methods for one-photon fluorescent imaging of calcium dynamics in vivo are popular due to their ability to simultaneously capture the dynamics of hundreds of neurons across large fields of view, at a low equipment complexity and cost. In contrast to two-photon methods, however, one-photon methods suffer from higher levels of crosstalk between cell bodies and the surrounding neuropil, resulting in decreased signal-to-noise and artifactual correlations of neural activity. Here we address this problem by engineering cell body-targeted variants of the fluorescent calcium indicator GCaMP6f. We screened fusions of GCaMP6f to both natural as well as engineered peptides, and identified fusions that localized GCaMP6f to within approximately 50 microns of the cell body of neurons in live mice and larval zebrafish. One-photon imaging of soma-targeted GCaMP6f in dense neural circuits in larval zebrafish and in mice reported a decrease in artifactual spikes from neuropil, an increased signal-to-noise ratio, and decreased artifactual correlation across neurons. Thus, soma-targeting of GCaMP may facilitate even greater usage of simple, powerful, one-photon methods of population imaging of neural calcium dynamics.

11. 20-nm resolution imaging of brain circuitry by next-generation expansion microscopy

J.-B. Chang, F. Chen, Y.-G. Yoon, E. Jung, H. Babcock, J. Kang, S. Asano, H.-J. Suk, N. Pak, P. Tillberg, A. Wassie, X. Zhuang, E. S. Boyden

Society for Neuroscience (SfN), 2016.

[Abstract Link]


TL;DR: We report a super-resolution microscopy method that achieves 20 nm of resolution through iterative expansion of biological specimen.

Abstract

Understanding how biomolecules such as proteins are architected in 3-D throughout synapses, neurons, and brain circuits is essential to understanding how such molecular and cellular machines work together to support the operation of normal and diseased neural networks. Earlier, we discovered that biological specimens could be physically magnified by ~4.5-fold by embedding them in a dense swellable polyelectrolyte gel, anchoring key biomolecules to the polymer network, and then adding water to osmotically swell the gel - a process we call ‘expansion microscopy’ (ExM; Science 347(6221):534-548). We are now creating an improved, next-generation form of expansion microscopy, which can expand specimens up to 20-fold, enabling ~20-nm spatial resolution imaging, using conventional optics. Here, we report the optimization and application of this next-generation expansion microscopy to reveal extremely fine structures that make up brain circuits, including components of the synaptic cleft in intact brain circuits, and Brainbow-labeled neural circuits. Given that conventional, diffraction-limited optics can proceed with very high throughput (e.g., in lightsheet microscopy), the organization of brain circuitry can be revealed with nanoscopic precision over large volumes relevant to behavior and disease, using next-generation ExM. We anticipate that large-volume nanoscopic imaging via next-generation expansion microscopy, because it does not require any special hardware, may support widescale and democratized investigation of the molecular configurations of brain circuits.

10. Sparse reconstruction light-field microscopy for high-resolution 3D-imaging of neuronal activity

Y.-G. Yoon*, N. Pak*, L. Freifeld*, M. A. Henninger, J. Deguchi, N. Savidis, E. S. Boyden 

Society for Neuroscience (SfN), 2015. 

[Abstract Link]


TL;DR: We report a strategy for high-resolution light-field imaging that exploits spatial prior information.

Abstract

We recently developed an approach using light-field microscopy (LFM) to image the entire C. elegans nervous system and the entire zebrafish brain in 3D, at high speeds (e.g., ~20 Hz), possible since no moving parts are required for light-field microscopes to acquire 3-D images (Prevedel et al., 2014). However, the spatial resolution was limited, and the activity of only a subset of the neurons could be extracted as it relied on a computational method based on independent component analysis (ICA) to extract the activity of neurons during post-processing. For ground-truth studies of the nervous system, ideally it would be possible to pick up the activity of all neurons, even those that are quiet during the recording (whereas ICA tends to select for highly active neurons). And, ideally, it would be possible to assign neural activity to defined sites in the circuit, in order to link anatomical and dynamical descriptions of neural circuits. We have developed a novel sparse reconstruction lightfield microscopy (SRLFM) strategy that can, in simulation, accurately reconstruct neural activity throughout the entire brain of the larval zebrafish, expressing a GCaMP variant, with single cell resolution, at up to 100 Hz. No post-processing (e.g., via ICA) is needed with SRLFM, meaning that even quiet neurons can be detected, and also neural activity can be accurately assigned to specific neurons in the neural network, important for linking neural circuit dynamics to the underlying network architecture. The effective resolution of light-field microscopy is improved by >2-fold with our new algorithm. We are currently implementing this algorithm on an optimized light-field microscope, aiming to assess the technology in the context of living brain dynamics. 

9. Imaging from the inside out: a design of an implantable probe for imaging of single-cell physiological dynamics in deep brain tissue at large scales

M. A. Henninger, Y.-G. Yoon, J. Deguchi, J. Scholvin, A. Zorzos, R. Horstmyter, R. Raskar, E. S. Boyden

Society for Neuroscience (SfN), 2014. 

[Abstract Link]


TL;DR: We report a strategy for deep brain imaging based on an implantable light-field sensor.

Abstract

We present the design of a system to image the neural activity of many individual neurons simultaneously, at arbitrary locations in the brain. We use numerical simulations to estimate the proposed system’s performance, and predict how future advances would improve performance. Simulating widely available fluorescent reporters and current CMOS pixel designs, our results indicate that a microprobe shank (e.g., 10 microns thin, 60 microns wide) placed in the cortex could image the activity of many hundreds of neurons. While fluorescent indicators of physiological activity are powerful tools for monitoring brain activity, it remains difficult to use them to image the activity of individual cells at high speeds, especially in deep tissue. We propose a lensless microimager that is thin enough to implant with minimal tissue displacement. An array of such probes can record from many arbitrary sites in the mammalian brain. The system consists of a silicon probe that is densely arrayed with CMOS imaging pixels. On top of the CMOS pixels are a standoff layer, a light-modulating mask layer, and fluorescence emission filters. This probe is implanted in conjunction with an excitation light delivery mechanism--such as a waveguide or optical fiber to excite the fluorescent signal to be recorded. Whereas the lenses in a traditional imager alter the angles of incoming light such that the recorded image contains purely spatial information, our mask causes the imager to collect spatial and angular information, sampling from the 4D light field. The recorded angular information allows us to determine depth information; the imager records a full 3D image every frame. This reduces problems related to out of focal plane light without requiring techniques like confocal or two photon microscopy. While our technique does not allow diffraction-limited resolution, it does allow resolving to within a few microns, which is sufficient to correctly assign fluorescence to its cell of origin in most brain structures. Reconstructing the 3D volume from the recorded image can be cast as a straightforward linear algebra problem. While this problem appears to be underconstrained, there are several techniques for introducing additional information—such as sparsity, knowledge of cell locations, or positive-definiteness—that allow us to constrain the problem to a single valid solution. The end result is an activity trace for each neuron in the probe’s field of view. We characterize the correlation between the fluorescent activity and the probe recording, and find that with full fluorescent labeling in the cortex, a single probe would record hundreds of neurons with over 90% fidelity to the underlying signal.

8. Simultaneous whole-animal 3D imaging of neuronal activity using light-field microscopy

R. Prevedel*, Y.-G. Yoon*, M. Hoffmann, N. Pak, G. Wetzstein, S. Kato, T. Schrödel, R. Raskar, M. Zimmer, E. S. Boyden**, A. Vaziri**

Society for Neuroscience (SfN), 2014. 

[Abstract Link]


TL;DR: We report light-field microscopy that enbles ultra-fast 3-D imaging of neuronal activity of a whole animal and a whole brain.

Abstract

3D functional imaging of neuronal activity of entire organisms at the single cell level and on physiologically relevant time scales poses a major challenge in neuroscience. Here, using light-field microscopy in combination with 3D deconvolution, we demonstrate intrinsically simultaneous volumetric functional imaging of neuronal population activity at single neuron resolution for an entire organism, the nematode Caenorhabditis elegans, at up to 50Hz. This owes to a system-level optimized light field microscope, a fast deconvolution algorithm, and an appropriate genetically-encoded calcium indicator (GECI). This data combined with the full wiring diagram, or connectome, of C. elegans may allow the study of the nervous system at the circuit level in a systematic way. By performing whole-brain imaging of neural activity in larval zebrafish, we demonstrate the ability of our technique to capture dynamics of spiking neurons in volumes of ~700x700x200μm at 20Hz. The optical resolution for this volume is below single neuron resolution, but computational techniques based on independent component analysis enabled us to extract the activity of large numbers of neurons. The simplicity of our technique makes it an attractive tool for high-speed volumetric calcium imaging, and potentially voltage imaging, of neural activities in intact neural networks. 

7. A cepstral analysis based method for quantifying the depth of anesthesia from human EEG

T.-H. Kim, Y.-G. Yoon, J. Uhm, D.-W. Jeong, S. Z. Yoon, S.-H. Park

IEEE International Conference in Medicine and Biology Society (EMBC), 2013.

[Publisher Link]


TL;DR: We report a cepstrum-based algorithm for processing EEG signal for estimation of depth of anesthesia.

Abstract

In this paper, a cepstral analysis based approach to measuring the depth of anesthesia (DoA) is presented. Cepstral analysis is a signal processing technique widely used especially for speech recognition in order to extract speech information regardless of vocal cord characteristics. The resulting index for the DoA is called index based on cepstral analysis (ICep). The Fisher criterion is engaged to evaluate the performance of indices. All analyses are based on a single-channel electroencephalogram (EEG) of 10 human subjects. To validate the proposed technique, ICep is compared with bispectral index (BIS), which is the most commonly used method to estimate the level of consciousness via EEG during general anesthesia. The results show that ICep has high correlation with BIS, and is outstanding in terms of the Fisher criterion and offers faster tracking than BIS in the transition from consciousness to unconsciousness.

6. Monitoring the depth of anesthesia from rat EEG using modified Shannon entropy analysis

Y.-G. Yoon, T.-H. Kim, D.-W. Jeong, S.-H, Park

IEEE International Conference in Medicine and Biology Society (EMBC), 2011.

[Publisher Link]


TL;DR: We report an entropy analysis algorithm for processing EEG signal for estimation of depth of anesthesia.

Abstract

In this paper, an entropy based method for quantifying the depth of anesthesia from rat EEG is presented. The proposed index for the depth of anesthesia called modified Shannon entropy (MShEn) is based on Shannon entropy (ShEn) and spectral entropy (SpEn) which are widely used for analyzing non-stationary signals. Discrimination power (DP), as a performance indicator for indexes, is defined and used to derive the final index for the depth of anesthesia. For experiment, EEG from anesthetized rats are measured and analyzed by using MShEn. MShEn shows both high stability and high correlation with other indexes for depth of anesthesia.

5. A Time-based noise shaping analog-to-digital converter using a gated-ring oscillator

Y.-G. Yoon, S.-H, Park, S. H. Cho

IEEE International Microwave Workshop Series (IMWS) on Intelligent Radio for Future Personal Terminals, 2011.

[Publisher Link]


TL;DR: We report a time-based ADC architecture that achieves high linearity by employing a gated-ring oscillator.

Abstract

In this paper, a time-based analog-to-digital converter (ADC) with first order noise shaping property is presented. The ADC consists of a pulse-width modulator (PWM) and a time-to-digital converter (TDC) based on a gated-ring oscillator. A prototype is designed in 0.18μm CMOS and simulated to verify the concept. The ADC shows high linearity despite the open loop architecture since the linearity does not depend on the frequency tuning characteristic of oscillators unlike conventional noise shaping time-based ADCs. With the sampling frequency of 10MHz, the prototype achieves spurious-free dynamic range (SFDR) and signal-to-noise-and-distortion ratio (SNDR) of 66dB and 56dB, respectively, when the signal bandwidth is 500kHz.

4. A linearization technique for voltage-controlled oscillator-based ADC

Y.-G. Yoon, M.-C. Cho, S.H. Cho

IEEE International SoC Design Conference, 2009.

[Publisher Link]


TL;DR: We report a simple technique for designing a VCO-based ADC with high linearity.

Abstract

In this paper, a linearization technique for voltage-controlled oscillator (VCO)-based analog-to-digital converter (ADC) is presented. Even order harmonics are canceled by using pseudo-differential architecture with two identical VCO-based ADCs. The effect of cancelation technique is verified through simulation with a prototype designed in 0.18μm CMOS technology and verilog. The CMOS ring VCO consumes about 280μW of power in average and the digital counter is implemented in verilog. With the sampling frequency of 100MHz, the prototype achieves signal-to-noise ratio (SNR), spurious-free dynamic range (SFDR) and signal-to-noise-and-distortion ratio (SNDR) of 58.2dB, 60dB and 56.5dB, respectively, when the signal bandwidth is 5MHz. Although the power consumption of the overall ADC is doubled compared to a single channel ADC, the figure-of-merit (FOM) of the ADC is improved by 2.95 times due to the SNDR improvement by linearization technique.

3. Design of highly programmable bio-impedance measurement IC

M.-C. Cho, Y.-G. Yoon, S.H. Cho

IEEE International SoC Design Conference, 2009.

[Publisher Link]


TL;DR: We report a programmable IC design for bio-impedance measurement.

Abstract

In this paper, a highly programmable bio-impedance measurement system for multi-purpose health monitoring application is presented. Complex and area consuming analog components are replaced by a high resolution ADC and digital processing providing lots of flexibility to both designers and users. The prototype of the proposed system architecture is designed in 0.18μm CMOS technology. The tuning range of signal generator is from 10kHz∼10MHz and current variation of voltage-controlled current source (VCCS) is below 1%. The gain, bandwidth, CMRR and input referred noise of instrumentation amplifier (IA) are 18dB, 1.5Hz∼9.5MHz, 96.7dB at 100kHz and 10.3nV/√Hz, respectively. ADC is implemented using pseudo-differential VCO-based architecture. Signal-to-noise ratio (SNR), spurious-free dynamic range (SFDR) and signal-to-noise-and-distortion ratio (SNDR) of ADC are 87.5dB, 60dB and 60dB, respectively. The total power consumption of prototype is 6.7mW.

2. A pulse transit time measurement method based on electrocardiography and bioimpedance

S. Bang, C. Lee, M.-C. Cho, Y.-G. Yoon, S.H. Cho

IEEE Biomedical Circuits and Systems Conference, 2009.

[Publisher Link]


TL;DR: We report a circuit design that enables pulse transit time measurement through simultaneous recording of ECG and bioimpedance.

Abstract

In this paper, a novel pulse transit time (PTT) measurement method which employs electrocardiography and bioimpedance measurement (ECG-BIM) is proposed. Unlike conventional method based on ECG and photoplethysmography (ECG-PPG), the proposed method offers a promising technique for continuous and portable monitoring of cardiovascular diseases, as it requires only electrical components that can be fully integrated in a low-power and low-cost silicon circuit. To verify the validity of the proposed ECG-BIM method, experiments have been conducted on a human body in various conditions, using both the ECG-PPG and the ECG-BIM methods which is implemented using discrete off-the-shelf components. Experimental results show that the PTT data achieved from ECG-PPG and ECG-BIM methods are highly correlated, with correlation coefficient of 0.93, hence indicating the validity of the proposed method which can offer high level of integration and low power consumption for portable continuous cardiovascular signal monitoring. 

1. A 1.5-GHz 63dB SNR 20mW direct RF sampling bandpass VCO-based ADC in 65nm CMOS

Y.-G. Yoon, S.H. Cho

IEEE Symposium on VLSI Circuits, 2009.

[Publisher Link]


TL;DR: We report a VCO-based bandpass ADC design that allows direct digitization RF signal at 1.5-GHz.

Abstract

This paper presents a bandpass ADC which exploits enhanced time-resolution of a deep submicron CMOS process. Unlike conventional bandpass ADCs that rely on voltage resolution and Gm-LC filters, the proposed ADC employs time-interleaved voltage-controlled oscillators that enable frequency tunable bandstop noise shaping property without a feedback loop. The ADC implemented in 65nm CMOS achieves SNR of 63.3dB for 1MHz signal located at 1.5GHz, while consuming 19.6mW from 1.2V supply.