Skip to content

Commit 653b84f

Browse files
author
Thinh Nguyen
committed
added Background section
1 parent 7ab0c2a commit 653b84f

File tree

2 files changed

+89
-3
lines changed

2 files changed

+89
-3
lines changed

Background.md

Lines changed: 83 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,83 @@
1+
# Array Electrophysiology Element
2+
## Description of modality, user population
3+
4+
Neuropixels probes were developed by a collaboration between HHMI Janelia, industry partners, and others (Jun et al., Nature 2017).
5+
Since its initial release in October 2018, 300 labs have ordered 1200 probes.
6+
Since the rollout of Neuropixels 2.0 in October 2020, IMEC has been shipping 100+ probes monthly (correspondence with Tim Harris).
7+
8+
Neuropixels probes offer 960 electrode sites along a 10mm long shank,
9+
with 384 recordable channels per probe that can record hundreds of units spanning multiple brain regions
10+
(Neuropixels 2.0 version is a 4-shank probe with 1280 electrode sites per shank).
11+
Such large recording capacity have offered tremendous opportunities for the field of neurophysiology research,
12+
yet this is accompanied by an equally great challenge in terms of data and computation management.
13+
14+
## Acquisition tools
15+
The typical instrumentation used for data acquisition is the Neuropixels probe and headstage interfacing with a PXIe acquisition module (https://www.neuropixels.org/control-system).
16+
Two main acquisition softwares are used for Neuropixels:
17+
SpikeGLX - developed by Bill Karsh and Tim Harris at HHMI/Janelia
18+
OpenEphys - developed by Joshua Siegle at the Allen Institute.
19+
These save the data into specific directory structure and file-naming convention as custom binary formats (e.g. “.bin”, “.dat”). Meta data are stored as separate files in xml or text format.
20+
21+
## Preprocessing tools
22+
The preprocessing pipeline includes bandpass filtering for LFP extraction, bandpass filtering for spike sorting, spike sorting, and manual curation of the spike sorting results, and calculation of quality control metrics. In trial-based experiments, the spike trains are aligned and separated into trials. Standard processing may include PSTH computation aligned to trial onset or other events, and often grouped by different trial types.
23+
Neuroscience groups have traditionally developed custom home-made toolchains.
24+
25+
In recent years, several leaders have been emerging as de facto standards with significant community uptake:
26+
+ Kilosort
27+
+ JRClust
28+
+ MountainSort
29+
+ SpyKING CIRCUS
30+
31+
Kilosort provides most automation and has gained significant popularity, being adopted as one of the key spike sorting methods in the majority of the teams/collaborations we have worked with. As part of Year-1 U24 effort, we provide support for data ingestion of spike sorting results from Kilosort.
32+
Further effort will be devoted for the ingestion support of other spike sorting methods. On this end, a framework for unifying existing spike sorting methods, named SpikeInterface, has been developed by Alessio Buccino, et al. SpikeInterface provides a convenient Python-based wrapper to invoke, extract, compare spike sorting results from different sorting algorithms.
33+
34+
## Precursor projects and interviews
35+
36+
Over the past few years, several labs have developed DataJoint-based data management and processing pipelines for Neuropixels probes.
37+
Our team collaborated with several of them during their projects.
38+
Additionally, we interviewed these teams to understand their experiment workflow, pipeline design, associated tools, and interfaces.
39+
These teams include:
40+
41+
+ International Brain Lab - https://internationalbrainlab.org - https://github.com/int-brain-lab/IBL-pipeline
42+
+ Mesoscale Activity Project (HHMI Janelia) - https://github.com/mesoscale-activity-map - https://github.com/mesoscale-activity-map/map-ephys
43+
+ Moser Group (private repository)
44+
45+
## Pipeline Development
46+
Through our interviews and direct collaboration on the precursor projects,
47+
we identified the common motifs to create the Neuropixels Element with the repository hosted at https://github.com/datajoint/elements-neuropixels.
48+
49+
Major features of the Neuropixels Element include:
50+
+ Pipeline architecture defining:
51+
+ Probe, electrode configuration compatible with Neuropixels probes and generalizable to other types of probes (e.g. tetrodes) - supporting both chronic and acute probe insertion mode
52+
+ Probe-insertion, ephys-recordings, LFP extraction, clusterings, curations, sorted units and the associated data (e.g. spikes, waveforms, etc.)
53+
+ Store/track/manage different curations of the spike sorting results
54+
+ Ingestion support for data acquired with SpikeGLX and OpenEphys acquisition systems
55+
+ Ingestion support for spike sorting outputs from Kilosort
56+
+ Sample data and complete test suite for quality assurance
57+
58+
Incorporation of SpikeInterface into the Neuropixels Element will be on DataJoint Elements development roadmap.
59+
Dr. Loren Frank has led a development effort of a DataJoint pipeline with SpikeInterface framework and NeurodataWithoutBorders format integrated (https://github.com/LorenFrankLab/nwb_datajoint).
60+
61+
## Alpha release: Validation sites
62+
We engaged several labs to adopt and validate the Neuropixels Element during the alpha testing phase. These include:
63+
+ Andreas Tolias Lab (BCM) - Anthony Ramos and Saumil Patel
64+
+ The lab uses Neuropixels 1.0 probes, recording in rodents and monkeys in the near future
65+
+ The lab has an existing animal, lab management and imaging pipeline, in need of a Neuropixels ephys pipeline
66+
+ The lab uses OpenEphys acquisition system, we extended the Neuropixels Element to provide support for OpenEphys in order to facilitate adoption/validation with Tolias Lab
67+
+ The lab uses on-premise institutional resource for data infrastructure and hosting
68+
+ Repository: https://github.com/cajal/pipeline
69+
+ BrainCoGs (Princeton Neuroscience Institute) - Manuel Schottdorf, Alvaro Luna
70+
+ DataJoint NEURO conducted a training workshop on 3/01- 03.
71+
+ The Neuropixels Element was adopted, connected to an existing BrainCoGs project pipeline. The ingestion routine was successfully validated on the existing Neuropixels dataset (acquired with SpikeGLX) and Kilosort outputs.
72+
+ Manuel Schottdorf expressed interest in comparison study between different spike sorting algorithms, thus further validating our roadmap to integrate the SpikeInterface framework into the Neuropixels Element
73+
+ The lab uses local institutional resource for data infrastructure and hosting
74+
+ Repository: https://github.com/BrainCOGS/U19-pipeline_python
75+
+ Brody Lab (Princeton) - Adrian Bondy, Alvaro Luna
76+
+ The Brody Lab performs ephys recordings on chronically inserted Neuropixels and tetrode probes. The lab is in the process of converting their existing MySQL database server into a DataJoint-compatible pipeline, and is in need of an ephys pipeline.
77+
+ We have extended the Neuropixels Element and provided a design version capable of supporting chronic probe insertion experiments.
78+
+ Though the ingestion routines are not included for non-Neuropixels probes, the Neuropixels Element’s architecture is compatible to ingest existing tetrode data acquired previously by the Brody Lab
79+
+ The lab uses local institutional resource for data infrastructure and hosting
80+
+ Repository: private repository
81+
82+
## Beta release
83+
As the validation progresses, we expect to produce a beta version of the workflow for users to adopt independently by May 1, 2021.

README.md

Lines changed: 6 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -1,6 +1,7 @@
1-
# DataJoint Element - Canonical Electrophysiology
2-
DataJoint Element for electrophysiology.
3-
This repository features DataJoint pipeline design for extracellular electrophysiology,
1+
# DataJoint Element - Array Electrophysiology Element
2+
DataJoint Element for array electrophysiology.
3+
4+
This repository features DataJoint pipeline design for extracellular array electrophysiology,
45
with ***Neuropixels*** probe and ***kilosort*** spike sorting method.
56

67
The pipeline presented here is not a complete pipeline by itself, but rather a modular
@@ -10,6 +11,8 @@ This modular pipeline element can be flexibly attached downstream
1011
to any particular design of experiment session, thus assembling a fully functional
1112
ephys pipeline.
1213

14+
For background and development progess, see [here](./Background.md).
15+
1316
## The Pipeline Architecture
1417

1518
![ephys pipeline diagram](images/attached_ephys_element.svg)

0 commit comments

Comments
 (0)