Longitudinal multi-centre brain imaging studies: guidelines and practical tips for accurate and reproducible imaging endpoints and data sharing
- 117 Downloads
Research involving brain imaging is important for understanding common brain diseases. Study endpoints can include features and measures derived from imaging modalities, providing a benchmark against which other phenotypical data can be assessed. In trials, imaging data provide objective evidence of beneficial and adverse outcomes. Multi-centre studies increase generalisability and statistical power. However, there is a lack of practical guidelines for the set-up and conduct of large neuroimaging studies.
We address this deficit by describing aspects of study design and other essential practical considerations that will help researchers avoid common pitfalls and data loss.
The recommendations are grouped into seven categories: (1) planning, (2) defining the imaging endpoints, developing an imaging manual and managing the workflow, (3) performing a dummy run and testing the analysis methods, (4) acquiring the scans, (5) anonymising and transferring the data, (6) monitoring quality, and (7) using structured data and sharing data.
Implementing these steps will lead to valuable and usable data and help to avoid imaging data wastage.
KeywordsLongitudinal Multi-centre Magnetic resonance imaging Study design Data sharing Guidelines Big data
Brain imaging data structure
Digital Imaging and Communications in Medicine (file type)
Fluid-attenuated inversion recovery
Integrated Research Application System
Institutional review board
Magnetic resonance imaging
Positron emission tomography
Research involving brain imaging contributes to our understanding of common brain diseases such as stroke , dementia , multiple sclerosis  and brain tumours . Imaging endpoints are used in clinical trials [5, 6] to provide objective evidence of beneficial and adverse outcomes, and imaging-derived features have become phenotypes in their own right. Aims will differ across studies, and imaging can be used to drive main endpoints but also as an exploratory tool that contributes to our understanding of disease mechanisms. Longitudinal multi-centre studies, in which patients from different centres are imaged repeatedly over time, allow greater numbers of subjects to be recruited, and can generate insights into disease progression and outcomes that are not available in cross-sectional studies. Such studies are, however, expensive and complex to organise, and require careful co-ordination and management to optimise the answering of research hypotheses.
Large sample sizes help reduce uncertainty and increase reliability in clinical decisions and clinical practice strategies, which are then informed by research evidence. Multi-centre imaging studies are one response to the increasing demand for more data. Generalisability and statistical power are enhanced with a larger study sample size. Such studies promote collaborations across institutions and countries, and experts worldwide will have access to the large data sets and can combine their group expertise  (e.g. http://enigma.ini.usc.edu/).
It is important to ensure that appropriate technologies and strategies are used to manage the large amounts of data generated: some of the challenges include capturing, storing, analysing, searching, sharing, transferring, visualising, querying, protecting and updating data – all in addition to maintaining patient confidentiality and adhering to good clinical practice.
A carefully conducted longitudinal or multi-centre study will yield valuable data, which are essential for addressing the study’s research questions. It is unethical to conduct a study if there is a high risk of data loss or misuse, or other problems that restrict the ability to answer the research question. Not only are high-quality data essential for answering the predefined research question, these data could also help other scientists from all over the world answer other questions. Data sharing and open science are important contemporary topics in medical research. The International Committee of Medical Journal Editors, UK Research and Innovation (https://www.ukri.org/funding/information-for-award-holders/open-access/), and some of the charities now mandate data sharing . This includes the computer code  (image processing pipelines) that generates the research output from images. The Lancet  is promoting improved management and sharing of research data as these reduce ‘research wastage’ and reward scientific diligence; see the REWARD Statement, http://www.thelancet.com/campaigns/efficiency/statement).
Guidelines for designing , recruiting to , organising  and performing quality assurance [14, 15] in multi-centre trials have been published. Brain imaging protocols for large multi-centre imaging data collections also exist, e.g. UK Biobank [16, 17], Alzheimer’s Disease Neuroimaging Initiative (http://adni.loni.usc.edu/methods/documents/mri-protocols/) and the Lothian Birth Cohort , and data standards for clinical research are supported by the Equator Network (http://www.equator-network.org/) and the National Institute of Neurological Disorders and Stroke (https://www.commondataelements.ninds.nih.gov/). Additionally, much emphasis has been placed on data sharing after primary studies are completed. A detailed report (http://www.humanbrainmapping.org/files/2016/COBIDASreport.pdf) – summarised in Nature Neuroscience  – by the Organization for Human Brain Mapping and its Committee on Best Practice in Data Analysis and Sharing (http://www.humanbrainmapping.org/cobidas) includes over 100 items to help plan, execute, report and share neuroimaging research. Recommendations already exist for multi-centre functional magnetic resonance imaging (fMRI) studies  that have specific guidance, such as how to organise metadata  from task-based fMRI. Methodological issues for guarding against false positives and overstating effect sizes in neurogenetic studies have been discussed . However, concrete practical advice, in an easily digestible format, that guides the setting up of a longitudinal multi-centre structural neuroimaging study is lacking.
Results and discussion
The key points explained
Neuroradiologists for general advice and insight, and for reading the images, reporting on incidental findings and advising on which sequences are best suited to answer the research question
Radiographers for practical insights, e.g. a scan protocol with 25 min on-table will require a longer booking slot in a cohort of multiple sclerosis patients with severe movement difficulties
Medical physicists to optimise technical parameters, e.g. to lower the specific absorption rate in MRI sequences with high flip angles or short repetition time, which is particularly relevant at 3 tesla, and for advice on protection from ionising radiation
Radiochemists for advice on tracers for positron emission tomography (PET) and other radionuclide studies
Image analysts to help specify the technical parameters to optimise efficient information extraction. For example, isotropic voxels can be used to reconstruct an image with the same in-plane resolution in different orientations but can bias diffusion estimates ; the planned analysis should guide the acquisition parameters
Data managers for anonymising, storing accurately and robustly, and versioning metadata and moving large volumes of imaging data, which can be expensive and require specialists with specific knowledge of hardware and software
Facilities managers to help cost and resource the project adequately, and to deal with unexpected costs, e.g. staff illness or equipment failure
The imaging manual and related systems of work
Contact details (principal investigator and imaging staff)
Brief introduction and study rationale
Aims and hypotheses, clearly described
Imaging endpoints and outputs—be specific, e.g. total brain tissue volume change over 1 year; white matter hyperintensity burden using the Fazekas scale, etc. This can be enhanced later based on new research findings, but at the minimum a framework that ensures the basic output needed to answer the research questions should be in place from the beginning
Image acquisition including explicit acquisition parameters and radiographer instructions (e.g. “Do not angle acquisition direction on diffusion tensor imaging, but instead plan a straight axial with no in-plane rotation”); pictures can be helpful
Anonymisation procedure, file naming conventions, upload procedure for Digital Imaging and Communications in Medicine files (DICOM)
Quality control (QC) procedure for inter- and intra-site reliability and reproducibility
Details of the image management system (see below)
Appendices (further detailed technical parameters, log sheets to record notes specific to a scan session, e.g. ‘patient anxious’ or ‘only first two sequences acquired’)
Incidental findings  and how they will be handled [25, 26], e.g. if studying multiple sclerosis, there should be a mechanism to deal with a suspected brain tumour. A cogent policy for management of incidental findings is now mandated in UK Research Ethics applications and by the Medical Research Council and Wellcome Trust, both major funders of human imaging research.
If available, follow disease-specific agreed-upon recommendations that guide choice of scan sequences (see the example of a small vessel disease in ) and where relevant new methods of analysis (but ensure the proposed method is relevant to your population and research question and has been validated for your scans and patients).
Harmonisation of sequences across sites: different sites might conduct imaging on different manufacturer’s hardware, and even the same scanner at two different sites might be running different software versions. It is important to investigate these issues and assess any impact on the proposed imaging outcome measures.
A plan to cope with unforeseen circumstances, such as scanner upgrades.
The availability of head coils should also be considered.
In MRI studies, consider safety contra-indications (e.g. a cardiac pacemaker) and subject heating (specific absorption rate). Consider the radiation dose in studies using computed tomography, PET or any radionuclides.
- Consider how the image data and related phenotypes will be stored and managed. The recommendations presented in this paper require an image management system that will handle scan transfers, data housekeeping, systematic reviews of the data and data queries. Involving database experts that understand database schemas is the most robust approach. The upfront cost of developing such a system will be repaid in efficiency gains. Storage of, and linking to, other study data including genetic and clinical variables is a further step in integrating all study data. Combining neuroimaging data with other study variables, particularly if they include full genome sequencing, will result in massive datasets . Figure 3 covers some elements of an image management system, including:
◦ a record of the scan datasets received (when received, which centre sent the data and key variables extracted from the DICOM headers, such as scan date)
◦ notes from the QC process (e.g. pass or fail, and if the scan failed, a reason)
◦ links to where the raw data are stored, notes on how it was processed (including the software used and version numbers, problems encountered and who did the processing), links to where the processed output is stored
An image management system is important. The 3rd International Stroke Trial investigated alteplase in acute ischaemic stroke and used brain imaging as a critical component of the diagnosis and safety outcome assessments. Our centre coordinated imaging from 3035 patients in 156 centres in 12 countries from 2000 to 2012, yielding a total of over 7000 scans. In this trial, which used an efficient image management system, missing scans were queried in 4.2% of patients (only 17 of these (0.5%) were missing in the end) and 2.4% of scans had imaging issues rendering them unsuitable for reading. Either a commercial or open-source image management system is worth investigating. One example is the Hive database system (theHiveDB) , although we have not used it and are unable to comment on its utility. Researchers should attempt to minimise scan losses (by considering this guideline) but also allow for a percentage of losses in power calculations, just as for subject loss to follow-up.
Dummy run test scan
Testing the imaging protocol on a healthy volunteer or patient with the disease of interest is essential. Each site should do this and upload the dummy scan to the hosting facility to verify all aspects of the study are as expected (image quality, anonymisation, and upload and transfer procedures). On-study scanning should start only after acceptance. The analysis pipeline should also be tested at an early stage.
High quality and consistent scans are essential for successful scientific studies. In some studies, images are assessed by radiologists or trained observers, who give their opinion on, for example, disease status or detailed visual scoring, and it is important that image quality is sufficient for such reads. Likewise, images are often processed using automated or semi-automated algorithms that require consistent contrast, resolution and subject positioning, which are dependent upon fixed acquisition parameters such as acquisition orientation, field of view, and matrix, to minimise between-scan noise.
Figure 4(b) is an example of an image acquired (wrongly) in the sagittal direction, resulting in unacceptable in-plane resolution axially. To maximise information, it is important to scan the required anatomy fully and to a consistent standard that permits reproducible analysis. Figure 4(c) shows the last slice inferiorly from an axially acquired FLAIR brain scan with insufficient whole brain coverage, resulting in a large portion of the cerebellar tissue being missing. Not only does this reduce the chance of capturing all disease, but it means that the brain’s intracranial volume cannot be measured, an important metric for determining brain shrinkage.
Data quality and completeness should be checked at the end of the exam before the subject leaves the scanner, and problems should be rectified, time allowing.
Anonymise, file and folder names, and data upload and transfer
Data governance regulations require research data to be anonymised before leaving the health-care system. Ethics committees require anonymisation of personally identifiable information from the raw imaging DICOM data before it is sent to a central host site for analysis, particularly if outside the health provider environment. Participating imaging centres are usually diligent at removing patient names and unique identifiers, but it is also often important to anonymise sex, age and date of birth. The trial sponsor, Caldicott Guardian (https://www.igt.hscic.gov.uk/Caldicott2Principles.aspx) or another data controller may dictate what types of personally identifiable data are permitted in a particular study and this information should be in the imaging manual or the study protocol. The process by which subject-identifiable data are removed from the imaging dataset header files is important and must not also result in removal of data essential for subsequent image analysis. It is possible to recreate facial features, and hence identify individuals, from structural brain imaging data . Consequently, it is recommend to de-face the images, and there are automated tools for this purpose (for example, https://surfer.nmr.mgh.harvard.edu/fswiki/mri_deface).
In longitudinal studies, it is crucial to be able to distinguish scans temporally. Thought should be given to the scan naming convention. The brain imaging data structure (BIDS)  (http://bids.neuroimaging.io/) recommends use of the “ses” prefix in studies with multiple time points to denote the session, e.g. “sub-001_ses-baseline” would indicate a baseline scan for the first subject while “sub-001_ses-12 months” would indicate a 12-month follow-up scan. Inclusion of the date in the scan file name can be helpful. Mixing up baseline and follow-up scans will lead to incorrect scientific results and confound the study.
Often in multi-centre imaging studies, a central site will be the main repository and analysis site. An incomplete upload of a source DICOM file from a satellite to the host site makes it impossible to reconstruct the full image, as shown in Fig. 4(d). Transfers should be checked on receipt for completeness as they happen, or in small batches while it is still possible to repeat the transfer before the original raw data are wiped from the scanner or archived by other means. Checking scans on arrival also allows systematic problems from a particular site to be identified early and rectified before more patients are scanned. It is poor practice to verify upload completeness after the data from many subjects have been transferred, since it makes the job of rectifying problems due to poor site performance or scan transfers more cumbersome if not impossible. Consider manual or automated scan checks. For example, if 60 image slices are expected, did 60 arrive? Regular checking identifies problems early before they multiply among many cases.
Transfers should be to a resilient and secure server infrastructure. Cloud-based or drop box methods that are in common use are unlikely to meet the security requirements.
Brain imaging data needs to be processed to provide meaningful biomedical information. Such processing can be extensive, and processing pipelines are used to automate and facilitate this work and should have robust quality checks at each stage. As well as the examples in this paper, further examples exist, including details on what to look for, how to look for them and the causes (e.g. cbs.fas.harvard.edu/usr/mcmains/CBS_MRI_Qualitative_Quality_Control_Manual.pdf).
Image acquisition – Radiographers should verify completeness (e.g. whole-brain coverage) and attempt to rectify movement and other artefacts at the time of acquisition, per the instructions in the protocol.
Data upload – The person responsible (a radiographer, researcher or the data manager) should ensure proper anonymisation, then transfer the complete exam.
Data receipt – The receiving centre should check that all expected images actually arrived.
Initial QC – After the raw data have been converted to the processing format (e.g. NIfTI), the analyst needs to verify that the scans meet the prescribed quality. For example, was the correct field of view used? Are there any artefacts? Are any orientations not flipped? The analyst should also ensure folder and file naming conventions are consistent and meet the expectation of the processing pipeline.
Pre-processing QC – The output should be checked. For example, did the brain extraction or defacing method perform adequately? Was there poor image registration?
Processing pipeline – Check the compatibility of the output of each piece of software involved in the image processing pipeline beforehand on a subset of representative images from all centres involved.
Post-processing QC – Check masks and manually edit them as required. The output files should be consistently named as per the agreed predefined conventions (e.g. S001_ses-baseline_acq-FLAIR_WMHvol).
Structured data organisation and data sharing
BIDS  standardises the approach to describing and organising neuroimaging data. The use of a structured approach is critical, not only within a single site (so colleagues know what data they are dealing with) but also across collaborating sites, as it makes pooling data far simpler as scripts and processing pipelines do not need to be laboriously re-coded to cater for site-specific nuances. Additionally, the use of this standardised approach makes it more likely that other researchers will easily be able to work on the data, and there are an increasing number of software tools being developed that understand data organised according to BIDS, which opens the possibility for machine-readable analyses.
Collaborative neuroimaging data management systems that promote data sharing exist and their use is encouraged. Consider maximising the benefits of the research to society by making the data available to other researchers either through a university’s repository facilities or, if available and relevant, by submitting the data to a brain bank (for example, see the practical recommendations from the BRAINS Expert Working Group for enhancing the creation, use and reuse of neuroimaging data ).
Plan the study: This includes building relationships with imaging experts who are best placed to ensure the study meets its aims.
Set up an imaging manual with the essential details of the imaging process (e.g. include the scanning protocol and analysis methods). Do this before you apply for a grant or ethical approval. Implement an image management system.
Perform a dummy run before the trial starts in which you test your scan protocol on a volunteer and go through the other imaging procedures needed for successful study performance. Test your analysis methods.
Carefully acquire scans of high quality that are consistent across the study.
Monitor the scan uploading process and make sure the scans are received as expected at the central data site. Decide how to anonymise scans before transferal to other sites.
Implement data QC and quality assurance and feedback at all appropriate study steps (image acquisition, data upload, pre-processing and post-processing) to identify problems early, to give feedback to correct problems and thus, to ensure you have high-quality data.
Use structured data and share the data.
This work was unfunded but the manuscript draws on our experience derived from studies funded by the following: Medical Research Council (G0701120, G1001245 and MR/M013111/1), Wellcome Trust (075611 and WT088134/Z/09/A), Age UK, Lupus UK, Chief Scientist Office (CZB/4/281), Stroke Association (TSA02/01), Chest Heart and Stroke Scotland (ResFell04), Alzheimer’s Society, Row Fogo Charitable Trust (BRO-D.FID3668413) and the Scottish Funding Council through the SINAPSE Collaboration (Scottish Imaging Network—A Platform for Scientific Evidence).
Availability of data and materials
Data sharing is not applicable to this article as no datasets were generated or analysed during the current study.
SJW conceived of the idea. All authors contributed to the research, including clinical and technical input. SJW drafted the manuscript. SJW, RM, MdCVH, CP, ES, DJ, ADW and JMW edited the manuscript. All authors read and approved the final manuscript.
Ethics approval and consent to participate
Consent for publication
We consent to publish the research paper.
The authors declare that they have no competing interests.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
- 1.Wardlaw JM, Smith EE, Biessels GJ, Cordonnier C, Fazekas F, Frayne R, Lindley RI, O’Brien JT, Barkhof F, Benavente OR, Black SE, Brayne C, Breteler M, Chabriat H, DeCarli C, de Leeuw F-E, Doubal F, Duering M, Fox NC, Greenberg S, Hachinski V, Kilimann I, Mok V, van Oostenbrugge R, Pantoni L, Speck O, Stephan BCM, Teipel S, Viswanathan A, Werring D, Chen C, Smith C, van Buchem M, Norrving B, Gorelick PB, Dichgans M. Neuroimaging standards for research into small vessel disease and its contribution to ageing and neurodegeneration. Lancet Neurol. 2013;12(8):822–38. https://www.nature.com/articles/nn.4579.
- 3.Barkhof F, Simon JH, Fazekas F, Rovaris M, Kappos L, de Stefano N, Polman CH, Petkau J, Radue EW, Sormani MP, Li DK, O’Connor P, Montalban X, Miller DH, Filippi M. MRI monitoring of immunomodulation in relapse-onset multiple sclerosis trials. Nat Rev Neurol. 2012;8(1):13–21. https://doi.org/10.1038/nrneurol.2011.190.CrossRefGoogle Scholar
- 4.Ellingson BM, Bendszus M, Boxerman J, Barboriak D, Erickson BJ, Smits M, Nelson SJ, Gerstner E, Alexander B, Goldmacher G, Wick W, Vogelbaum M, Weller M, Galanis E, Kalpathy-Cramer J, Shanker L, Jacobs P, Pope WB, Yang D, Chung C, Knopp MV, Cha S, van den Bent MJ, Chang S, Yung WKA, Cloughesy TF, Wen PY, Gilbert MR, the Jumpstarting Brain Tumor Drug Development Coalition Imaging Standardization Steering Committee. Consensus recommendations for a standardized brain tumor imaging protocol in clinical trials. Neuro-Oncology. 2015;17(9):1188–98. https://doi.org/10.1093/neuonc/nov095. CrossRefPubMedPubMedCentralGoogle Scholar
- 7.Thompson PM, Andreassen OA, Arias-Vasquez A, Bearden CE, Boedhoe PS, Brouwer RM, Buckner RL, Buitelaar JK, Bulayeva KB, Cannon DM, Cohen RA, AM CPJD, Deary IJ, Dennis EL, de Reus MA, Desrivieres S, Dima D, Donohoe G, Fisher SE, Fouche J-P, Francks C, Frangou S, Franke B, Ganjgahi H, Garavan H, Glahn DC, Grabe HJ, Guadalupe T, Gutman BA, Hashimoto R, Hibar DP, Holland D, Hoogman M, Hulshoff Pol HE, Hosten N, Jahanshad N, Kelly S, Kochunov P, Kremen WS, Lee PH, Mackey S, Martin NG, Mazoyer B, McDonald C, Medland SE, Morey RA, Nichols TE, Paus T, Pausova Z, Schmaal L, Schumann G, Shen L, Sisodiya SM, DJA S, Smoller JW, Stein DJ, Stein JL, Toro R, Turner JA, van den Heuvel MP, van den Heuvel OL, van Erp TGM, van Rooij D, Veltman DJ, Walter H, Wang Y, Wardlaw JM, Whelan CD, Wright MJ, Ye J, ENIGMA Consortium. ENIGMA and the individual: Predicting factors that affect the brain in 35 countries worldwide. NeuroImage. 2017;145:389–408. https://doi.org/10.1016/j.neuroimage.2015.11.057.CrossRefPubMedGoogle Scholar
- 8.Taichman DB, Backus J, Baethge C, Bauchner H, de Leeuw PW, Drazen JM, Fletcher J, Frizelle FA, Groves T, Haileamlak A, James A, Laine C, Peiperl L, Pinborg A, Sahni P, Wu S. Sharing clinical trial data: A proposal from the International Committee of Medical Journal Editors. PLoS Med. 2016;13(1):2–4. https://doi.org/10.1371/journal.pmed.1001950.CrossRefGoogle Scholar
- 9.Extending transparency to code. Nat Neurosci. 2017;20(6):761. https://doi.org/10.1038/nn.4579.
- 12.Treweek S, Wilkie E, Craigie AM, Caswell S, Thompson J, Steele RJC, Stead M. Anderson AS on behalf of the BeWEL trial. Meeting the challenges of recruitment to multicentre, community-based, lifestyle-change trials: a case study of the BeWEL trial. Trials. 2013;14(1):436. https://doi.org/10.1186/1745-6215-14-436. CrossRefPubMedPubMedCentralGoogle Scholar
- 16.Miller KL, Alfaro-Almagro F, Bangerter NK, Thomas DL, Yacoub E, Xu J, Bartsch AJ, Jbabdi S, Sotiropoulos SN, Andersson JLR, Griffanti L, Douaud G, Okell TW, Weale P, Dragonu I, Garratt S, Hudson S, Collins R, Jenkinson M, Matthews PM, Smith SM. Multimodal population brain imaging in the UK Biobank prospective epidemiological study. Nat Neurosci. 2017;19(11):1523–36. https://doi.org/10.1038/nn.4393.Multimodal. CrossRefGoogle Scholar
- 17.Alfaro-Almagro F, Jenkinson M, Bangerter NK, Andersson JLR, Griffanti L, Douaud G, Sotiropoulos SN, Jbabdi S, Hernandez-Fernandez M, Vallee E, Vidaurre D, Webster M, McCarthy P, Rorden C, Daducci A, Alexander DC, Zhang H, Dragonu I, Mathews PM, Miller KL, Smith SM. Image processing and quality control for the first 10,000 brain imaging datasets from UK Biobank. NeuroImage. 2018;166:400–24. https://doi.org/10.1016/j.neuroimage.2017.10.034.CrossRefPubMedPubMedCentralGoogle Scholar
- 18.Wardlaw JM, Bastin ME, Valdés Hernández MC, Munoz Maniega S, Royle NA, Morris Z, Clayden JD, Sandeman E, Eadie E, Murray C, Starr JM, Deary IJ. Brain aging, cognition in youth and old age and vascular disease in the Lothian Birth Cohort 1936: rationale, design and methodology of the imaging protocol. Int J Stroke. 2011;6(6):547–59. https://doi.org/10.1111/j.1747-4949.2011.00683.x.CrossRefPubMedGoogle Scholar
- 19.Nichols TE, Das S, Eickhoff SB, Evans AC, Glatard T, Hanke M, Kriegeskorte N, Milham MP, Poldrack RA, Poline J-B, Proal E, Thirion B, Van Essen DC, White T, Yeo BTT. Best practices in data analysis and sharing in neuroimaging using MRI. Nat Neurosci. 2017;20(3):299–303. https://doi.org/10.1038/nn.4500.CrossRefPubMedPubMedCentralGoogle Scholar
- 20.Glover GH, Mueller BA, Turner JA, van Erp TGM, Liu TT, Greve DN, Voyvodic JT, Rasmussen J, Brown GG, Keator DB, Calhoun VD, Lee HJ, Ford JM, Mathalon DH, Diaz M, O’Leary DS, Gadde S, Preda A, Lim KO, Wible CG, Stern HS, Belger A, McCarthy G, Ozyurt B, Potkin SG, FBIRN. Function Biomedical Informatics Research Network Recommendations for prospective multi-center functional magnetic resonance imaging studies. J Magn Reson Imaging. 2013;36(1):39–54. https://doi.org/10.1002/jmri.23572.Function. CrossRefGoogle Scholar
- 24.Morris Z, Whiteley WN, Longstreth WT, Weber F, Lee Y-C, Tsushima Y, Alphs H, Ladd SC, Warlow C, Wardlaw JM, Al-Shahi Salman R. Incidental findings on brain magnetic resonance imaging: systematic review and meta-analysis. BMJ. 2009;339:b3016. https://doi.org/10.1136/bmj.b3016.CrossRefPubMedPubMedCentralGoogle Scholar
- 26.The Royal College of Radiologists. Management of incidental findings detected during research imaging. R Coll Radiol. 2011:1–60 Available at: papers3://publication/uuid/627D4627-FE73-472B-BD26-9FD0F38FC547.Google Scholar
- 30.Gorgolewski KJ, Auer T, Calhoun VD, Cameron Craddoc R, Das S, Duff EP, Flandin G, Ghosh SS, Glatard T, Halchenko YO, Handwerker DA, Hanke M, Keator D, Li X, Michael Z, Maumet C, Nolan Nichols B, Nichols TE, Pellman J, Poline J-B, Rokem A, Schaefer G, Sochat V, Triplett W, Turner JA, Varoquaux G, Poldrack RA. The brain imaging data structure, a format for organizing and describing outputs of neuroimaging experiments. Sci Data. 2016;3:160044. https://doi.org/10.1038/sdata.2016.44.CrossRefPubMedPubMedCentralGoogle Scholar
- 31.Ducharme S, Albaugh MD, Nguyen T-V, Hudziak JJ, Mateos-Perez JM, Labbe A, Evans AC, Karama S, Brain Development Cooperative Group. Trajectories of cortical thickness maturation in normal brain development – The importance of quality control procedures. NeuroImage. 2016;125:267–9. https://doi.org/10.1038/nature12598.DNMT1-interacting. CrossRefPubMedGoogle Scholar
- 33.Shenkin SD, Pernet C, Nichols TE, Poline J-P, Mathews PM, van der Lugt A, Clare Mackay C, Lanyon L, Mazoyer B, Boardman JP, Thompson PM, Fox N, Marcus DS, Sheikh A, Cox SR, Anblagan D, Job DE, Dickie DA, Rodriguez D, Wardlaw JM. Improving data availability for brain image biobanking in healthy subjects: Practice-based suggestions from an international multidisciplinary working group. NeuroImage. 2017;153(February):399–409. https://doi.org/10.1016/j.neuroimage.2017.02.030. CrossRefPubMedPubMedCentralGoogle Scholar
Open AccessThis article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.