14. What’s new#

14.1. Junifer 0.0.3 (2023-07-21)#

14.1.1. Bugfixes#

Enable YAML 1.2 support and allow multiline strings in YAML which would not work earlier by Synchon Mandal (#223)
Handle datalad.IncompleteResultsError exception for partial clone in DataladDataGrabber by Synchon Mandal (#235)

14.1.2. API Changes#

Expose types parameter for DataladAOMICID1000, DataladAOMICPIOP1, DataladAOMICPIOP2 and JuselessUCLA by Synchon Mandal (#132)
Rename junifer.testing.datagrabbers.SPMAuditoryTestingDatagrabber to SPMAuditoryTestingDataGrabber and junifer.testing.datagrabbers.OasisVBMTestingDatagrabber to OasisVBMTestingDataGrabber by Synchon Mandal (#222)
Add BaseFeatureStorage.read() method for storage-like objects by Synchon Mandal (#236)

14.1.3. Improved Documentation#

Improve general prose, formatting and code blocks in docs and set line length for .rst files to 80 by Synchon Mandal (#220)
Update julearn example under examples by Synchon Mandal (#242)

14.1.4. Enhancements#

Change validation of types against patterns to allow a subset of patterns’s types to be used for DataGrabber data fetch by Synchon Mandal (#132)
Rename instances of “Datagrabber” to “DataGrabber” especially in junifer.testing to be consistent by Synchon Mandal (#222)
Use ruamel.yaml instead of pyyaml as YAML I/O library by Synchon Mandal (#223)
Adopt DataGrabber consistently throughout codebase to match with the documentation by Synchon Mandal (#226)
Adopt DataReader consistently throughout codebase to match with the documentation by Synchon Mandal (#227)
Enable stdout and stderr capture for AFNI commands by Synchon Mandal (#234)
Adapt HDF5FeatureStorage.read_df() due to addition of HDF5FeatureStorage.read() by Synchon Mandal (#236)

14.1.5. Features#

Add AICHA v1 and AICHA v2 parcellations to junifer.data by Synchon Mandal (#173)
Add Shen 2013, Shen 2015 and Shen 2019 parcellations to junifer.data by Synchon Mandal (#184)
Add Yan 2023 parcellation to junifer.data by Synchon Mandal (#225)
Introduce onthefly sub-module and read_transform() for quick transform operations on stored data by Synchon Mandal (#237)

14.1.6. Misc#

Consistent docstrings for pytest fixtures used in the test suite by Synchon Mandal (#228)
Adopt ruff as the only linter for the codebase by Synchon Mandal (#229)
Improve codespell support by fixing typos in documentation by Synchon Mandal (#230)
Adopt pre-commit for adding and managing git pre-commit hooks by Synchon Mandal (#232)
Improve docstrings and code style and parametrize remaining tests for junifer.data.parcellations by Synchon Mandal (#238)
Bump numpy version constraint to >=1.24,<1.26 by Synchon Mandal (#241)

14.2. Junifer 0.0.2 (2023-03-31)#

14.2.1. Bugfixes#

Fix a bug in which relative storage URIs will be computed relative to the CWD and not to the location of the YAML file by Fede Raimondo. (#127)
Fix junifer run to respect preprocess step specified in the pipeline by Synchon Mandal (#159)
Fix a bug in which only REST1 and REST2 tasks could be accessed in DataladHCP1200 and HCP1200 datagrabbers by Fede Raimondo (#183)
Fix a bug in which fitting a marker (e.g. SphereAggregation) on a specific type (e.g.: BOLD) will fail if another non-supported type (e.g.: BOLD_confounds) is present in the data object by Fede Raimondo (#185)
Fix ALFFParcels, ALFFSpheres, ReHoSpheres and ReHoParcels pass the extra_input parameter by Fede Raimondo (#187)
Fix several markers that did not properly handle the extra_input parameter by Fede Raimondo (#189)
Fix a bug in which relative paths in the YAML with directive would be computed relative to the current working directory of the process instead of the location of the YAML file by Fede Raimondo. (#191)
Fix an issue with datalad cache and locks in which the user-specific configuration might create a conflict in high throughput systems by Fede Raimondo (#192)
Fix a bug in which ParcelAggregation could yield duplicated column names if two or more parcels were used and label names were not unique by Fede Raimondo (#194)
Fix a bug in which count() will not be correctly applied across an axis by Fede Raimondo (#195)
Fix an issue with datalad cache and locks in which the overridden settings in Junifer were not propagated to subprocesses, resulting in using the default settings by Fede Raimondo (#199)
Fix a bug in which get_mask() fails for FunctionalConnectivityBase class, because of missing extra_input parameter by Leonard Sasse (#200)
Fix the output of RSSETSMarker to be 2D by Synchon Mandal (#215)

14.2.2. API Changes#

Add confounds_format parameter to PatternDataGrabber constructor for improved handling of confounds specified via BOLD_confounds data type by Synchon Mandal (#158)
Rename store_table() to store_vector() for storage-like objects and adapt marker-like objects to use "vector" in place of "table" for storage. Also, improve the logic of storing vectors by Synchon Mandal (#181)
Add ica_fix parameter to DataladHCP1200 and HCP1200 datagrabbers to allow for selecting data processed with ICA+FIX. Default value is False which changes behaviour since 0.0.1 release. By Fede Raimondo (#183)
Add pre_run parameter to _queue_condor by Fede Raimondo (#188)
Expose allow_overlap parameter in SphereAggregation and related markers by Fede Raimondo (#190)
Rename AmplitudeLowFrequencyFluctuationParcels and AmplitudeLowFrequencyFluctuationSpheres to ALFFParcels and ALFFSpheres by Synchon Mandal (#216)

14.2.3. Improved Documentation#

Add more documentation on registering parcellations, coordinates, and masks by Leonard Sasse (#166)
Migrate and document changelog creation and maintenance via towncrier by Synchon Mandal (#203)
Add copy button to documentation code blocks by Synchon Mandal (#205)
Add sections starting and help in the documentation by Fede Raimondo (#210)
Shorten Sphinx references across code and docs, and add black shield in README by Synchon Mandal (#218)

14.2.4. Enhancements#

Organize functional connectivity markers in junifer.markers.functional_connectivity by Synchon Mandal (#107)
Change HCP datagrabber tests to decrease CI running time by Fede Raimondo (#155)
Allow PartlyCloudyTestingDataGrabber to be accessible via import junifer.testing.registry by Synchon Mandal (#160)
Update docstrings and fix typo in log message by Synchon Mandal (#165)
Add fMRIPrep brain masks to the datagrabber patterns for all datagrabbers in the aomic sub-package by Leonard Sasse (#177)
Improved logging output for preprocessing, collecting and pipeline building from YAML by Fede Raimondo (#185)
Allow for empty spheres in JuniferNiftiSpheresMasker, that will result in NaNs. Also, modify the behaviour of the collect parameter in HTCondor queue function to run a collect job even if some of the previous jobs fail. This is useful to collect the results of a pipeline even if some of the jobs fail by Fede Raimondo (#190)
Allow for empty parcels in ParcelAggregation, that will result in NaNs by Fede Raimondo (#194)
Improve metadata and data I/O for HDF5FeatureStorage by Synchon Mandal (#196)
Force datalad to be non-interactive on queued jobs by Fede Raimondo (#201)
Add missing abstractmethod decorators for get_valid_inputs methods of BaseMarker and BasePreprocessor by Synchon Mandal (#214)

14.2.5. Features#

Add EdgeCentricFCParcels and EdgeCentricFCSpheres by Leonard Sasse (#64)
Expose a merge_parcellations() function to merge a list of parcellations by Leonard Sasse (#146)
Add support for HDF5 feature storage via HDF5FeatureStorage by Synchon Mandal (#147)
Add TemporalSNRParcels and TemporalSNRSpheres by Leonard Sasse (#163)
Add support for Power coordinates by Synchon Mandal (#167)
Add support for Dosenbach coordinates by Synchon Mandal (#168)
Add support for nilearn computed masks (compute_epi_mask, compute_brain_mask, compute_background_mask, fetch_icbm152_brain_gm_mask) by Fede Raimondo (#175)
Add aggregation function count() that returns the number of elements in a given axis. This allows to count the number of voxels per sphere/parcel when used as method in markers by Fede Raimondo (#190)

14.3. Junifer 0.0.1 (2022-12-20)#

14.3.1. Bugfixes#

Fix a bug in which a PatternDataGrabber would now work with relative datadir paths (reported by Leonard Sasse, fixed by Fede Raimondo) (#96, #98)
Fix a bug in which DataladAOMICPIOP2 datagrabber did not use user input to constrain elements based on tasks by Leonard Sasse (#105)
Fix a bug in which a datalad dataset could remove a user-cloned dataset by Fede Raimondo (#53)
Fix a bug in which CLI command would not work using elements with more than one field by Fede Raimondo
Fix a bug in which the generated DAG for HTCondor will not work by Fede Raimondo (#143)

14.3.2. API Changes#

Change the single_output default parameter in storage classes from False to True by Fede Raimondo (#134)

14.3.3. Improved Documentation#

Add an example how to use junifer and julearn in one pipeline to extract features and do machine learning by Leonard Sasse, Nicolas Nieto, and Sami Hamdan (#40)
Add documentation for the datagrabbers by Leonard Sasse, Nicolas Nieto, and Sami Hamdan
Change documentation template to furo. Fix references and standardize documentation by Fede Raimondo (#114)

14.3.4. Enhancements#

Add comments to DataladDataGrabber datagrabber and change to use datalad-clone instead of datalad-install by Benjamin Poldrack (#55)
Upgrade storage interface for storage-like objects by Synchon Mandal (#84)
Add missing type annotations by Synchon Mandal (#74)
Refactor markers on attribute and get_valid_inputs to verify that the marker can be computed on the input data types by Fede Raimondo
Add test for DataladHCP1200 datagrabber by Synchon Mandal (#93)
Refactor DataladAOMICID1000 slightly by Leonard Sasse (#94)
Rename “atlas” to “parcellation” by Fede Raimondo (#116)
Refactor the BaseDataGrabber class to allow for easier subclassing by Fede Raimondo (#123)
Allow custom aggregation method for SphereAggregation by Synchon Mandal (#102)
Add support for “masks” by Fede Raimondo (#79)
Allow ParcelAggregation to apply multiple parcellations at once by Fede Raimondo (#131)
Refactor PipelineStepMixin to improve its implementation and validation for pipeline steps by Synchon Mandal (#152)

14.3.5. Features#

Implement SPMAuditoryTestingDataGrabber datagrabber by Fede Raimondo (#52)
Implement matrix storage in SQliteFeatureStorage by Fede Raimondo (#42)
Implement FunctionalConnectivityParcels marker for functional connectivity using a parcellation by Amir Omidvarnia and Kaustubh R. Patil (#41)
Implement register_coordinates(), list_coordinates() and load_coordinates() by Fede Raimondo (#11)
Add DataladAOMICID1000 datagrabber for AOMIC ID1000 dataset including tests and creation of mock dataset for testing by Vera Komeyer and Xuan Li (#60)
Add support to access other input in the data object in the compute method by Fede Raimondo
Implement RSSETSMarker marker by Leonard Sasse, Nicolas Nieto and Sami Hamdan (#51)
Implement SphereAggregation marker by Fede Raimondo (#83)
Implement DataladAOMICPIOP1 and DataladAOMICPIOP2 datagrabbers for AOMIC PIOP1 and PIOP2 datasets respectively by Leonard Sasse (#94)
Implement JuselessDataladCamCANVBM datagrabber by Leonard Sasse (#99)
Implement JuselessDataladIXIVBM CAT output datagrabber for juseless by Leonard Sasse (#48)
Add junifer wtf to report environment details by Synchon Mandal (#33)
Add junifer selftest to report environment details by Synchon Mandal (#9)
Implement JuselessDataladAOMICID1000VBM datagrabber for accessing AOMIC ID1000 VBM from juseless by Felix Hoffstaedter and Synchon Mandal (#57)
Add fMRIPrepConfoundRemover by Fede Raimondo and Leonard Sasse (#111)
Implement CrossParcellationFC marker by Leonard Sasse and Kaustubh R. Patil (#85)
Add JuselessUCLA datagrabber for the UCLA dataset available on juseless by Leonard Sasse (#118)
Introduce a singleton decorator for marker computations by Synchon Mandal (#151)
Implement ReHoParcels and ReHoSpheres markers by Synchon Mandal (#36)
Implement ALFFParcels and ALFFSpheres markers by Fede Raimondo (#35)

14.3.6. Misc#

Create the repository based on the mockup by Fede Raimondo