Changelog¶
Change Log¶
This document records the main changes to the sdss_access code.
3.0.5 (unreleased)¶
PR
62
- Fix issue61
: removed use ofdisutils
which has been Deprecated in Python 3.12. Also pin Sphinx to<7.3.0
to addressthis issue
.Adding
-i
to rsync stream command to accommodate issues with new Mac OS Sequoia
3.0.4 (03-08-2024)¶
Fix issue
52
- rsync failure when remote file is compressed compared to templateIssue
48
- Add support for adding temporary paths for use in local sdss_accessIssue
55
- Add support for adding resolved urls or filepaths into sdss_access remote downloadPR
57
- Enables symlink following by default. Adds afollow_symlinks
option to thecommit
method.
3.0.3 (11-29-2023)¶
Add new
tilegrp
method for grouping LVM tile idsUpdates test action to use the latest tree git repo
3.0.2 (11-2-2023)¶
Add support for .fz compression
Release for IPL-3
3.0.1 (2023-06-17)¶
Bug fix for remote access to IPLs > IPL-1
3.0.0 (2023-06-05)¶
Fixing sdss_access after
tree
updates. “sdsswork” now references SDSS-V paths.Pins
tree
package to>4.0
Adds new pattern for detecting required keywords in special functions
2.0.6 (2023-06-02)¶
Adds new
configsubmodule
special function.Pins
tree
package to<4.0
.
2.0.5 (2022-11-30)¶
Bug fix for downloading IPL-1 products with sdss_access
2.0.4 (2022-11-30)¶
Fixing broken tests with MWM paths
2.0.3 (2022-10-15)¶
Minor path fixes for MWM and Astra paths
2.0.2 (2022-09-08)¶
Adds new
isplate
andpad_fieldid
special functions for BHM paths.
2.0.1 (2022-05-13)¶
Adds new
configgrp
special function.
2.0.0 (2021-09-24)¶
Breaking Change: switches
sdss_access
to use new SDSS dtn.sdss.org serverFeature: adds new “data.sdss5.org” server to support rsync, curl, and http downloads for sdss5 products
Adding new Sphinx docs for SDSS collaboration authentication
Updates the public release check to now check todays date against the tree release date, and “DR” in release name.
1.1.1 (2020-11-11)¶
Feature - Adds new functions for mwm
healpixgrp
,apginst
, andapgprefix
to determine other keywords from existingtelescope
kwargSupport #25 - Adds
preserve_envvars
option to preserve original os environment variables
1.1.0 (2020-07-07)¶
1.0.1 (2020-05-28)¶
Bug Fix #16 - HttpAccess used in public mode checks for netrc file
Combines separate
set_auth
methods inBaseAccess
andHttpAccess
into a singleset_auth
available asAuthMixin
Auth.set_netrc
now raises anAccessError
on failure to find a value netrc file.
1.0.0 (2020-05-07)¶
Refactored¶
Modified sdss_access to use the new versioned tree. Removes input and dependency on single
sdss_paths.ini
file.sdss_access no longer uses ConfigParser to parse the
sdss_paths.ini
filepath templates are passed in directly from the
tree
python productThe symbol for “special function” path definition has changed from
%
to@
sdss_access
now checks for compressed/uncompressed files on disk compared to its path template definitionremote access classes, i.e
RsyncAaccess
, no longer need both public and release to be specified to access DRs. Sets public=True automatically ifDR
in release name.Added
path.changelog
module with newcompute_changelog
andget_path_templates
functions to compute changes in paths between releasesMoved tests out of
sdss_access
python package to top level.Deprecated included logger and config in favor of
sdsstools
logger and config.Simplified python package setup.cfg and consolidated requirements files
0.2.11 (2020-05-07)¶
Pinning sdss-tree requirement to <3.0
0.2.10 (2020-04-23)¶
Fixed¶
Bug in remote file existence check for following redirects.
0.2.9 (2019-12-06)¶
Fixed¶
0.2.8 (2019-11-12)¶
Added¶
new extract method to return extracted keywords from a given filename
new tests for sdss_access.path
methods to extract and look up source code given a method name
sdss_access now has a
CurlAccess
class to enable use on Windows OSimplemented new
BaseAccess
class to abstract out commonalities betweenRsyncAccess
andCurlAccess
added a general
Access
class which handles the choice betweenRsync/CurlAccess
issue #10 - added public access for
HttpAccess
merged PR #6 - add curl as an access method
Changed¶
expanded lookup_keys to also look for keywords inside special % functions
moved special function template substitution into a separate method
replaced template envvar substitution with os.path.expandvars
updating yaml.load to use FullLoaded in compliance with pyyaml 5.1
changing disutils.strictversion to parse_versions
moved methods from RsyncAccess and CurlAccess into common BaseAccess
refactored the test suite to add tests on DR data, and simplify new path entries
Fixed¶
Bug fix for pathlib on 2.7 python systems
Issue #9 Bug fix in generate_stream_task for public rsync locations
0.2.7 (2018-09-06)¶
Added¶
Ability to check for a remote file existence on the SAS
Changed¶
rsync.reset now resets both the initial stream and the real stream
rsync.add now accepts the full keyword argument
rsync.full now checks for itself in kwargs and returns that
0.2.6 (2018-07-10)¶
Fixed¶
Bug when checking for missing keys; removes key format from variable name
0.2.5 (2018-07-09)¶
Added¶
New tests for Path and RsyncAccess
Public toggling (now replants Tree upon init of Path or RsyncAccess)
lookup_names method to look up all the available sdss_path names
Changed¶
Wrapped config file opens in ‘with’ to ensure proper file closures
Cleaned up some verbose warnings
Accessing a ‘full’ keyword argument in Path methods to ensure proper handling
path generation now fails with KeyError when missing input keyword arguments
Fixed¶
Bug with RsyncAccess not properly working with public data releases
0.2.4 (2017-12-05)¶
Added¶
Method to lookup the keyword arguments needed for a given path name
Sphinx plugin to auto document the sdss_access path definitions
0.2.3 (2017-12-02)¶
Added¶
Added new Sphinx documentation and wrote some stuff
Changed¶
Migrated sdss_access over into the cookiecutter model