replace openmatrix with h5py - #87
Open
jpn-- wants to merge 4 commits into
Open
Conversation
Reopen compatible OMX wrappers through h5py while preserving caller ownership. Add coverage for 2D, 3D, and reload workflows.
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
This pull request removes the use of the
openmatrixpackage throughout the codebase and replaces it with direct usage of theh5pylibrary for reading and writing OMX (Open Matrix) HDF5 files. The change simplifies dependencies, updates documentation and examples, and refactors code to useh5pyAPIs. Additionally, improvements are made to shared memory handling, including support for custom array storage order and better memory management.Dependency and Documentation Updates:
openmatrixfrom all dependency files (envs/development.yml,envs/testing.yml,pyproject.toml,.github/workflows/run-tests.yml) and updated code, documentation, and examples to useh5pydirectly for OMX file operations. [1] [2] [3] [4] [5] [6] [7] [8] [9]Code Refactoring:
openmatrixto useh5py, including insharrow/example_data.py,sharrow/omx.py, andsharrow/tests/test_datasets.py. This includes updating file reading/writing logic and dataset creation. [1] [2] [3] [4] [5]OMX File Handling Improvements:
split_omxfunction insharrow/omx.pyto useh5pyfor splitting OMX files, added helper functions for copying metadata and datasets, and improved output file organization and lookup management.Shared Memory Enhancements:
sharrow/shared_memory.py. [1] [2] [3] [4] [5] [6] [7] [8] [9] [10]API and Type Annotations:
openmatrixand clarify the use ofh5pyobjects, especially insharrow/omx_reader.py. [1] [2]