Skip to content

Conversation

pull[bot]
Copy link

@pull pull bot commented Feb 17, 2023

See Commits and Changes for more details.


Created by pull[bot]

Can you help keep this open source service alive? 💖 Please sponsor : )

* Add: `sparsezoo.deployment-package` from `sparsify.package`

* Address: review comments
Fix: Failing tests
Refactor: Get `Dockerfile` path programmatically and also add it to `MANIFEST.in`

* Propagate: `directory`

* Move: Dockerfile inside src

* Potential bug fix

* Style

* Raise error when no filtered candidates found
@pull pull bot added the ⤵️ pull label Feb 17, 2023
rahul-tuli and others added 27 commits February 17, 2023 09:35
* Add: `sparsezoo.analyze`

* Add: basic cli tests for `sparsezoo.analyze`

* Fix: Summary Metrics displayed on screen

* Address: review comments

* Update: Summary

* Style Fixes

* Fix: failing tests by trying to extract throughput instead of latency

* Print summary as table
link to sparsification backgrounder updated to new location
* Dummy graphql requests module

* graphql api request

* return Model instances

* Update NOTICE (#242)

license name change

* bump main to 1.4.0 (#246)

Co-authored-by: dhuang <[email protected]>

* Pin numpy version to <=1.21.6 (#247)

search

search, download draft

draft, successful search and download

draft

Update: `ModelAnalysis.from_onnx(...)` to additionally work with loaded `ModelProto` (#253)

refactor

search, download

* lint

* pass tests

* init files

* lint

* Add dummy test using test-specific subclass

* tests

* add incremeent_downloads=False

* allow empty arguments

* comments

* refactor from main merge

* comments

* da comments

---------

Co-authored-by: Danny Guinther <[email protected]>
Co-authored-by: Jeannie Finks <[email protected]>
Co-authored-by: dhuangnm <[email protected]>
Co-authored-by: dhuang <[email protected]>
Co-authored-by: Rahul Tuli <[email protected]>
* Dummy graphql requests module

* graphql api request

* return Model instances

* Update NOTICE (#242)

license name change

* bump main to 1.4.0 (#246)

Co-authored-by: dhuang <[email protected]>

* Pin numpy version to <=1.21.6 (#247)

search

search, download draft

draft, successful search and download

draft

Update: `ModelAnalysis.from_onnx(...)` to additionally work with loaded `ModelProto` (#253)

refactor

search, download

* lint

* pass tests

* init files

* lint

* Add dummy test using test-specific subclass

* tests

* add incremeent_downloads=False

* allow empty arguments

* comments

* query parser, allow dict as input, add tests for extra functionality

* restore models.utils

* restore models.utils

* comments

* remove redundant code

---------

Co-authored-by: Danny Guinther <[email protected]>
Co-authored-by: Jeannie Finks <[email protected]>
Co-authored-by: dhuangnm <[email protected]>
Co-authored-by: dhuang <[email protected]>
Co-authored-by: Rahul Tuli <[email protected]>
* Moved: analysis namespace to analyze
Created: a base to make analyze api args + options importable
Updated: `sparsezoo.analyze` cli to use the new importable `analyze_options`

* Remove: code used for local debugging

* Propagate: changes to tests

* Add missed file

* Add: `flake8: noqa` to files that violate F811 as these errors are no longer ignored by noqa: F811

* Conform Analyze CLI with PRD (#280)

* Conform CLI with arg requirements from [PRD](https://docs.google.com/document/d/1ys6FZjcv7cnQL1tVeSditG1IJMnd7dCGMXbfNHlwn-I/edit#heading=h.bpbwnw1mba1c)

* Add impose arg
* fix type

* arguments type

* accept bool as arg value

* remove print

* Update src/sparsezoo/api/graphql.py

Co-authored-by: Danny Guinther <[email protected]>

---------

Co-authored-by: Danny Guinther <[email protected]>
* Moved: analysis namespace to analyze
Created: a base to make analyze api args + options importable
Updated: `sparsezoo.analyze` cli to use the new importable `analyze_options`

* Remove: code used for local debugging

* Propagate: changes to tests

* Add missed file

* Add: `flake8: noqa` to files that violate F811 as these errors are no longer ignored by noqa: F811

* Conform Analyze CLI with PRD (#280)

* Conform CLI with arg requirements from [PRD](https://docs.google.com/document/d/1ys6FZjcv7cnQL1tVeSditG1IJMnd7dCGMXbfNHlwn-I/edit#heading=h.bpbwnw1mba1c)

* Add impose arg

* Add a `.create(...)` function for `ModelAnalysis`
Add tests for creation
Migrate `sparsezoo.analyze` to use `.create`

* Style

* Remove unintended typo

* fix yaml tests

* Resolve: merge conflicts
Merge: Main
Address: Review Comments

* Rework: ModelAnalysis.create(...) if else ladder to load onnx file irrespective of extension
* Moved: analysis namespace to analyze
Created: a base to make analyze api args + options importable
Updated: `sparsezoo.analyze` cli to use the new importable `analyze_options`

* Remove: code used for local debugging

* Propagate: changes to tests

* Add missed file

* Add: `flake8: noqa` to files that violate F811 as these errors are no longer ignored by noqa: F811

* Conform Analyze CLI with PRD (#280)

* Conform CLI with arg requirements from [PRD](https://docs.google.com/document/d/1ys6FZjcv7cnQL1tVeSditG1IJMnd7dCGMXbfNHlwn-I/edit#heading=h.bpbwnw1mba1c)

* Add impose arg

* Add a `.create(...)` function for `ModelAnalysis`
Add tests for creation
Migrate `sparsezoo.analyze` to use `.create`

* Style

* Remove unintended typo

* fix yaml tests

* Resolve: merge conflicts
Merge: Main
Address: Review Comments

* Add: needed changes to summary for performance results

* Move: pretty printing summary into a method of ModelAnalysis class
* Add google analytics logging for the SparseZoo and base constructor. Testing -- QA will handle to ensure GA events are being populated

* fix imports

* add message about how to disable

* test fixes and standardizing analytics names
* Google Analtyics fixes

* fix style
* error handling - send message from graphql

Union to Optional

error message

* error message

* comments

* tests

* tests

* change def name

* error logic
* Dummy graphql requests module

* graphql api request

* return Model instances

* Update NOTICE (#242)

license name change

* bump main to 1.4.0 (#246)

Co-authored-by: dhuang <[email protected]>

* Pin numpy version to <=1.21.6 (#247)

search

search, download draft

draft, successful search and download

draft

Update: `ModelAnalysis.from_onnx(...)` to additionally work with loaded `ModelProto` (#253)

refactor

search, download

* lint

* pass tests

* init files

* lint

* Add dummy test using test-specific subclass

* tests

* add incremeent_downloads=False

* allow empty arguments

* comments

* query parser, allow dict as input, add tests for extra functionality

* restore models.utils

* restore models.utils

* v2 stub

* comments

* change stubs to ones on prod

* lint

* Update src/sparsezoo/model/utils.py

Co-authored-by: Danny Guinther <[email protected]>

* Update src/sparsezoo/model/utils.py

Co-authored-by: Danny Guinther <[email protected]>

* Update src/sparsezoo/api/utils.py

Co-authored-by: Danny Guinther <[email protected]>

---------

Co-authored-by: Danny Guinther <[email protected]>
Co-authored-by: Jeannie Finks <[email protected]>
Co-authored-by: dhuangnm <[email protected]>
Co-authored-by: dhuang <[email protected]>
Co-authored-by: Rahul Tuli <[email protected]>
Co-authored-by: Danny Guinther <[email protected]>
* Add:ModuleAnalysisSummary schema for easily displaying comparing summaries from ModelAnalysis
Add: Tests for yaml serialization of the same

* Move: yaml de-serialization methods to YAMLSerializableBaseModel

* Style

* Add: Tests for serialization, pretty printing, and subtraction

* Get path programmatically

* Add from_analysis method

* Move relevant schemas to models.py
Move ModelAnalysisSummary to analysis.py
Moved analysis tests to a separate dir
Remove extraneous test
Simplify logic
Move Summary generation to a separate class
Delete old code

* Fix failing tests

* Update CLI

* Update CLI

* Add by_types info to analyze api (#292)

* Add by types

* Remove unintended changes

* Style

* Add kwargs

* Fix failing tests

* Fix failing test + `by-layers`

* Add compare functionality

* Add deprecation warning for `ModelAnalysis.pretty_print_summary(...)`
Move pandas import within a pretty_print_summary(...) function that will be deprecated in a future version

* Add `by-layers` support to analyze api(s) (#301)

* Remove Not Implemented Error

* Add: `by-layers` analysis
Add: total property to `ZeroNonZeroParams`

* Propagate `by-layers` to comparison summary

* Rename: LINEAR_OP_TYPES --> TARGETED_LINEAR_OP_TYPES

* BugFix: int32 was ignored from dense ops during analysis by types

* Add support to compare by types and layers (#302)

* Feature: Add compare across types and layers

* Renames:
 * sparsity --> sparsity_percent
 * quantized --> quantized_percent

 Update: Size calculation to include sparsity
 Add: __name__ to avoid using root logger
 Added: slight improvements to print messaging, and logs
 Style Updates

* Rename:
* _get_entries_to_compare --> _get_comparable_entries

* Add: docstrings

* Add: Multiline row printing (#303)

* Feature: Add compare across types and layers

* Renames:
 * sparsity --> sparsity_percent
 * quantized --> quantized_percent

 Update: Size calculation to include sparsity
 Add: __name__ to avoid using root logger
 Added: slight improvements to print messaging, and logs
 Style Updates

* Rename:
* _get_entries_to_compare --> _get_comparable_entries

* Add: docstrings

* Add: Support to print multiline rows

* Connect Deepsparse.Analyze (#304)

* Feature: Add compare across types and layers

* Renames:
 * sparsity --> sparsity_percent
 * quantized --> quantized_percent

 Update: Size calculation to include sparsity
 Add: __name__ to avoid using root logger
 Added: slight improvements to print messaging, and logs
 Style Updates

* Rename:
* _get_entries_to_compare --> _get_comparable_entries

* Add: docstrings

* Add: Support to print multiline rows

* Connect deepsparse.analyze to sparsezoo.analyze
Add: PerformanceEntry to entry types, else it will be converted to a ModelEntry
Fix: model_name while instantiating PerformanceEntry

* Add: supported_graph_percentage to BenchmarkResult

* Add node level timings

* Style
Replaced community@ email with Neural Magic Contact Us Form link instead.
Updated name of Slack Community reference
python version number updated
updated python version
Slack name changed
George and others added 30 commits February 12, 2024 16:04
* chunk download, break down into 10

* lint

* threads download

* draft

* chunk download draft

* job based download and combining/deleteing chunks

* delete old code

* lint

* fix num jobs if file_size is less than the chunk size

* doc string and return types

* test

* lint
* fix equivalent changes made to analyze_v2 such that inference session works for llms; update wanrings to be debug printouts

* typo
on runtime, to avoid serialization issues
* initial fix

* style
* initial fix

* style

* incorporate sparsity into size calculation

* quality
* add more info on what chunk is downloading, and make chunk folder foe each file

* fix bug

* comments

* add .cache/sparsezoo/neuralmagic/
* src/sparsezoo/utils/download.py

* revert readme"
* import util

* com
* add workflow to use nm-actions and build wheels for dev, release, nightly

* update github conditions

* update actions name now that they are merged

* update to main
Fixing expired Slack link
Fixed expired Slack link
* Changes from bump-pydantic

* update setup.py

* Style + use v1 basemodel for FeatureStatus

* Update pydantic to <2.8

* Delete extraneous file
* Add failing test

* Fix computed field serialization
* update release build workflow

* debug

* clean up

* minor fix

---------

Co-authored-by: dhuangnm <[email protected]>
numpy 2.0 is released and not yet compatible with this repo
Added EOL announcement to top of page and made minor content edits in response to messaging.
* Update README.md

* Delete CODE_OF_CONDUCT.md

* Delete CONTRIBUTING.md

* Delete DEVELOPING.md

* Update MANIFEST.in

* Update NOTICE

* Update setup.py
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.