Code

Compression#41

Code

Open

danlkv wants to merge 159 commits intodevdanlkv/QTensor:devfrom compressiondanlkv/QTensor:compressionCopy head branch name to clipboard

+38,875-240

Commits

Commits on Jan 13, 2023

• first try on compressed contraction

  danlkv

  committed
  fe70198

Commits on Jan 14, 2023

• add complexity estimation based on hypergraph

  danlkv

  committed
  22199b8

• update gitignore (wily, pre-commit)

  danlkv

  committed
  f5b1ee1

• more correct memory estimation with compression

  danlkv

  committed
  f258e68

• add compression_ratio to arguments

  danlkv

  committed
  9540aae

Commits on Jan 21, 2023

• adapt to use slicing

  danlkv

  committed
  0062a50

• Add __getitem__ to CompressedTensor, generalize compressed contraction

  danlkv

  committed
  5708555

Commits on Jan 24, 2023

• Added cuSZx APIs to Compressor class

  mkshah5

  committed
  8098507

Commits on Jan 25, 2023

• first try: reverse order

  danlkv

  committed
  cb05f9f

• merge summation into last einsum in torch backend

  danlkv

  committed
  5482c68

• update submodule

  danlkv

  committed
  3ad55ac

• fix dtype for torch_gpu

  danlkv

  committed
  405d5ab

Commits on Jan 27, 2023

• Add ordering algo as parameter to run.py. Fix merged backend in torch

  danlkv

  committed
  5c90eb6

• Merge branch 'dev' into compression

  danlkv

  committed
  ff40e70

Commits on Jan 28, 2023

• update compression cost test

  danlkv

  committed
  1298fda

• fix bug in profiler summary

  danlkv

  committed
  e9cf799

• fix torch backend bug

  danlkv

  committed
  cdd724b

Commits on Feb 1, 2023

• Merge branch 'dev' into reverse_ix_order

  danlkv

  committed
  2e7831b

Commits on Feb 10, 2023

• Merge branch 'reverse_ix_order' into compression

  danlkv

  committed
  aa351f8

Commits on Feb 23, 2023

• add minimal CUSZCompressor

  danlkv

  committed
  737beab

Commits on Feb 24, 2023

• fix cusz pointer conversion

  danlkv

  committed
  72d1031

Commits on Feb 25, 2023

• Fixed CUDA misaligned address error

  

  Milan Kartik Shah

  committed
  e9f3981

Commits on Feb 26, 2023

• remove unused szx/src/Dynamic* files; minor tweak intest_cost_estimation

  danlkv

  committed
  62f0911

Commits on Feb 27, 2023

• rename merged_indices/ to contraction_algos to host variants of bucket elimination

  danlkv

  committed
  67cb1ff

• add test for reversed order backend

  danlkv

  committed
  976f699

• Updated device compress to use R2R error and threshold

  

  Milan Kartik Shah

  committed
  701adc4

• Reset cuszx library path in wrapper

  

  Milan Kartik Shah

  committed
  b873f6d

• add better slicing tools, integrate reverse contraction

  danlkv

  committed
  b2ffd09

• rename to is_reverse_order_backend

  danlkv

  committed
  a0e00e0

• rename to is_reverse_order_backend

  danlkv

  committed
  e14cf37

• Merge branch 'reverse_ix_order' into compression

  danlkv

  committed
  7b46ec6

• fix dtype issue with test_compresssor

  danlkv

  committed
  8126f30

Commits on Feb 28, 2023

• first try on compressed backend

  danlkv

  committed
  fd3888e

• don't test complex128 or float64. This is not supported

  danlkv

  committed
  ecd18cf

• reverse cupy order

  danlkv

  committed
  77c27df

• Merge branch 'reverse_ix_order' into compression

  danlkv

  committed
  2daa0dc

• reverse cupy tensor index ordering

  danlkv

  committed
  0a7c43f

Commits on Mar 1, 2023

• add compressor backend and tests for it; add cbe/common.py

  danlkv

  committed
  a6ee295

• fix the tests

  danlkv

  committed
  9faae95

• use lazy_import for cupy

  danlkv

  committed
  514a54b

Commits on Mar 2, 2023

• change _get_ordering_ints to get_ordering_ints

  danlkv

  committed
  091bc79

• make adaptive optimizer compatibile with slicing

  danlkv

  committed
  7a1ef39

• make common update_peo_after_slice

  danlkv

  committed
  1902897

• add source for qc_simulation bench

  danlkv

  committed
  8dd69fc

• modify slicing algo to change update_peo strategy; support slice_ext_dict

  danlkv

  committed
  cdde852

• move qtensor profile bench to subfolder

  danlkv

  committed
  e43c2a1

• move compression tests

  danlkv

  committed
  e4113c3

• move Compressor to a separate file

  danlkv

  committed
  10ed7df

Commits on Mar 3, 2023

• add memory leak test

  danlkv

  committed
  9b787d1

• Merge branch 'bench' into compression

  danlkv

  committed
  7a260d4

• maybe fix the memory leak problem; update memory leak test

  danlkv

  committed
  e86e303

• update compression test_memory_leak

  danlkv

  committed
  7d5818c

• Fixed incorrectly initialized variable; test_memory_leak returning consistent compression ratio now

  

  Milan Kartik Shah

  committed
  7756340

• add memory cleanup operations and memory profile compressor/backend

  danlkv

  committed
  75066a5

• update submodule

  danlkv

  committed
  13b2c44

Commits on Mar 5, 2023

• Updated post proc for compression

  mkshah5

  committed
  53d1f88

• Complete merge with fixed for cuszx_entry.cu

  mkshah5

  committed
  e4184b7

• Compilation error fixes

  mkshah5

  committed
  a8c9e70

• Compilation error fixes, integral type error

  mkshah5

  committed
  50be22f

• Updated post_proc to faster kernels

  

  Milan Kartik Shah

  committed
  12dd9c0

Commits on Mar 7, 2023

• Merge branch 'bench' of github.com:DaniloZZZ/Qensor into bench

  

  Dan Lykov

  committed
  df8ca2e

• add memory prof and fix reversed backend

  danlkv

  committed
  43adb66

• Fixed median value array bug

  mkshah5

  committed
  708bc8d

Commits on Mar 9, 2023

• Merge branch 'compression' into bench

  

  Dan Lykov

  committed
  fe8a7d4

• add instructions on how to use main.py

  

  Dan Lykov

  committed
  5307d8e

• fix link in readme

  

  Dan Lykov

  committed
  d89181c

Commits on Mar 17, 2023

• Updated compress pipeline for throughput improvement

  

  Milan Kartik Shah

  committed
  1692096

• Merge branch 'compression' of https://github.com/DaniloZZZ/QTensor into compression

  

  Milan Kartik Shah

  committed
  3c33739

• add new preprocess data for tests

  

  Dan Lykov

  committed
  a091ae3

Commits on Mar 19, 2023

• Updated decompression for faster pre- and post-processing

  

  Milan Kartik Shah

  committed
  2642bae

• Merge branch 'compression' of https://github.com/DaniloZZZ/QTensor into compression

  

  Milan Kartik Shah

  committed
  68dd02a

Commits on Mar 23, 2023

• Improved compression throughput further

  mkshah5

  committed
  0af7bc6

• add small bench analysis script

  

  Dan Lykov

  committed
  1ade10a

• add usage of simple simulation analysis to README.md

  

  Dan Lykov

  committed
  14f6d47

• Added definitions of blocks and threads for kernel launches

  mkshah5

  committed
  7072f36

Commits on Mar 26, 2023

• add simple analysis file, add nvmem monitor

  

  Dan Lykov

  committed
  a0e8630

Commits on Mar 28, 2023

• remove some old prints

  

  Dan Lykov

  committed
  a7e7818

Commits on Apr 3, 2023

• improve compression cusz wrapper. add details in perf

  

  Dan Lykov

  committed
  bd0564f

Commits on Apr 4, 2023

• Merge branch 'compression' into bench

  

  Dan Lykov

  committed
  aae1de3

• threshold real value

  

  Dan Lykov

  committed
  8d5111e

• Merge branch 'compression' into bench

  

  Dan Lykov

  committed
  9e1ea59

• small refactor in bench simulation

  

  Dan Lykov

  committed
  fdd3181

• reduce verbosity, mpi is functional

  

  Dan Lykov

  committed
  7f2d6d4

• minor fix with mpi bench sim

  

  Dan Lykov

  committed
  95c0abf

• add polaris scripts

  

  Dan Lykov

  committed
  98b6fa1

• upload preprocess file

  

  Dan Lykov

  committed
  5f1e786

• minor fix in run script

  

  Dan Lykov

  committed
  80c8edf

• minor fix in mpi run script

  

  Dan Lykov

  committed
  c8d262c

Commits on Apr 5, 2023

• Reduce output compressed buffer size

  mkshah5

  committed
  d2a2d4d

• update submit script

  

  Dan Lykov

  committed
  310e74a

• Merge branch 'compression' into bench

  

  Dan Lykov

  committed
  b9a2c25

• Updated outsize and compressed buffer to reflect accurate value

  mkshah5

  committed
  9664af8

• Merge branch 'compression' into bench

  

  Dan Lykov

  committed
  be16ded

Commits on Apr 20, 2023

• Modifiable data block size

  mkshah5

  committed
  820f8a3

Commits on Apr 21, 2023

• Merge branch 'compression' into bench

  

  Dan Lykov

  committed
  24c6bcb

Commits on May 5, 2023

• adjust slice count in qtensor bench estimation

  danlkv

  committed
  145810d

Commits on May 8, 2023

• Added threshold and grouping code outside CUDA kernel

  mkshah5

  committed
  714fa67

Commits on May 19, 2023

• Added cuSZp as compressor

  mkshah5

  committed
  f53e6ed

• Merge branch 'bench' of github.com:DaniloZZZ/Qensor into bench

  

  Dan Lykov

  committed
  7bf786b

• Merge branch 'compression' into bench

  

  Dan Lykov

  committed
  2ea9d88

Commits on May 22, 2023

• Revert to SZx compression

  mkshah5

  committed
  f2a4305

• Fix lib paths for Compressor

  mkshah5

  committed
  1252c2b

Commits on May 24, 2023

• Merge branch 'compression' into bench

  

  Dan Lykov

  committed
  22e8bc8

Commits on Jun 6, 2023

• Added cuSZ base compressor with only threshold

  mkshah5

  committed
  3894220

• Fixed merge conflicts

  mkshah5

  committed
  a60556c

Commits on Jun 7, 2023

• Added PyTorch based lossy compressor

  mkshah5

  committed
  87184a9

Commits on Jun 12, 2023

• torch transpose changes

  danlkv

  committed
  6a5d472

Commits on Jun 16, 2023

• Merge remote-tracking branch 'origin/bench' into bench

  

  Dan Lykov

  committed
  79fe72e

• fix DOS newline characters

  

  Dan Lykov

  committed
  af8c59e

• Merge branch 'compression' into bench

  

  Dan Lykov

  committed
  7f7a17d

• Updated scale and zero point for quantization

  mkshah5

  committed
  a0591f2

• Merge branch 'compression' into bench

  

  Dan Lykov

  committed
  a1ee144

Commits on Jun 23, 2023

• Updated to add threshold+grouping

  mkshah5

  committed
  e8ebe8c

• Added packbits call to compress bitmap

  mkshah5

  committed
  c13ee3a

Commits on Jun 29, 2023

• Merge branch 'compression' into bench

  

  Dan Lykov

  committed
  888b622

Commits on Jun 30, 2023

• Merge branch 'dev' into bench

  

  Dan Lykov

  committed
  ecc66bb

Commits on Jul 3, 2023

• Updated zero point and grouping criteria

  mkshah5

  committed
  311211f

• Merge branch 'compression' into bench

  

  Dan Lykov

  committed
  b808285

Commits on Jul 7, 2023

• Quantize per channel

  mkshah5

  committed
  4712784

• Added grouping to perchannel quantization

  mkshah5

  committed
  46b6994

• Merge branch 'compression' into bench

  

  Dan Lykov

  committed
  b55bc8a

Commits on Jul 10, 2023

• Added all compressors to Compressor.py

  mkshah5

  committed
  afe92ff

Commits on Jul 11, 2023

• Can change compressor with flag

  mkshah5

  committed
  ec6aee8

• Bug fixes for freeing pointers

  mkshah5

  committed
  df1f8c1

Commits on Jul 18, 2023

• add qaoa parameters config to circuit genm

  

  Dan Lykov

  committed
  d34e0d7

Commits on Jul 21, 2023

• Merge branch 'compression' into bench

  

  Dan Lykov

  committed
  9e10b77

Commits on Jul 24, 2023

• Added new compressor: combines quantization with lossless compression of quant codes

  mkshah5

  committed
  27d44a2

• Updated lib paths in newsz_wrapper.py

  mkshah5

  committed
  fac16fd

Commits on Aug 4, 2023

• Merge branch 'compression' into bench

  

  Dan Lykov

  committed
  75f57dd

• add WriteToDiskCompressor

  

  Dan Lykov

  committed
  1e728c5

Commits on Aug 11, 2023

• Minor cleanup in Compressor.py

  

  Dan Lykov

  committed
  cdd9c35

• Change pynauty to pynauty-nice

  danlkv

  committed
  ac03eb5

Commits on Nov 10, 2023

• add energy simulation to compression bench

  

  Dan Lykov

  committed
  957ddb5

Commits on Dec 1, 2023

• update in slicing history shape

  

  Dan Lykov

  committed
  5f5a15c

• add more info for compression profiling

  danlkv

  committed
  547d05b

Commits on Dec 14, 2023

• compressed contraction memory leak testing

  danlkv

  committed
  4ce7d0c

Commits on Dec 15, 2023

• fix test_leak for cusz. only complex64 works

  danlkv

  committed
  547c5f5

• add test test for leak in contraction

  danlkv

  committed
  12e21f8

Commits on Dec 16, 2023

• fix memory leak problems with cuszx

  danlkv

  committed
  d66c90b

• fix line endings

  danlkv

  committed
  b4a112f

• replace crlf with lf

  danlkv

  committed
  354b4e0

• replace crlf with lf

  danlkv

  committed
  055aef5

• replace crlf with lf

  danlkv

  committed
  c644f8e

• Merge branch 'compression' into bench

  danlkv

  committed
  6ed7f85

• minor torch compressor refactor

  danlkv

  committed
  c667539

• Merge branch 'compression' into bench

  danlkv

  committed
  405314b

• torch compressor fix

  danlkv

  committed
  b52d487

Commits on Feb 9, 2024

• Added cuSZp compressor

  mkshah5

  committed
  a600c99

• Added cuszp, fixed merge conflicts

  mkshah5

  committed
  f4bad2b

Commits on Feb 15, 2024

• Remove empty directory

  mkshah5

  committed
  9bc3d9c

• Added cuSZp src code

  mkshah5

  committed
  92bf98b

• small fix to Compressor api

  

  Danil

  committed
  019b506

• Merge remote-tracking branch 'origin/compression' into compression

  

  Danil

  committed
  9108d80

Commits on Mar 15, 2024

• replace lineend characters

  danlkv

  committed
  a61a658

Commits on Mar 22, 2024

• trying to make cuSZp work

  

  Danil

  committed
  c8447ad

Commits on Apr 26, 2024

• use cuszp module in compressor; add compressors to init.py

  

  Danil

  committed
  447fc32

• add test for compressed energy exp calculation

  

  Danil

  committed
  6137d2c

Commits on May 8, 2024

• fix cuszp implementation

  

  Danil

  committed
  1506748

Commits on May 9, 2024

• cuszp compressor import optional

  danlkv

  committed
  82fb586