-
Notifications
You must be signed in to change notification settings - Fork 23
add recursive symmetry checks + check for existing attr #1626
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
base: main
Are you sure you want to change the base?
Conversation
9d4bf3e to
357e961
Compare
ae0cae7 to
1345bac
Compare
05720e3 to
83e2944
Compare
83e2944 to
721b7c8
Compare
721b7c8 to
573167a
Compare
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
EnzymeJAX Benchmarks
| Benchmark suite | Current: 173903f | Previous: b55ffd4 | Ratio |
|---|---|---|---|
scatter_sum / JaX / cpu / Primal |
0.00000438585311640054 s |
0.000004338932399696205 s |
1.01 |
scatter_sum / JaXPipe / cpu / Primal |
0.000004262724006548524 s |
0.000004298453299998073 s |
0.99 |
scatter_sum / JaX / tpu / Primal |
0.0001382552735041 s |
0.0001558048111997 s |
0.89 |
scatter_sum / JaXPipe / tpu / Primal |
0.0001349988545058 s |
0.0001522772955002 s |
0.89 |
This comment was automatically generated by workflow using github-action-benchmark.
src/enzyme_ad/jax/Utils.cpp
Outdated
| if (isa<enzymexla::SymmOp>(op)) { | ||
| return State::GUARANTEED; | ||
| } |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Is this generally true? it is true for syrk but not for symm if B is not symmetric
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
yup you're right, there's no op for syrk yet right?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
correct
src/enzyme_ad/jax/Utils.cpp
Outdated
| recursiveCheck = true; | ||
| } | ||
|
|
||
| if (isa<stablehlo::TransposeOp>(op), isa<stablehlo::DotGeneralOp>(op)) { |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
for dot general it only holds if the operands commute, not in general I think
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
even then not necessarily since you could have batched dimensions
|
Okay I just got rid of the wrong checks |
No description provided.