Skip to content

Add deduce_jagged_tensor_with_graph_analysis flag for batch dim distinguish - #929

Open
tissue3 wants to merge 1 commit into
facebookincubator:mainfrom
tissue3:export-D49262422
Open

tissue3 wants to merge 1 commit into
facebookincubator:mainfrom
tissue3:export-D49262422

Conversation

@tissue3

@tissue3 tissue3 commented Sep 14, 2023

Copy link
Copy Markdown
Contributor

Summary:
For vdd, it seems that the jagged tensor batch dim is identical to dense tensor batch dim, which caused issue in bmm kernel, that it cannot handle batch size as large as 2^16.

This fix adds a flag deduce_jagged_tensor_with_graph_analysis so that when it is turnt on, we depend on graph analysis, i.e. try_getting_jagged_tensor_map, to deduce batch dim for jagged tensor. This can be more reliable than deducing based on value.

Differential Revision: D49262422

@facebook-github-bot facebook-github-bot added CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. fb-exported labels Sep 14, 2023
@facebook-github-bot

Copy link
Copy Markdown
Contributor

This pull request was exported from Phabricator. Differential Revision: D49262422

…nguish (facebookincubator#929)

Summary:

For vdd, it seems that the jagged tensor batch dim is identical to dense tensor batch dim, which caused issue in bmm kernel, that it cannot handle batch size as large as 2^16.

This fix adds a flag `deduce_jagged_tensor_with_graph_analysis` so that when it is turnt on, we depend on graph analysis, i.e. `try_getting_jagged_tensor_map`, to deduce batch dim for jagged tensor. This can be more reliable than deducing based on value.

Differential Revision: D49262422
@facebook-github-bot

Copy link
Copy Markdown
Contributor

This pull request was exported from Phabricator. Differential Revision: D49262422

@meta-cla

meta-cla Bot commented Aug 29, 2026

Copy link
Copy Markdown

Hi @tissue3!

Thank you for your pull request.

We require contributors to sign our Contributor License Agreement, and yours needs attention.

You currently have a record in our system, but the CLA is no longer valid, and will need to be resubmitted.

Process

In order for us to review and merge your suggested changes, please sign at https://code.facebook.com/cla. If you are contributing on behalf of someone else (eg your employer), the individual CLA may not be sufficient and your employer may need to sign the corporate CLA.

Once the CLA is signed, our tooling will perform checks and validations. Afterwards, the pull request will be tagged with CLA signed. The tagging process may take up to 1 hour after signing. Please give it that time before contacting us about it.

If you have received this in error or have any questions, please contact us at cla@meta.com. Thanks!

This branch has not been deployed

No deployments
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. fb-exported

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants